Merge pull request #6 from DNXLabs/docs/adding-tip-readme

📝 Adding tip to automate the list of files
DNXLabs · Mar 15, 2022 · 7c14baa · 7c14baa
2 parents 7809e4b + c8ee662
commit 7c14baa
Showing 1 changed file with 6 additions and 1 deletion.
diff --git a/scripts/parallel-script/README.md b/scripts/parallel-script/README.md
@@ -32,10 +32,15 @@ These scripts will help you to start a multi thread processment either for `aws
         file2
         file3
         ```
+        💡 You can use the AWS CLI to create your list of files, here is how to do it:
+
+        ```
+        aws s3 ls s3://ORIGIN_BUCKET --recursive | awk '{$1=$2=$3=""; print $0}' | sed 's/^[ \t]*//' > my_files_list.txt & tail -F my_files_list.txt
+        ```
 
 - main()
     - pool = the number of threads running at the same time
 
 ## Changing the scripts
 
-The scripts in this repo are examples. Feel free to change them to run your own parallel command. When changing the scripts don't forget to change the function to list whatever you want. 
+The scripts in this repo are examples. Feel free to change them to run your own parallel command. When changing the scripts don't forget to change the function to list whatever you want.