Skip to content

Files

Latest commit

0ba04c8 · Jan 31, 2024

History

History
12 lines (10 loc) · 395 Bytes

README.md

File metadata and controls

12 lines (10 loc) · 395 Bytes

sxd

sxd is a simple web scraping image downloader This is really a simple toy and we will fix the problems when we feel like it.

dependence

  • python 3.11
  • pip install requests beautifulsoup4

how to use

  1. "URL.txt" with the URLs processed one line at a time.
  2. Run the py script run_serial or run_parallel.
  3. The images will be downloaded in batches to the downloaded_images folder