This project is made to scrap text data from URL and save it to .txt files.
You will need Poetry to be installed: https://python-poetry.org/docs/
Install project dependencies using Poetry then: poetry install
Check parameters of the program: poetry run scrap -h
Default URL is used, use -u argment to change it (If specific website support is required- contact me for development/ create pull request)
To run the script, use the following command: poetry run scrap 1 2 (Replace 1 2 with the desired start and end page numbers.)
Below you can find Asciinema of the project, enjoy!
Parsing 2 pages:
