-
Clone the repository:
git clone https://github.com/Anthony-Nabil/Electronics-price-tracker cd Electronics-price-tracker
-
Install the requirements:
pip install -r requirements.txt
-
Create a
headers.json
file in the root directory
-
To run the scrapers independently:
python src/scrapers/<scraper_name>.py
For example:
python src/scrapers/amazon-scraper.py
-
The scraped data will be stored in a SQLite database located at
../db/
directory.
src/scrapers/*
: Contains the scraper scripts.headers.json
: Configuration file for request headers.../db/
: Directory where the SQLite database will be stored.../images/
: Directory where product images will be saved.