This Python script scrapes the Volkswagen GTI inventory from the official VW website and filters the results based on specified criteria (e.g., manual transmission). The script can be scheduled to run periodically to monitor the inventory for new listings.
Before running the script, ensure you have the following installed:
- Python 3.6 or later
- Google Chrome browser
- ChromeDriver (compatible with your Chrome version)
Additionally, you need to run the following command in the terminal to install the required Python packages:
pip install -r requirements.txt
The config.ini
file contains the following settings that you can update as needed:
zip_code
: The zip code for searching the inventorymanual_only
: Set toTrue
if you want to search for manual transmission cars only, otherwise set toFalse
radius
: The search radius (in miles) around the specified zip code
To run the script, execute the following command:
python scraper.py
By default, the script will run once when executed. You can modify the scheduling interval in the scraper_vw.py
file by updating the following line:
schedule.every(1).hours.do(job)
Change the 1 to the desired interval (in hours) between scraper runs.
The script will print the progress and the car information as it scrapes the inventory. You can update the scrape_cars() function to process the car information as needed (e.g., save to a file, send an email).
- What to do with the output
- automate an email or text to dealer if criteria are met
- alert me when this has happened
- fix total price output
- refactor code
- GUI?
This project is licensed under the MIT License. See the LICENSE file for details.