A small producer to send email messages from a imap account to a kafka broker.
You'll need to set up the environment variables, you can create an env.sh script like this::
export I2K_KAFKA_SERVERS='<broker ip>:<port>' # Comma separated list of kafka brokers
export [email protected] #imap username
read -sp 'password' pass
export I2K_PASSWORD=$pass # imap password
export I2K_IMAP_SERVER=imap.example.com # imap server
export I2K_FOLDER=<email_folder_to_process> # if it is not set, it will process the INBOX
export I2K_TOPIC=the_kafka_topiconce you have the env.sh script you can create an virtual environment and run it for the first time:
virtualenv -p python3 venv
source venv/bin/activate
pip install -r requirements.txt
source env.sh
python src/imap2kafka.py- To work with gmail accounts you need to "enable less secure apps" in the security settings. Outlook accounts works out the box.
- If you need to setup a kafka standalone, maybe this gist can be useful.