Installation

pip install datto

Overview

datto is a package with various data tools to help in data analysis and data science work.

Some examples of what you can do:

Remove links from some text
Extract body of an email only (no greeting or signature)
Easily load/save data from S3
Run SQL from Python
Explore data - check for mistyped data, find correlated data
Assign a given user to an experimental condition
Create an HTML dropdown from a DataFrame
Find the most common phrases by a category
Classify free text responses into any number of meaningful groups (e.g. find survey themes)
Make a simple Python logger with default options
Take some data and test various machine learning models on it

For detailed examples of how you can use it, check out this Juypter notebook.

Check out the templates folder for files that automate certain tasks, but don't fit within the realm of a Python package.

Create virtualenv:

pyenv virtualenv datto

Activate virtualenv:

pyenv activate datto

Install dependencies (specified in pyproject.toml file) in virtualenv:

poetry install

To add any new dependencies you need to Poetry, run:

poetry add PACKAGE_NAME

If adding/deleting a module, you'll need to update these files:

Run the following to make sure all tests pass:

make test

Run the following to update all the docs:

make docs

Create a PR with your desired change(s), and request review from the code owner!