Dataduct v2

Changes

• Added Travis integration for continuous builds
• Added QA steps and logging to S3
• Added pipeline visualization command
• Updated Dataduct CLI to a single entry point
• Added RDS connections for scripts
• Added bootstrap step for pipelines
• Added backfill or delay activation
• Added utput path and input path options
• Added ability to specify a script directory for transform steps
• Added SQL sanitization for DBA actions
• Added SQL parser for select and create table statements
• Added logging across the library
• Introduced support for custom steps
• Added pipeline dependency step
• Reduced verbosity of imports
• Step parsing is now isolated in steps
• Added more examples for steps
• Added configuration file sync with S3
• Added config overrides with modes
• Renamed keywords and safe config failure handling
• Added EMR streaming support with hadoop 2
• Cleaned up exceptions
• Added read the docs support
• Tables are now created automatically for various steps
• Added history table support
• EC2 and EMR config control from YAML
• Added slack integration
• Added support for regions in AWS