Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Preprocess needs a settings/configuration file #198

Open
raprasad opened this issue Oct 1, 2019 · 0 comments
Open

Preprocess needs a settings/configuration file #198

raprasad opened this issue Oct 1, 2019 · 0 comments

Comments

@raprasad
Copy link
Contributor

raprasad commented Oct 1, 2019 •
edited
Loading

Preprocess needs a settings/configuration file

  • Purpose: set default values for preprocess assumptions
  • Allows override by environment variables or possible another config file.

Examples of config settings:

  • Date utility

    • Currently years must be between 1600 and 2100, unless column explicitly called year
    • Add YEAR_DETECTION_MIN, YEAR_DETECTION_MAX, or something similar

  • Date recognition

    • Currently, when checking for dates, only the 1st 10 values are checked.
    • Add DATE_DETECT_NUM_CHECK_ROWS (or something similar)
@raprasad raprasad changed the title pre 1600 dates, option to allow user to specify column Preprocess needs a settings/configuration file Oct 1, 2019
@raprasad raprasad mentioned this issue Oct 1, 2019
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@raprasad