Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Purpose
This is a small PR that just does the minimum updates to download 2023 data and run the pipeline, without actually fixing any data quality issues yet. The pipeline did successfully complete but there are a number or errors raised, including a large amount of negative fuel in MISO. It is possible that these will be fixed once we properly go through the entire update process.
Advances CAR-4691
What the code is doing
How is the purpose executed?
Testing
Ran the pipeline
Where to look
It's helpful to clarify where your new code lives if you moved files around or there could be confusion/
What files are most important?
Usage Example/Visuals
How the code can be used and/or images of any graphs, tables or other visuals (not always applicable).
Review estimate
5 minutes
Future work
The data pipeline log file was over 300MB because it output a large amount of hourly data in the warning. We should limit these warnings in the future to just print a sample of the data
Checklist
black