Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Daylight saving time error when dowload a full year data #1

Open
MaykThewessen opened this issue Apr 19, 2024 · 1 comment
Open

Daylight saving time error when dowload a full year data #1

MaykThewessen opened this issue Apr 19, 2024 · 1 comment

Comments

@MaykThewessen
Copy link

I get an error when downloading a whole year, due to summer time difference (DST) error

issue is that during DST switch, one hour gets data missing
at DST reversal, two hour data points are overlapped, thus broken data again
How to solve this? And download full year 15min power values?

How to get the full year data in one line?

instead of adding up days after each other

@sfirke
Copy link
Owner

sfirke commented Apr 19, 2024

I can't try it out right now, but I just had to deal with this same problem for data at my job -- hourly usage data from building electrical meters. I did some research and concluded that the generic best practice way to handle this was:

  1. For the two hours that occur twice, average them
  2. For the hour that never occurs, take the average of the preceding and following value

Now this time change happens at ~2am at least where I live. During that time the solar generation would be zero. Meaning that this method could be applied with no hit to precision of the data, unlike at say, a water plant that uses electricity 24/7.

Something should be added to the script to incorporate this check for data missingness/duplication.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants