update script to https

[danielzsh]

Place an "x" in the corresponding checkbox if it is done or does not apply to this pull request.

• I have tested my code.
• I have added my solution according to the steps here.
• I have followed the code conventions mentioned here.
  • I understand that if it is clear that I have not attempted to follow these conventions, my PR will be closed.
  • If changes are requested, I will re-request a review after addressing them.
• I have linked this PR to any issues that it closes.

[danielzsh]

@thecodingwizard any idea why this doesn't work? python can't fetch https://usaco.org/current/data/dec23_gold_results.html properly, but javascript fetch can?

[thecodingwizard]

What do you mean by "doesn't work"?

Maybe USACO's ddos protection (cloudflare) thinks we're trying to ddos them. That would be very, very annoying.

[danielzsh]

urllib.request.urlopen('https://usaco.org/current/data/dec23_gold_results.html') causes a 403 Forbidden Error, while fetch('https://usaco.org/current/data/dec23_gold_results.html') works fine. After some googling, others have had issues with urlopen and https but none of the fixes they mentioned worked...

[thecodingwizard]

lgtm!

[danielzsh]

wait it still doesn't work though 😭

[thecodingwizard]

oh.. what if you try a different library, like requests? https://pypi.org/project/requests/ (You are running locally, not on Github Actions, right?)

[mjh316]

import urllib.request
req = urllib.request.Request("https://usaco.org/current/data/dec23_gold_results.html", headers={'User-Agent' : "Magic Browser"}) 
con = urllib.request.urlopen( req )
print(con.read())

Have you tried this fix from here? Seems to work locally for me.

[danielzsh]

works for me locally too, lets hope it works on gh actions 🙏 thanks for the help!

[thecodingwizard]

lgtm!

[danielzsh]

wait what, the workflow on master suddenly started working again 😭 (ah nvm it was for a diff reason)
https://github.com/cpinitiative/usaco-guide/actions/runs/8088739231/job/22103377324