Price changes have not updated since 7th January

[amydelroc]

Hello, i love your hotprices website and use it daily. I have noticed that it has not updated for 3 weeks but not sure if you are aware. Looks like the scrape for groceries is not working. Any chance you could take a look? Thank you! @Javex

[kylemd]

There seems to be issues with Coles being scraped currently. Javex has made some changes tonight so is currently working on it.

[Javex]

Hey, yes thanks for reporting this issue, I was aware it was broken, but didn't know anyone was using it. I've been trying to fix it, Coles bot protection is stopping it. Unfortunately, I haven't been successful so far and this isn't really an area I have a lot of experience in. I'll keep trying, but if anyone knows what to do, I'd appreciate the help.

[kylemd]

@Javex I've been using it every week, it is an amazing tool and has saved me a heap already. Thank you so much for your efforts in maintaining and hosting it.

I will make a post on OzBargain today to see if there may be some devs there that can chip in. I will also try to have a crack at it over the weekend (although with three kids, time is a precious commodity!)

[PetePeter]

i came here from the ozbargain referral.
have you tried using different user agent strings, or adding a random pause between requests?

[Javex]

Hey everyone, I managed to do a quick local scrape and have pushed updated price data for today. It's not fixed yet, but I think I know what to do.

[amydelroc]

Thanks so much! Really appreciate it. Sent from my iPhoneOn 31 Jan 2025, at 21:32, Flozza ***@***.***> wrote: Hey everyone, I managed to do a quick local scrape and have pushed updated price data for today. It's not fixed yet, but I think I know what to do. —Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you authored the thread.Message ID: ***@***.***>