[Feature Request]: Create a new hook called "on_page_created" #526
aravindkarnam
started this conversation in
Feature requests
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
What needs to be done?
Create a new hook called "on_page_created" which allows the user to inspect raw HTTP requests/responses, and more
What problem does this solve?
Gives developers access the raw content of requests being sent when a page is crawled (for instance, requests made to other APIs or files, etc.), the responses, and the associated headers.
Target users/beneficiaries
Developers
Current alternatives/workarounds
No response
Proposed approach
Add this hook to execute right after
context.newPage()
inasync_crawler_strategy.py
Beta Was this translation helpful? Give feedback.
All reactions