You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
A new API method should just take any given url, and return the website's data, along with all fully parsed articles it found through RSS feeds in one go.
Since this may require many HTTP requests, there must be an configuration parameter which can be used to restrict the crawling process, e.g.: only articles less than 24h old, exclude articles that match given URLs (when you already crawled them), and so on.
The text was updated successfully, but these errors were encountered:
A new API method should just take any given url, and return the website's data, along with all fully parsed articles it found through RSS feeds in one go.
Since this may require many HTTP requests, there must be an configuration parameter which can be used to restrict the crawling process, e.g.: only articles less than 24h old, exclude articles that match given URLs (when you already crawled them), and so on.
The text was updated successfully, but these errors were encountered: