Webscraping is not up to date

The AI's web scraping tool (InvokeLLM with add_context_from_internet) is not accessing live web pages. It is using a cached or indexed version of the internet, which makes it impossible to scrape real-time data like job listings. Even when provided with a direct URL to a careers page, it finds old, expired jobs and misses all the current ones. This makes the web scraping feature unreliable for its intended purpose. Please take a look at improving this tool!

Please authenticate to join the conversation.

Upvoters
Status

In Review

Board
💡

Feature Request

Date

7 months ago

Author

Phil Chapman

Subscribe to post

Get notified by email when there are changes.