I just subscribed to the Elite version, but the live crawling feature is not working. When I enter the URL in the format “https://*****.com/” and press enter, I get the message:
“Live Crawling of ‘[The URL I entered]’ failed. Please try again later.” It doesn’t work at all. I’ve tested it with multiple websites (English sites), and it hasn’t worked even once.
I have tested numerous URLs, including Wikipedia, select articles on CNN, and various blogs.
Unfortunately, all attempts and URLs have resulted in failure.
I understand your frustration and appreciate your patience in this matter. We’ve tested the Live Crawling feature using the same articles and prompt template you provided in your email. We haven’t found any issues, yet - and it appears to be functioning correctly.
We suspect that it may be related to your network, VPN, or a similar factor. Our team is already in touch with you investigating the cause of the problem.
I still haven’t resolved my issue. Either I have to cancel my subscription or lower my plan. Due to the intense competition among AI companies, such features have become child’s play. So please don’t waste your time like me trying to solve it… I have tried many methods, but it hasn’t been resolved and the feedback is very slow. Moreover, with the rapid development of AI, there are plenty of good alternatives available at this price.
I continue to receive the error message from Chat GPT when using live crawling of “live crawling of “xx” failed. Please try again.” then GPT responds that it cannot browse the internet. Message attached.
Trolled forums for posts that are related to this topic and tried, linking GPT-4 email and AIPRM emails, Checked VPN and web browser, website does not have code to stop scraper/crawlers, Tried GPT-4 Browsing, plug-in and other models.
Sorry to hear that you are having trouble with the Live Crawling of URLs. I have tested the Live Crawling feature using the same URL and prompt template visible in your screenshot and have not found any issues yet. It appears to be functioning correctly.
Hi, The Live Crawling function of outranking an article is nog longer working. I get a grey box at the top mentioning: “Live Crawling of “https://URL/” finished - parsing content …”
and then ChatGPT answers:
It looks like you’ve provided a URL from “URL” that seems to be related to [topic]. However, I’m unable to access external websites or specific content on the internet in real-time. If you have any questions or need information related to [topic], feel free to ask, and I’ll do my best to assist you based on the information I have up to my last update in September 2021.
Apologies for any inconvenience caused. Based on the attached screenshot, it appears that the parsing of content after live crawling of URL was not successful. This issue seems to be related to parsing of Notion pages that require JavaScript.
The Live Crawling feature appears to still be functioning properly. However, some websites might block live crawling or any kind of crawlers, which could be the reason you are unable to use this feature on specific sites.