Ability to Recrawl Error Urls

26 votes

Add the ability to recrawl pages that resulted in an error (due to disconnected internet/timeout) after the crawl has finished to get a complete report rather than having to recrawl the entire site from scratch.

Done Suggested by: Oliver (11 Dec, '17) • Upvoted: 24 Nov, '21 • Comments: 4

Comments: 4

08 Mar, '18
Oleg
Yes, it would be helpful to have the ability to make a crawl of a certain section or a hint itself. When I resolve some issues specified in a hint if I want to check if everything has really been resolved, I have to recrawl the entire site from scratch.
06 Jul, '18
Laurie Turnbull Merged
For example, pages that return 500s could be individually recrawled and the results updated in the same audit. Screaming Frog does this by allowing you to simply highlight the URLs, right click and select 'recrawl'
09 Jul, '18
Admin
"Recrawl individual URLs" (suggested by Laurie Turnbull on 2018-07-06), including upvotes (1) and comments (0), was merged into this suggestion.
08 Mar, '19
Joe
Need this - got a bunch of 500 errors - that were incorrect upon viewing the live URL

Site probably got overburdened by crawler. Definitely a needed feature!