*** File not scanned in VirusTotal as it exceeds the limit***$$$$$$Small Update – Version 24.1 Released 8th June 2026$$$We have just released a small update to version 24.1 of the SEO Spider. This release is mainly bug fixes and small improvements –$$$Added recently crawled URLs to scheduled crawl seed textbox.$$$Added a view to ‘Usage Stats’ graph to switch away from cumulative (a running total); to standard non-cumulative data points.$$$Added ‘Auto-start MCP Server on application launch’ setting for cloud.$$$Added ability to Bulk Export all multi file exports in MCP Server.$$$Included an option to download MCP API as markdown via ‘MCP > Configure > View Tools’ and the button at the top.$$$Increased GSC read time out to 2 minutes from 20 seconds.$$$Updated MCP Server progress to include APIs and Crawl Analysis.$$$Fixed issue with URL Inspection not working in API mode with ‘Ignore Non-Indexable URLs For URL Inspection’ enabled.$$$Fixed issue with MCP server returning “Tool error: Page content size too large” using sf_url_content tool.$$$Fixed issue with MCP Server logging to stdout in CLI Mode.$$$Fixed issue with some MCP server tools not working in non-English languages.$$$Fixed various unique crashes.

Screaming Frog SEO Spider Update – Version 24.0$$$We’re delighted to announce Screaming Frog SEO Spider version 24.0; codenamed internally as ‘bolus’.$$$In this release we have introduced a number of much demanded new features; as well as smaller quality of life improvements and updates.$$$$$$Let’s take a look at what’s new.$$$$$$1) Screaming Frog SEO Spider MCP$$$2) Auto Compare Crawls$$$3) View Crawl Changes in Email Notifications$$$4) Send Crawl Export Attachments by Email$$$5) Find Uncrawlable Links$$$6) Usage Stats$$$$$$Other Updates$$$Version 24.0 also includes a number of smaller updates and bug fixes.$$$$$$New Arm64 Linux Versions – We now have two more packages available for Arm users for both Ubuntu and Fedora. Our three Linux users will rejoice again!$$$Improved Reporting of Syntactically Invalid Links – There’s a new ‘Crawl Invalid Links‘ option under ‘Config > Spider > Crawl’. Enabling this setting means URLs that are syntactically invalid such as hppts://example.com will be parsed; crawled and reported upon. These will typically appear under ‘Response Codes > No Response’ as malformed links.$$$Skip Empty Reports – You can now skip exporting empty reports in ‘Output Settings’ of scheduled crawl tasks; and ‘Bulk Export > Multi Export’. This means any exports that have been selected that do not contain any data; will not be exported. They will also not be attached in email notifications exports.$$$Ahrefs Country Level Metrics – There’s a new ‘Options’ tab in the Ahrefs integration with filters to adjust data for countries and volume (monthly or average).$$$Filterable Content Clusters – You’re now able to click on the content cluster legends in the graph to enable and disable their appearance in the diagram.$$$Live Model Validation & List In AI Integrations – When you connect to an AI provider; the model selected in the prompt will be checked against the live model list endpoint and alert you if they don’t exist – and allow you to select a live model. With models changing so frequently; both system and user prompts can quickly become deprecated.$$$System Wide Prompt for AI Integrations – In the ‘Advanced’ tab of each AI provider integration; you’re able to include a chat system prompt to establish the role; personality; constraints; and overall behaviour; providing foundational instructions that guide all its responses for consistency and relevance.$$$AI Provider Token Usage – Token usage is now displayed on the ‘Account Information’ dialog for each AI provider when connected.$$$Ollama Image Generation & Request Timeout – The Ollama integration now supports their image generation and has an adjustable ‘Request Timeout’ in the advanced tab.$$$Renamed Looker Studio Back to Data Studio Again – For our automated crawl reports in Looker Data Studio. Google is definitely messing with us all at this point.$$$Java 25 – One for the purists. Version 24 has been updated to Java 25.$$$$$$Refer - https://www.screamingfrog.co.uk/blog/seo-spider-24/

Screaming Frog SEO Spider Update – Version 24.0$$$We’re delighted to announce Screaming Frog SEO Spider version 24.0; codenamed internally as ‘bolus’.$$$In this release we have introduced a number of much demanded new features; as well as smaller quality of life improvements and updates.$$$$$$Let’s take a look at what’s new.$$$$$$1) Screaming Frog SEO Spider MCP$$$2) Auto Compare Crawls$$$3) View Crawl Changes in Email Notifications$$$4) Send Crawl Export Attachments by Email$$$5) Find Uncrawlable Links$$$6) Usage Stats$$$$$$Other Updates$$$Version 24.0 also includes a number of smaller updates and bug fixes.$$$$$$New Arm64 Linux Versions – We now have two more packages available for Arm users for both Ubuntu and Fedora. Our three Linux users will rejoice again!$$$Improved Reporting of Syntactically Invalid Links – There’s a new ‘Crawl Invalid Links‘ option under ‘Config > Spider > Crawl’. Enabling this setting means URLs that are syntactically invalid such as hppts://example.com will be parsed; crawled and reported upon. These will typically appear under ‘Response Codes > No Response’ as malformed links.$$$Skip Empty Reports – You can now skip exporting empty reports in ‘Output Settings’ of scheduled crawl tasks; and ‘Bulk Export > Multi Export’. This means any exports that have been selected that do not contain any data; will not be exported. They will also not be attached in email notifications exports.$$$Ahrefs Country Level Metrics – There’s a new ‘Options’ tab in the Ahrefs integration with filters to adjust data for countries and volume (monthly or average).$$$Filterable Content Clusters – You’re now able to click on the content cluster legends in the graph to enable and disable their appearance in the diagram.$$$Live Model Validation & List In AI Integrations – When you connect to an AI provider; the model selected in the prompt will be checked against the live model list endpoint and alert you if they don’t exist – and allow you to select a live model. With models changing so frequently; both system and user prompts can quickly become deprecated.$$$System Wide Prompt for AI Integrations – In the ‘Advanced’ tab of each AI provider integration; you’re able to include a chat system prompt to establish the role; personality; constraints; and overall behaviour; providing foundational instructions that guide all its responses for consistency and relevance.$$$AI Provider Token Usage – Token usage is now displayed on the ‘Account Information’ dialog for each AI provider when connected.$$$Ollama Image Generation & Request Timeout – The Ollama integration now supports their image generation and has an adjustable ‘Request Timeout’ in the advanced tab.$$$Renamed Looker Studio Back to Data Studio Again – For our automated crawl reports in Looker Data Studio. Google is definitely messing with us all at this point.$$$Java 25 – One for the purists. Version 24 has been updated to Java 25.$$$$$$Refer - https://www.screamingfrog.co.uk/blog/seo-spider-24/

Small Update – Version 23.3 Released 18 February 2026$$$We have just released a small update to version 23.3 of the SEO Spider. This release is mainly bug fixes and small improvements –$$$$$$With Google’s update on Googlebot’s file size limits actually being 2mb rather than previously communicated 15mb; we have updated our SEO issues in the tool to ‘HTML Document Over 2MB‘ and ‘Resource Over 2mb‘ and made the limits configurable in ‘Config > Spider > Preferences’.$$$Removed deprecated ‘Gemini text-embedding-004’ and replaced with ‘gemini-embedding-001’ for default Gemini embedding prompts.$$$Created a ‘Non-Indexable Page Inlinks Only‘ bulk export; available via ‘Bulk Export > Links’.$$$Rev Java to 21.0.10.$$$Updated Log4j to 2.25.3 to fix TLS hostname issue.$$$Fixed issue with only account name being used for command line GSC & GA4 crawls and account properties being ignored.$$$Fixed issue with Content Cluster Diagram segment names not being escaped.$$$Fixed issue with Cluster 0 showing in Content Cluster Diagram.$$$Fixed various unique crashes.

Small Update – Version 23.3 Released 18 February 2026$$$We have just released a small update to version 23.3 of the SEO Spider. This release is mainly bug fixes and small improvements –$$$$$$With Google’s update on Googlebot’s file size limits actually being 2mb rather than previously communicated 15mb; we have updated our SEO issues in the tool to ‘HTML Document Over 2MB‘ and ‘Resource Over 2mb‘ and made the limits configurable in ‘Config > Spider > Preferences’.$$$Removed deprecated ‘Gemini text-embedding-004’ and replaced with ‘gemini-embedding-001’ for default Gemini embedding prompts.$$$Created a ‘Non-Indexable Page Inlinks Only‘ bulk export; available via ‘Bulk Export > Links’.$$$Rev Java to 21.0.10.$$$Updated Log4j to 2.25.3 to fix TLS hostname issue.$$$Fixed issue with only account name being used for command line GSC & GA4 crawls and account properties being ignored.$$$Fixed issue with Content Cluster Diagram segment names not being escaped.$$$Fixed issue with Cluster 0 showing in Content Cluster Diagram.$$$Fixed various unique crashes.

Small Update – Version 23.2 Released 16 December 2025$$$We have just released a small update to version 23.2 of the SEO Spider. This release is mainly bug fixes and small improvements –$$$$$$Re-introduce the PageSpeed Opportunities Summary report. Unfortunately; not all data is available for all PageSpeed opportunities.$$$Updated trusted certificate discovery; so the site visited is now configurable.$$$Updated the AlsoAsked Custom JS Snippet.$$$Fixed cells with green text being invisible when highlighted.$$$Fixed –load-crawl uses wrong config to validate exports.$$$Fixed issue with showing too many Google Chrome Console errors.$$$Fixed issue with ‘Low Memory’ warning not showing in some low memory situations.$$$Fixed issue with crawls sometimes freezing on macOS.$$$Fixed issue with ‘Archive Website’ causing ‘undefined’ image URL to be loaded.$$$Fixed issue with crawl comparison fogetting config.$$$Fixed issue with Ahrefs failing for values outside of 32bit signed range.$$$Fixed issue with visual custom extraction using the saved user agent rather than from the current editing config.$$$Fixed issue with missing argument for option: crawl-google-sheet in Scheduled Task.$$$Fixed various unique crashes.

Small Update – Version 23.2 Released 16 December 2025$$$We have just released a small update to version 23.2 of the SEO Spider. This release is mainly bug fixes and small improvements –$$$$$$Re-introduce the PageSpeed Opportunities Summary report. Unfortunately; not all data is available for all PageSpeed opportunities.$$$Updated trusted certificate discovery; so the site visited is now configurable.$$$Updated the AlsoAsked Custom JS Snippet.$$$Fixed cells with green text being invisible when highlighted.$$$Fixed –load-crawl uses wrong config to validate exports.$$$Fixed issue with showing too many Google Chrome Console errors.$$$Fixed issue with ‘Low Memory’ warning not showing in some low memory situations.$$$Fixed issue with crawls sometimes freezing on macOS.$$$Fixed issue with ‘Archive Website’ causing ‘undefined’ image URL to be loaded.$$$Fixed issue with crawl comparison fogetting config.$$$Fixed issue with Ahrefs failing for values outside of 32bit signed range.$$$Fixed issue with visual custom extraction using the saved user agent rather than from the current editing config.$$$Fixed issue with missing argument for option: crawl-google-sheet in Scheduled Task.$$$Fixed various unique crashes.

Small Update – Version 21.4 Released 5th Febuary 2025. This release is mainly bug fixes and small improvements –$$$$$$Updated parsing of some relative URL types to correct behaviour.$$$Fixed issue in rendered crawls that would use more memory.$$$Fixed issue failing to collect image dimensions in some HTML.$$$Fixed issue with scheduled crawls in list mode not appearing in scheduled crawl history.$$$Fixed issue with PSI not auto connecting when set to ‘Local’.$$$Fixed various issues with tiling window managers in Linux (i3 and Sway).$$$Fixed various unique crashes.

Small Update – Version 21.4 Released 5th Febuary 2025. This release is mainly bug fixes and small improvements –$$$$$$Updated parsing of some relative URL types to correct behaviour.$$$Fixed issue in rendered crawls that would use more memory.$$$Fixed issue failing to collect image dimensions in some HTML.$$$Fixed issue with scheduled crawls in list mode not appearing in scheduled crawl history.$$$Fixed issue with PSI not auto connecting when set to ‘Local’.$$$Fixed various issues with tiling window managers in Linux (i3 and Sway).$$$Fixed various unique crashes.

Small Update – Version 21.3 Released 11th December 2024$$$We have just released a small update to version 21.3 of the SEO Spider. This release is mainly bug fixes and small improvements –$$$$$$Update AMP validation to latest version.$$$Fixed issue with invalid schedules being created when removing email from notifications.$$$Fixed issue with GA4/GSC crawls sometimes not completing.$$$Fixed issue with loading in some AI API presets.$$$Fixed various unique crashes.

Small Update – Version 21.3 Released 11th December 2024$$$We have just released a small update to version 21.3 of the SEO Spider. This release is mainly bug fixes and small improvements –$$$$$$Update AMP validation to latest version.$$$Fixed issue with invalid schedules being created when removing email from notifications.$$$Fixed issue with GA4/GSC crawls sometimes not completing.$$$Fixed issue with loading in some AI API presets.$$$Fixed various unique crashes.

Small Update – Version 21.2 Released 28th November 2024$$$We have just released a small update to version 21.2 of the SEO Spider. This release is mainly bug fixes and small improvements –$$$$$$Reduce AI credit use by not sending blank prompts.$$$Ensure all images in JavaScript rendering mode are available to AI APIs.$$$Fixed issue with browser not finding accessibility issues when opened.$$$Fixed issue preventing crawls being exported via the right click option in the crawls dialog.$$$Fixed a bug with segments ‘greater than’ operator not working correctly.$$$Fixed various unique crashes.

Small Update – Version 21.1 Released 14th November 2024$$$We have just released a small update to version 21.1 of the SEO Spider. This release is mainly bug fixes and small improvements from the latest major release –$$$$$$Fixed issue with custom database locations not being picked up.$$$Fixed bug in OpenAI Tester.$$$Fixed a couple of crashes; including for users that had ‘auto connect’ selected for the old GA API; which hasn’t been available for sometime (and is now removed!).

** File is not scanned for Virus due to size. **$$$Small Update – Version 20.4 Released 22nd October 2024$$$We have just released a small update to version 20.4 of the SEO Spider. This release is mainly bug fixes and small improvements –$$$$$$Fixed an issue with JavaScript rendering on macOS Sequoia.$$$Fixed freeze in a crawl if sitemap is discovered late in the process.$$$Fixed crash when connecting via RDP.

Small Update – Version 20.3 Released 23rd September 2024$$$We have just released a small update to version 20.3 of the SEO Spider. This release is mainly bug fixes and small improvements –$$$$$$Fixed bug where the SEO Spider was incorrectly flatting iframes found in the head when inserted via JS.$$$Fixed bug with URLs in list mode not being imported if they had capital lettings in the protocol.$$$Fixed bug with filtering column in custom extraction.$$$Fixed bug in basic authentication with non ASCII usernames.$$$Fixed various crashes.$$$Update Java to 21.0.4.

**File not scanned as it is too large**$$$$$$Small Update – Version 20.2 Released 24th June 2024$$$We have just released a small update to version 20.2 of the SEO Spider. This release is mainly bug fixes and small improvements –$$$$$$Update to PSI 12.0.0.$$$Schema.org validation updated to v.27.$$$Updated JavaScript Libary to use Gemini 1.0.$$$Show more progess when opening a saved crawl in memory mode.$$$Retry Google Sheets writing on 502 responeses from the API.$$$Added Discover Trusted Certificates option to make setup for users with a MITM proxy easier.$$$Added ‘Export’ button back to Lighthouse details tab.$$$Fixed intermittent hang when viewing N-Grams on Windows.$$$Fixed issue with UI needless resizing on Debian using KDE.$$$Fixed issue preventing High Carbon Rating being used in the Custom Summary Report.$$$Fixed handling of some URLs containing a hash fragment.$$$Fixed various crashes.

**File not scanned as it is too large**$$$$$$Small Update – Version 20.1 Released 20th May 2024$$$We have just released a small update to version 20.1 of the SEO Spider. This release is mainly bug fixes and small improvements –$$$$$$Updated carbon ratings and ‘High Carbon Rating‘ opportunity to be displayed only in JavaScript rendering mode when total transfer size can be accurately calculated.$$$ChatGPT JS snippets have all been updated to use the new GPT-4o model.$$$Added new Google Gemini JS Snippets. The Gemini API is available in select regions only currently. It’s not available to the UK; or other regions in Europe. Obviously it’s the users responsibility if they circumvent via a VPN.$$$Included a couple of user submitted JS snippets to the system library for auto accepting cookie pop-ups; and AlsoAsked unanswered questions.$$$Re-established the ‘Compare’ filter in the ‘View Source’ tab in Compare mode that went missing in version 20.$$$Fixed issue loading in crawls saved in memory mode with the inspection API enabled.$$$Fixed a few issues around URL parsing.$$$Fixed various crashes.

**File not scanned as it is too large**$$$$$$Refer - https://www.screamingfrog.co.uk/seo-spider-20/

**File not scanned as it is too large**$$$$$$Small Update – Version 19.8 Released 12th March 2024$$$This release superseded 19.7 with a single bug fix –$$$$$$Fix issue preventing scheduled tasks with ‘Export for Looker Studio’ being loaded.

**File not scanned as it is too large**$$$$$$Small Update – Version 19.4 Released 7th November 2023$$$We have just released a small update to version 19.4 of the SEO Spider. This release is mainly bug fixes –$$$$$$Fixed an issue with JavaScript rendering and redirects.$$$Fixed an issue causing a crash when seleting the bounce rate metric in GA4.

**File not scanned as it is too large**$$$$$$Small Update – Version 19.2 Released 30th August 2023$$$We have just released a small update to version 19.2 of the SEO Spider. This release is mainly bug fixes and small improvements –$$$$$$Improve messaging in list mode to make it clear how many URLs have been removed by excludes; includes or being duplicates.$$$Improve rendering disabled dialog messaging clearer.$$$Add support for Session Storage to Forms Authentication.$$$Add more retries when writing to Google Drive to make exports more robust.$$$Display JSON-LD Parse issues Structured Data details tab.$$$Remove brackets from sheet names in Excel.$$$Resolved a false positive in multiple body tag filter.$$$Fixed issue with PSI metric vanishing after PSI API update.$$$Fixed issue with using long XPath expressions in Custom Extraction.$$$Fixed issue where timestamp of crawl was modified but and not modifiying it.$$$Fixed issued with negative crawl depth appearing in the Crawl Path Report.$$$Fixed issue with ‘issues’ not being populated in comparision mode.$$$Fixed issue with being unable to edit tasks on macOS.$$$Fixed issue with GA4 not finding data for some URLs for customers with a large number of URLs in GA4.$$$Fixed issue with Export in list mode not matching uploading URLs correctly.$$$Fix issue when loading in crawls where a needless backup was performed; slowing things down.$$$Fixed various crashes.

Small Update – Version 18.5 Released 26th April 2023$$$We have just released a small update to version 18.5 of the SEO Spider. This release is mainly bug fixes and small improvements –$$$$$$Fix issue with GSC account verification in scheduling$$$Fix JS rendering issue around PDFs.$$$Fix crawl path report to work with orphaned URLs.$$$Fix ‘Security > Bad Content Type’ filter to only check know file extensions.$$$Fix issue with invalid GSC data when loading old crawls/config.$$$Fix issue showing Directory Tree Graph in non English languages.$$$Fix robots.txt to parse all text content types.$$$Fix crash loading in PSI data from old crawls.$$$Fix crash parsing structure data.$$$Fix crash editing scheduled tasks on Windows.

Small Update – Version 18.4 Released 16th March 2023$$$We have just released a small update to version 18.4 of the SEO Spider. This release contains a single update –$$$$$$Fix the PSI integration; after the API was updated with breaking changes without any advance warning. The PSI release notes have now been helpfully updated; a couple of days after the change.

Small Update – Version 18.3 Released 8th March 2023$$$We have just released a small update to version 18.3 of the SEO Spider. This release is mainly bug fixes and small improvements –$$$$$$Auto retry on various timeout types when writing to Google Sheets.$$$Improve performance of the ‘Link Analysis’ phase of ‘Crawl Analysis’.$$$Update JavaScript mime type for ‘Security > Bad Content Type’ validation.$$$Switched GA4 to use ‘LandingPagePlusQueryString’ rather than ‘Landing Page’ as the dimension; as Google changed behaviour.$$$Fix crash connecting to AHREFs with an invalid key.$$$Fix crash loading graphs.$$$Fix crash cancelling export of XML sitesmaps.$$$Fix issue with display of GA4 API usage stats.$$$Fix crash removing URL.$$$Fix crash editing scheduled task.$$$Fix issue with rendering failed due to OPTIONS request.

Small Update – Version 18.1 Released 14th December 2022$$$We have just released a small update to version 18.1 of the SEO Spider. This release is mainly bug fixes and small improvements –$$$$$$Added Education QA & Audit Google features.$$$Add support for video/mp4 mimetype.$$$SERP exports now import and export in users langauge.$$$Index out of bounds shown for URLs with invalid php tags.$$$Fix issue with JavaScript Rendering on Fedora triggering keyring dialog.$$$Fix issue with some exported PDFs not opening.$$$Fix ::before being shown in headings.$$$Fix various crashes; including PDFs links with spaces and newlines; auto saving of config and more

Small Update – Version 17.2 Released 12th September 2022$$$We have just released a small update to version 17.2 of the SEO Spider. This release is mainly bug fixes and small improvements –$$$$$$Reinstate auto scrolling behaviour at the bottom of table view; so users can see URLs appear as they are dicovered. Thanks to Pete Mindenhall; Steve Morgan and a few others that spotted it.$$$Add handling for webp files in bad content filter.$$$Fix regression in cookie handling not showing all cookies.$$$Fix issue showing incorrect values for Total Internal/External URLs when ignoring URLs blocked by robots.txt.$$$Fix issue with last mode used not being persisted after restarts.$$$Fix issue with new Issues tab graphs not updating during a crawl.$$$Fix issue with new task dialog showing single digits for time.$$$Fix issue with selected filter being lost when returning to a tab.$$$Fix issue with old Response Codes 5XX export tab not working on upgrade.$$$Fix issue with Spelling & Grammer crashing when used on Apple Silicon.$$$Fix issue with Response Codes 4XX filtering showing 2XX responses after re-spider & reload.$$$Fix issue with grabled fonts affecting users with their own version of Roboto font installed.$$$Fix crash in view source panel.$$$Fix crash crawling robots.txt with long Sitemap: line.$$$Fix crash around detachable tabs and full screen on macOS.$$$Fix crash showing ‘Visualisations > Force-Directed Crawl Diagram’.$$$Fix crash removing/re-spidering URL.$$$Fix crash viewing scheduling history.