How Googlebot crawls the web

In this episode of Search Off the Record, Martin and Gary from the Google Search Relations team tackle a deceptively simple question: do you still need a website in 2026? Starting from the recurring industry claim that "the web is dead," they explore how the web has evolved throu ...  Show more

​Join Martin and Gary as they dive into Search Off the Record's Episode 103, unpacking the 2025 Year-End report on crawling issues. Discover fascinating insights on faceted navigation, action parameters, irrelevant parameters and more, highlighting the biggest challenges faced by ...  Show more

Founder at Knowatoa, Michael Buckbee, discusses how AI search technologies like ChatGPT and Perplexity are revolutionizing the SEO industry by uncovering new ranking opportunities for brands. In this episode, Michael shares his perspectives on: impact of Google's AI-driven sea ...

Enterprise SEO teams waste resources on ineffective LLM.txt files instead of proven protocols. Duane Forrester, former Bing search engineer and founder of UnboundAnswers.com, explains why major crawlers including AI systems still follow established robots.txt standards. The di ...

Keyword research faces significant evolution in the AI search era. Chris Andrew, co-founder and CEO of Scrunch AI, explains how traditional keyword targeting must adapt as search fragments across multiple AI platforms. He outlines how single keywords now expand into countless ...

Episode 16: How is AI transforming the future of SEO and job markets? Matt Wolfe ( https://x.com/mreflow) and Nathan Lands ( https://x.com/NathanLands) are joined by innovator Greg Isenberg ( https://x.com/gregisenberg), founder of Late Checkout and Boring Marketer. Greg hosts “The ...  Show more