Search Off the Record
Search Off the Record takes you behind the scenes of Google Search and its inner workings. In each episode, the folks from the Search Relations team give background info on decision-making behind launches, feature prioritization in Search Console, and projects Google Search teams are working on. They share fun stories from conferences and their day-to-day working life at Google, and dive into trending conversations in the SEO community.
Episodes
PDFs in Search: Indexing, AI & Pitfalls - Transcript
PDFs in Search: Indexing, AI & Pitfalls
Should you publish your content as a PDF or stick strictly to standard HTML? Does Google treat PDF files differently when it comes to indexing, ranking, and AI search features? In this episode of Search Off the Record, Martin Splitt and John Mueller from the Google Search Relations team demystify how Google Search handles PDF documents. They break down some of Google's internal pipelines, explain
Do sitemaps still matter? - Transcript
Do sitemaps still matter?
Sitemaps have been a core element of web development and search engine optimization for two decades, yet Search Console warnings like "Couldn't fetch" continue to generate concern among site owners. Are XML sitemaps still necessary with modern search crawlers, or can search engines and AI bots figure out site structure on their own? In this episode of Search off the Record, Google Search Relations
Should you block your Search result pages? - transcript
Should you block your Search result pages?
Is your website's internal search feature secretly acting as an open invitation for crawling lots and lots? In this episode of Search off the Record, Martin Splitt and John Mueller pull back the curtain on how internal search results pages can turn into "infinite crawl spaces" that trap Googlebot, waste your crawl budget, and spike your database load. They break down the critical technical differe
How to read the Indexing Report - Transcript
How to read the Indexing Report
Should you panic when your Search Console indexing report is showing pages that aren't indexed? Is a 404 error code always a sign of a broken website? In this episode of Search Off the Record, Martin Splitt and John Mueller from the Google Search Relations team dive deep into the Page Indexing report in Google Search Console. They unpack why treating this report as a static inventory checklist to
Should I use markdown for my site? - Transcript
Should I use markdown for my site?
Should you convert your website into Markdown to help Large Language Models (LLMs) understand your content better? Is "llms.txt" worth the effort for SEO? In this episode of Search Off the Record, Martin Splitt and John Mueller from the Google Search Relations team dive deep into the history of Markdown, its rise in the AI era, and whether it holds any real weight for search engine discovery. In t
Vibe Coding - yay or nay? - Transcript
Vibe Coding - yay or nay?
In this episode of Search Off the Record, Martin Splitt and John Mueller from Google's Search Relations team dive deep into the world of AI-assisted development. They explore the reality of "Vibe Coding", the process of building apps and websites using natural language instead of manual syntax. Whether you're a developer looking to offload tedious setup tasks or an SEO expert trying to understand
How AI Is Changing Google Search and SEO - transcript
How AI Is Changing Google Search and SEO
In this episode of Search Off the Record, Martin speaks with Nikola Todorovic (director of Software Engineering at Google Search) about how AI is changing Google Search. They discuss the evolution from traditional search to AI Overviews and AI Mode, how Google tests and launches search changes, and why query behaviour is becoming more conversational and complex. Nikola also explains the role of ma
Analysing Robots.txt at scale with HTTP Archive and BigQuery - transcript
Analysing Robots.txt at scale with HTTP Archive and BigQuery
In this episode of Search Off the Record, Martin and Gary turn a simple robots.txt question into a data‑driven deep dive using HTTP Archive, WebPageTest, custom JavaScript metrics, and BigQuery. They explore how millions of real robots.txt files are actually written in 2025–2026, which directives and user‑agents are most common, and what that means for modern crawling and AI bots. Perfect for begi
Are websites getting "fat"? Page weight, HTML size & Googlebot limits explained - transcript
Are websites getting "fat"? Page weight, HTML size & Googlebot limits explained
In this episode of Search Off the Record, Gary and Martin dig into what "page size" and "page weight" actually mean for developers, users, and search engines. They discuss exploding web page sizes: median mobile homepages hit 2.3 MB in 2025 Web Almanac (up 3x from 2015), key insights for developers on page weight definitions, Googlebot's crawl limits, HTML bloat from structured data/images, and wh
Google crawlers behind the scenes - transcript
Google crawlers behind the scenes
Developers often talk about Googlebot as if it were a single program you could just run as "googlebot.exe", but that is not how Google's crawling actually works. In this episode of Search Off the Record, Martin and Gary from the Search Relations team unpack how Google's crawling infrastructure is really built and operated. They cover why "Googlebot" is a misnomer and how it relates to a central c
How Browsers Really Parse HTML (and What That Means for SEO) - transcript
How Browsers Really Parse HTML (and What That Means for SEO)
Martin and Gary unpack how HTML parsing really works, why the HTML standard is so lenient, and how messy markup can silently break key SEO signals like hreflang and rel=canonical. They revisit validators and cross‑browser hacks from the Netscape/IE days, and discuss whether semantic HTML and strict validity truly matter for search. You'll also hear when link hints like preload, prefetch, and DNS p
Do You Still Need a Website in 2026? (Transcript)
Do You Still Need a Website in 2026?
In this episode of Search Off the Record, Martin and Gary from the Google Search Relations team tackle a deceptively simple question: do you still need a website in 2026? Starting from the recurring industry claim that "the web is dead," they explore how the web has evolved through the rise of apps, AI chatbots, and social platforms, and why the answer almost always ends up being "it depends." Tun
Crawling Challenges: What the 2025 Year-End Report Tells Us - Transcript
Crawling Challenges: What the 2025 Year-End Report Tells Us.
Join Martin and Gary as they dive into Search Off the Record's Episode 103, unpacking the 2025 Year-End report on crawling issues. Discover fascinating insights on faceted navigation, action parameters, irrelevant parameters and more, highlighting the biggest challenges faced by web crawlers last year. With humor and expert analysis, this episode reveals critical takeaways for webmasters and SEO
SOTR102_transcript.pdf
SEO, AIO, GEO, your site, & third-party support to optimize for LLMs
In this episode, John Mueller and Danny Sullivan continue their conversation about the changing landscape of Search. They discuss the practicalities of hiring an SEO professional in the age of AI: Do you really need one? How do you evaluate them? Danny also shares his thoughts on third-party SEO tools, "domain scores," and why creators shouldn't rush to break their content into "bite-sized chunks"
Thoughts on SEO & SEO for AI, part 1
In this episode, John Mueller and Danny Sullivan talk about SEO and the new kids on the block: AIO, GEO and others. Danny shares how these things interact with each other and what he thinks website owners should look for in their content creation and how Google's principles align with the way people use AI and search engines to navigate the web. Listen to more Search Off the Record → https://goo
How Search Off the Record tackles SEO and web development
Celebrate the 100th episode of Search Off the Record with Martin, Lizzi, Cherry, John and Gary as they revisit memorable moments, touching on a bunch of topics. This special episode touches on Google's mobile-first indexing, the intricacies of the Caffeine indexing system, and a deep dive into JavaScript scoping – and hoisting. You'll hear again about optimizing documentation traffic and the deli
SOTR100_transcript.pdf
Optimizing login-page content for Google Search
Explore critical aspects of search engine optimization for web content that lives behind a login or paywall. In this episode, Martin and John cover how Googlebot interacts with these pages, the role of paywall structured data, and methods to prevent unintended indexing of private information. Get practical advice on improving your website's visibility and user experience while maintaining data sec
SOTR099_transcript.pdf
Lazy loading demystified
Optimize your website's performance with lazy loading techniques. In this episode, John Mueller and Martin Splitt discuss lazy loading, and its SEO implications. Find out how lazy loading affects indexing, ranking, and Core Web Vitals. Whether you're using native lazy loading or custom JavaScript libraries, this episode provides insights for developers on how to enhance website speed and user exp
SOTR098_transcript.pdf
SEO for photographers: websites, social media, and Google Search
In this episode of Search Off The Record, John and Martin explore the intersection of SEO and photography. Is a website essential for photographers, or is social media enough? Martin, a technical SEO expert and photography enthusiast, dives into the challenges of building a photography website, optimizing images, and attracting the right audience. Whether you're a professional photographer or a ho
SOTR097_Transcript.pdf
How does CSS affect SEO?
Martin and John dive into the world of CSS and explore its connection to SEO. Discover why CSS files matter for SEO, how modern CSS frameworks impact pages, and the SEO implications of CSS class names and pseudo elements. Moreover, learn practical tips for ensuring your CSS enhances - rather than hinders - your website's search performance. Resources: Episode transcript → https://goo.gle/sotr096-
SOTR096_Transcript.pdf
SEO for small businesses
Are you a developer or small business owner struggling with Search Engine Optimization (SEO)? In this episode of Search Off the Record, Google Search Advocates John Mueller and Martin Splitt break down the essentials of SEO for small businesses. Learn practical tips for understanding your target audience, crafting a content strategy, and measuring your SEO efforts. They debunk SEO myths and explai
SOTR095_Transcript.pdf
Demystifying SEO for developers
Developers often have misconceptions about SEO. In this episode of Search Off the Record, John Mueller and Martin Splitt clarify what matters and what doesn't. They cover areas including: Optimizing themes for SEO, The indexing API, and common HTML mistakes. This podcast delivers essential knowledge for developers to enhance their SEO strategies and avoid common pitfalls. Resources: Episode trans
SOTR094_Transcript.pdf
What SEOs should know about devs
In this candid episode of Search Off the Record, Gary Illyes and Martin Splitt from the Google Search team peel back the curtain to reveal a more human side of their work and challenges. Instead of diving deep into technical concepts, they reflect on their personal journeys—touching on everything from public speaking nerves to building empathy between developers and SEOs. Through playful banter an
SOTR093_Transcript.pdf
How Googlebot crawls the web
In this episode of Search Off the Record, Martin and Gary from the Google Search Relations team take a deep dive into how Googlebot and web crawling work—past, present, and future. Through their humorous and thoughtful conversation, they explore how crawling evolved from the early days of the internet, when scripts could index a chunk of the web from a single homepage, to the more complex and cons
SOTR092_Transcript.pdf
Debugging the Internet: HTTP, TCP, and You
In this episode of Search Off the Record, Gary Illyes and Martin Splitt from the Google Search team dive deep into the foundations of how the web works—specifically HTTP, TCP, UDP, and newer technologies like QUIC and HTTP/3. The two reflect on how even experienced web professionals often overlook or forget the mechanics behind these core protocols, sharing insights through technical discus
SOTR091_Transcript.pdf
Launching Search Central Live Deep Dive
In this episode of Search Off the Record, Google's Martin Splitt, Cherry, and Gary Illyes discuss the exciting expansion of Search Central Live with the introduction of Search Central Live Deep Dive. They share the history of Search Central events, the inspiration behind creating a more advanced, multi-day experience, and how community feedback helped shape the new format. Cherry explains how the
How are web standards made?
Ever wondered how web standards are made? Martin and Gary from Google Search take you behind the scenes of the internet's governing bodies. From the IETF to the W3C, learn about the consensus-driven processes that shape the web. Find out why these standards are crucial for ensuring a consistent and reliable online experience. Resources: Episode transcript → https://goo.gle/sotr089-transcript L
SOTR089_Search_Off_the_Record_-_89th_episode_
Wrapping up 2024
As 2024 comes to a close, we're reflecting on what SEO things happened this year. Listen along as we chat about what we learned from going to events, the importance of understanding how AI works, and whether everything will be replaced with JavaScript. Resources: Episode transcript → https://goo.gle/sotr088-transcript Encoding + Googlebot → https://goo.gle/4iZEKXO Listen to more Search Off the
Handling Dupes - Same Same or Different?
In this episode of Search Off the Record, John and Martin talk to Allan Scott from the Google Search team that handles duplicate content. They explore how Google Search deals with duplicated content, clustering, and canonicalization. Resources: Episode transcript → https://goo.gle/sotr087-transcript Listen to more Search Off the Record → https://goo.gle/sotr-yt Subscribe to Google Search Chann
A discussion of UX for SEO
In this episode of Search Off the Record, Lizzi and John are joined by Rio Ichikawa, a product manager working on UX, CRO, and SEO, to discuss the intersection of SEO and UX. They explore how user experience impacts SEO, emphasizing the shared goals of attracting and converting users. Tune in for a discussion on common UX mistakes - like carousels - and how heatmaps can be a valuable tool for unde
Understanding how users experience your website
Sometimes talking to your users is the best way to figure out why that pesky bounce rate is high. But how do you actually do that, especially if you're on a budget? In this episode of Search Off the Record, we're learning all about user experience research (UXR) and how getting a better understanding of how your users interact with your website can help when you're looking for ways to improve it
Designing Google Doodles and delightful experiences
What does recursion, Weather Frog, and Momo the Magic Cat have in common? In this episode of SOTR, Lizzi and John go behind the scenes of a Google Doodle with Jessica Yu, the lead for Doodles and delight on Google Search, about designing experiences that resonate with your audience. Listen along as we learn more about what's involved in getting an easter egg into Google Search, from hatching the
Google Search Reliability
In this episode of Search Off the Record, Ben Walton and David Yule from the Google Search Site Reliability Team (SRE) walk us through their day to day work, which surprisingly is not just about putting out fires! Learn what Search SREs really do, how they handle incidents that occasionally occur, and what it takes to be an SRE for Google Search. Resources: Episode transcript → https://goo.gle/
How do I know if my SEO is doing a good job?
It's been a few months since you hired an SEO; how can you tell if things are headed in the right direction? In this episode of Search Off the Record, Lizzi and John interview Erika Varangouli, head of Branded Content at Riverside.fm, about all things hiring and working with SEOs. Just because uplift isn't happening doesn't mean they're not doing work; we walk through practical things to check
Let's talk shopping markup
In this episode of Search Off the Record, Irina Tuduce from the shopping team joins John Mueller and Lizzi Sassman to chat all things shopping data, from schema.org to feeds spec. Listen along as we chat about how shopping infrastructure gets its data, why pricing data can be tricky, and what the Shopping team has been working on this year. Resources: Episode transcript → https://goo.gle/sotr081-t
Working With Search Console API
We sat down with Mihai Aperghis, a Google Product Expert (PE) for Search, when he visited the Zurich office for the PE Summit this year. In this episode we talk about how he started his SEO agency, the tools he built, and his role as a Product Expert in the Search Central Help Community. Mihai explains how he built tooling to get data from Search Console into Google Sheets and how he automated thi
Crawling smarter, not harder
In this episode of SOTR, John Mueller, Lizzi Sassman, and Gary Illyes talk about misconceptions around crawl frequency and site quality, what's challenging about crawling the web nowadays, and how search engines could crawl more efficiently. Resources: Episode transcript → https://goo.gle/sotr079-transcript Gary's post on LinkedIn → https://goo.gle/3YAT55q Crawling episode with Dave Smart → ht
Transcript for Crawling smarter, not harder
Internationalization & hreflang
Managing websites that use different languages and serve different countries is no easy task. That's why Lizzi, Gary and Martin sat down to talk about all things internationalization, hreflang and what's making managing international, multi-language websites easier. Resources: Episode transcript → https://goo.gle/sotr078-transcript Docs for international and multilingual sites → https://goo.gle/
Rendering JavaScript for Google Search
In this episode, Zoe Clifford from the rendering team joins Martin and John from Search Relations to talk about how Google Search deals with JavaScript sites, how rendering works and what the mysterious "iteratorect" was. They also discuss what's the DOM, if all pages get rendered, how long it takes and what website owners should look out for when building JavaScript-driven websites. Resources:
Transcript for Inside Search Quality: Using metrics and data science to improve Search
Inside Search Quality: Using metrics and data science to improve Search
In this episode of SOTR, Lizzi and John sit down with Elizabeth Tucker to go behind the scenes of Search Quality product management. Listen along as they discuss using data science to measure quality and make improvements, how search behavior is changing over time, and how to think about E-E-A-T and the Search Quality Rater Guidelines. Resources: Episode transcript → https://goo.gle/sotr076-transc
Cosmic Rays & Crawlers: When Google Search is under the weather
How does Google address incidents that affect Search results, like indexing problems or crawling issues? Join John, Lizzi, and Gary in this episode of Search off the Record as the team discusses internal processes Google uses to detect, investigate, and communicate these incidents to users and website owners. Resources: Episode transcript → https://goo.gle/sotr075-transcript Google Search Status
Transcript for Cosmic Rays & Crawlers: When Google Search is under the weather
Building SEO community with office hours
In this episode of Search off the Record, John and Lizzi invite Michael Chidzey and "Jo" Juliana Turnbull to talk all things SEO Office Hours. Listen along as they discuss why they picked this format, whether community building has an impact on SEO, and how you can get involved in this growing community of SEO practitioners. Resources: Episode transcript → https://goo.gle/sotr074-transcript Joi
Transcript for Building SEO community with office hours
Let's talk Content Decay
What's the best way to handle outdated content? Does old content affect SEO? In this episode of Search Off the Record, Lizzi Sassman and John Mueller discuss the importance of addressing old content and updating it to continue being useful to users today. Listen along as Lizzi and John discuss content decay's effect on Google Search results and practical steps to tackle it. Resources: Episode tran
Transcript for Let's talk Content Decay
Gemini for Social Posts: Game Edition
In this episode of Search Off the Record, Gary Illyes, Lizzi Sassman, and John Mueller put Large Language Models (LLMs) to the test and compete to create the best social post using generative AI. Listen along as they weigh the pros and cons, assess how accurate the posts are, stumble on some owl facts, and see how Google's own GenAI tool, Gemini, can be used as a creativity tool. Resources: Epis
Transcript for Gemini for Social Posts: Game Edition
Deciphering INP and Core Web Vitals
In this episode of Search Off the Record, John Mueller and Lizzi Sassman are joined by Rick Viscomi from the Chrome Web Performance team to discuss the importance of understanding what users seek to accomplish and optimizing accordingly, rather than focusing solely on metric scores. Listen along as the Search team touches on metrics like Largest Contentful Paint (LCP), Cumulative Layout Shift (CLS
Transcript for Deciphering INP and Core Web Vitals
What is a web crawler, really?
In this episode of Search Off the Record, Gary Illyes and Lizzi Sassman take a deep dive into crawling the web: what is a web crawler, and how does it really work? Listen along as the Search team is joined by an expert web developer in the SEO community, Dave Smart, for an in-depth and technical discussion of all things crawling, and maybe dispel some myths along the way. Resources: Episode tra
Transcript for What is a web crawler, really?
Search Central Product Experts
In this episode of Search Off the Record, John Mueller and Lizzi Sassman sit down with Aaseesh Marina, Product Support Manager, to discuss the Search Central community forums. Did you know there is a group of Product Experts and community members that can help you navigate your SEO questions? Listen along as the Search Team takes a deep dive into the Search Central help community forum and discove
Recommended
زن بودن
Medicine with Meaning
Yours Truly Johnny Dollar Collection
Take Back Your Health®
CBS Radio Mystery Theater | Old Time Radio
Solved Murders - True Crime Stories
紐約鳥｜New York Aperture
The Swerve Podcast: Obscure Topics | Conspiracy Theories
The Bread and Banter Podcast
The Church of What's Happening Now: The New Testament
Busted Open
Deadline: White House
