Optimixed Search News

John Mueller Shares His Experience Testing Markdown for AI Crawlers

45
News

TLDR

John Mueller tested whether AI crawlers actually request markdown from websites and shared his findings.

Optimixed Overview

Optimixed's original report on this story.

In a post on Google's Search Liaison channel, John Mueller shared what he observed when checking whether AI crawlers were actually requesting markdown from his sites, offering practical insight into how AI systems interact with web content for SEO purposes.

Was this useful?
Share

Related articles

62
News

Meta's Muse AI bot generated one-third of all AI browser traffic in its first 9 days, mostly from CDN infrastructure rather than consumer devices, per security firm DataDome.

AI & Machine Learning in SEOTechnical SEOTools & Platforms
52
News

Google has again adjusted how links appear in AI Mode and AI Overviews, continuing efforts to drive clicks from AI responses to publisher sites.

AI & Machine Learning in SEOSEO News & Algorithm Updates
75
Analysis

Analysis suggests Google will shift its default from ranked search results to AI-generated answers once ad revenue from AI answer pages matches traditional SERP yields, a transition expected between 2028 and 2030.

AI & Machine Learning in SEOSEO News & Algorithm Updates
55
Research

SE Ranking's analysis of 300,000 domains found limited evidence that LLMs.txt files materially affect AI citation rates.

AI & Machine Learning in SEOAnalytics & MeasurementTools & Platforms