Why can't search engines find my robots.txt file?

Your robots.txt file returns a 404 error, meaning it's missing or inaccessible. Search engines can't get crawling instructions for your site. Create a robots.txt file and place it at your domain root to guide search engine crawlers properly.

What happens when my content has no publication dates?

Your pages lack date signals like publication or last modified dates. This creates freshness issues that hurt search rankings. Search engines can't determine content recency. Add clear timestamps to help search engines understand your content's relevance.

Do I need an llms.txt file for AI search engines?

Your site is missing an llms.txt file, which AI search engines use for crawling guidance. This returns a 404 error when AI systems look for it. Create an llms.txt file to provide proper instructions for AI crawlers and chatbots.

How does missing date information affect my search rankings?

Search engines can't assess your content's freshness without date signals. This hurts your E-E-A-T scoring and search visibility. Google prioritizes fresh, recently updated content. Add publication dates and last modified timestamps to improve your rankings.

Why should my page openings be longer than 18 words?

Your opening paragraph is only 18 words, which is too brief for effective direct answers. Search engines need substantial content to create featured snippets. Expand your openings to 40-60 words for better search visibility and user engagement.

‹ See all YC F25 audits

Thesis SEO & AI Visibility Audit

Thesis is an agentic AI environment that integrates code, notebooks, datasets, models, and experiments in a single workspace. It enables developers and researchers to build, monitor, and iterate on AI projects with integrated tools designed to accelerate development workflows.

thesislabs.ai

SEO + AEO + E-E-A-T combined

Audited March 06, 2026 · 7 pages analyzed

Overall Scores

Area	Score	Grade
SEO	71%	C
AEO (AI Visibility)	5%	F
E-E-A-T	47%	F
Combined	38%	—

Fastest way to fix your site is to use our Custom Connector for Claude Desktop, or other IDEs.

E-E-A-T Breakdown

Signal	Score	Issue
Trustworthiness	60%	Found, 7 security headers missing, No contact transparency signals detected
Expertise	53%	188 words, 13 headings, 4 outbound links
Authoritativeness	29%	No Organization JSON-LD schema found, No JSON-LD schema types detected, Found
Experience	40%	Found, Freshness issues, Found

Stobo finds what's broken and generates the fixes

Claude Desktop MCP integration settings showing how to add a custom MCP server

Try these in Claude Desktop

stobo my site: thesislabs.ai

stobo this article: thesislabs.ai/blog/my-article

Generate a robots.txt for thesislabs.ai

stobo my blog: thesislabs.ai/blog

Recommendations

robots.txt not accessible (HTTP 404) AEO
Update robots.txt to allow AI crawlers like GPTBot and ClaudeBot. Stobo generates an AI-friendly version.
```
Generate a robots.txt for thesislabs.ai
```
llms.txt not found (HTTP 404) AEO
Create an llms.txt file so AI models can understand what thesislabs.ai does. Stobo generates one automatically.
```
Generate an llms.txt for thesislabs.ai
```
Freshness issues: no date signals found AEO
Add date markup (datePublished, dateModified) so AI engines know content is current. Stobo generates the JSON-LD.
```
Generate freshness code for thesislabs.ai
```

Track your score over time

We'll re-audit your site in 7 days and email you what changed. Free, automatic.

Embed your audit badge

Show your score on your README or website.

Markdown

HTML

Frequently asked questions

Why can't search engines find my robots.txt file?: Your robots.txt file returns a 404 error, meaning it's missing or inaccessible. Search engines can't get crawling instructions for your site. Create a robots.txt file and place it at your domain root to guide search engine crawlers properly.
What happens when my content has no publication dates?: Your pages lack date signals like publication or last modified dates. This creates freshness issues that hurt search rankings. Search engines can't determine content recency. Add clear timestamps to help search engines understand your content's relevance.
Do I need an llms.txt file for AI search engines?: Your site is missing an llms.txt file, which AI search engines use for crawling guidance. This returns a 404 error when AI systems look for it. Create an llms.txt file to provide proper instructions for AI crawlers and chatbots.
How does missing date information affect my search rankings?: Search engines can't assess your content's freshness without date signals. This hurts your E-E-A-T scoring and search visibility. Google prioritizes fresh, recently updated content. Add publication dates and last modified timestamps to improve your rankings.
Why should my page openings be longer than 18 words?: Your opening paragraph is only 18 words, which is too brief for effective direct answers. Search engines need substantial content to create featured snippets. Expand your openings to 40-60 words for better search visibility and user engagement.

Audit a competitor