What does StackOptic analyze?

StackOptic runs 18 analysis modules on any public website from a single URL. It detects 7,000+ technologies (CMS, frameworks, analytics, payments, CDN, hosting), evaluates SSL certificates and HTTP security headers with grades from A+ to F, measures Core Web Vitals (LCP, CLS, TBT, FCP), audits SEO meta tags and structured data, checks email security (SPF, DKIM, DMARC), analyzes AI & LLM readiness including bot access and llms.txt validation, extracts color palettes and typography, estimates carbon footprint, and generates permanent shareable reports.

Does it work on sites behind Cloudflare or bot protection?

Yes. StackOptic uses a real browser engine that loads pages exactly like a human visitor — executing JavaScript, rendering CSS, and handling redirects. This allows it to bypass Cloudflare, LiteSpeed, Sucuri, and other bot protection systems where traditional crawlers and HTTP-only tools fail.

What do I get on the free plan?

The free plan includes 5 analyses per day with access to all 18 modules, full scores, technology detection, and security grades. Every report is permanently accessible via a unique shareable URL — no login required to view. No credit card needed. AI-powered insights, re-analysis, PDF/JSON export, and comparison features are available on Pro ($24/mo) and Agency ($99/mo) plans.

What is AI & LLM readiness analysis?

This module evaluates how visible and citable your website is to AI search engines like ChatGPT, Perplexity, Google AI Overviews, and Claude. It audits access permissions for 8 major AI bots, validates llms.txt and llms-full.txt files, scores citation-ready content structure, and analyzes structured data (JSON-LD) for GEO readiness — helping you rank in the next generation of search.

How long does an analysis take?

Most analyses complete in under 10 seconds. StackOptic runs all 18 modules in parallel using a real browser session, so you get technology detection, security audit, performance metrics, SEO analysis, and AI readiness scoring simultaneously.

How accurate are the results?

Detection is based on real browser execution — DOM inspection, JavaScript runtime analysis, HTTP headers, and DNS records. With 7,000+ technology signatures and Lighthouse-calibrated performance scoring, StackOptic achieves high accuracy for mainstream technologies.

What security checks are performed?

The security module evaluates SSL/TLS certificates, 12+ HTTP security headers (HSTS, CSP, X-Frame-Options, Permissions-Policy, Referrer-Policy), HTTPS enforcement, and email authentication (SPF, DKIM, DMARC). Each site receives a letter grade from A+ to F with specific remediation steps.

Do you store the websites I analyze?

StackOptic only stores publicly available information that any visitor to a website would see — HTML content, HTTP headers, DNS records, and screenshots. We do not access private data, log in to websites, or perform any intrusive testing.

Back to Search

robotstxt.org

https://robotstxt.org· First analyzed 20 Feb 2026· Updated 20 Feb 2026

Export

robotstxt.org

Mobile

Sponsored

Hosting Provider

Mythic Beasts

IP Address

93.93.131.3

Server Location

🇬🇧 Cambridge, United Kingdom

ASN

AS44684

Server

Apache

Nameservers

ns1.mythic-beasts.com.ns2.mythic-beasts.com.

Performance

Page Speed

392 KB

13 requests

0–49

50–89

90–100

Architecture Stack

Monolithic

⚙️ SSR

Infrastructure

Hosting

Mythic Beasts

Technology Stack

9 Technologies Detected

Advertising

Google Ads Google AdSense Criteo Outbrain

CSS Frameworks

Icon Libraries

Fonts

Payments

Web Servers

SEO Analysis

D41/100

robotstxt.orgrobotstxt.org

The Web Robots Pages

No description available for this page.

Title Length20 chars

Recommended: 50-60 chars

Description Length0 chars

Recommended: 120-160 chars

Issues (2)

• Missing meta description - important for click-through rates
• Missing viewport meta tag - page may not be mobile-friendly

8 issues found

Upgrade to view details

Crawlability

Sitemap

robots.txt

2 rules

Allows all crawlers

Sponsored

Security Score

0%Critical

Critical / Transactional

No SSL

No WAF

nulld

Top Recommendations

Security recommendation preview

Upgrade to view recommendations

Upgrade to view header details

HTTP Headers

Developer Console

accept-ranges

bytes

connection

Keep-Alive

content-encoding

📦 Gzip(gzip)

content-length

1486

content-type

text/html

date

Fri, 20 Feb 2026 03:57:35 GMT

Good Warning Issue

Email Infrastructure

Custom Mail Server

Score

SPF

DKIM

DMARC

MX Records (2)

mx1.mythic-beasts.com

mx2.mythic-beasts.com

Domain Information

robotstxt.org

Domain Age

25y 5m

Created

04.09.2000

Expires

04.09.2026

Last Updated

31.01.2026

Registrar

Tucows Domains Inc.

DNSSEC

Not Enabled

Privacy & Compliance

Quantcast Choice

Cookie Consent Banner

Quantcast Choice

GDPR Indicators

Cookie consent banner detected

CMP: Quantcast Choice

Legitimate interest basis mentioned

Typography & Readability

Open Sans + Verdana

51/100

Readability

/30

10/40

12px · LH --

Hierarchy

/20

15/25

1.46x ratio

WCAG

/25

15/15

Contrast: undefined

Performance

/25

13/20

2 fonts

Heading Font

Open Sans

Sans18px

Body Font

Verdana

Sans12px

Contrast Ratio

Reading Comfort

~39 CPL

Needs attention

18px

12px

Minor Second

Scale

❌ Critical: 12px body text is too small. Increase to at least 14px.

⚠️ Weak hierarchy: Headlines should be at least 2x body size for clear visual structure.

✅ Good performance: Using 2 font families keeps load times fast.

✅ Smart font loading: Using font-display: swap prevents invisible text during load.

GGoogle Fonts

Business & Marketing Stack

3 Tools Detected

Enterprise

Behavior Analytics

Google AnalyticsFree

User behavior and product analytics

Advertising

Google AdsEnterprise

Ad platforms and retargeting pixels

Privacy & Cookies

Quantcast ChoiceMid-Market

Cookie consent and privacy compliance tools

Sponsored

Scripts & Styles

9 Resources

Scripts

Styles

Async

Defer

Top Script Sources

pagead2.googlesyndication.com(5)fundingchoicesmessages.google.com(2)

Sponsored

Last analyzed: 20 Feb 2026 at 03:57

Historical Analysis & Change Tracking