Data Export

Detailed Reports

Download comprehensive TSV reports with all crawl data. Every URL, every link, every metric—ready for analysis.

Overview

What Are Detailed Reports?

Detailed reports are comprehensive TSV (tab-separated values) files that contain every piece of data collected during your website audit. Unlike simple summaries or dashboards, these reports give you raw, complete data that you can analyze, filter, pivot, and share.

Each report is structured into sections: SUMMARY (high-level stats), SITEMAP sections (split into Crawlable and Non-Crawlable), URLS_FETCHED (all pages crawled with full metadata), and EXTERNAL_URLS (outbound links discovered). This structure makes it easy to navigate to exactly the data you need.

Reports are generated automatically as the audit runs—written to disk every minute. This means even if the process crashes or is cancelled, you don't lose data. The final report includes total execution time, memory usage, and complete coverage statistics.

TSV format was chosen over CSV because it's 49% smaller (tabs instead of commas mean less escaping), opens natively in Excel and Google Sheets, and is easier to parse programmatically. Perfect for both human analysis and automated workflows.

Sample Report Structure

=== SUMMARY ===
TOTAL_TIME: 00:03:47
URLS_FETCHED: 142
SITEMAP_CRAWLABLE: 135
SITEMAP_NON_CRAWLABLE: 7

=== SITEMAP (Crawlable) ===
URL	CAN_CRAWL	HTTP_STATUS	DEPTH	LASTMOD	CHANGEFREQ	PRIORITY
https://example.com/	true	200	0	2025-11-01	daily	1.0
https://example.com/about	true	200	1	2025-10-15	weekly	0.8

=== URLS_FETCHED ===
URL	HTTP_STATUS	DEPTH	CONTENT_TYPE	RESPONSE_TIME	IN_SITEMAP
https://example.com/	200	0	text/html	245ms	true

Capabilities

Report Features

Everything you need for comprehensive data analysis

TSV Format

Tab-separated values for easy import into Excel, Google Sheets, or data analysis tools. 49% smaller than CSV.

Structured Sections

Reports split into Summary, SITEMAP (Crawlable/Non-Crawlable), URLS_FETCHED, and EXTERNAL_URLS sections.

Complete Metadata

Every URL includes HTTP status, depth level, sitemap metadata (lastmod, changefreq, priority), and more.

Instant Download

Download reports directly from the web interface or via API. Files available for 30 days after completion.

Automatic Generation

Reports written to disk every minute during crawl. Never lose data even if the process crashes.

Summary Statistics

Top-level metrics: Total time, pages crawled, sitemap coverage, external links, memory usage, and more.

Structure

Report Sections Explained

Understanding what's in each section

SUMMARY

High-level audit metrics and key findings

Fields Included:

TOTAL_TIME (audit duration)

URLS_FETCHED (pages crawled)

URLS_FOUND (pages discovered)

EXTERNAL_URLS (external links)

SITEMAP_TOTAL (sitemap URLs)

SITEMAP_CRAWLABLE (can reach)

SITEMAP_NON_CRAWLABLE (errors)

SITEMAP (Crawlable)

Sitemap URLs that were successfully crawled

Fields Included:

URL (page address)

CAN_CRAWL (true)

HTTP_STATUS (200, 301, etc.)

DEPTH (0-10)

LASTMOD (from sitemap)

CHANGEFREQ (from sitemap)

PRIORITY (from sitemap)

SITEMAP (Non-Crawlable)

Sitemap URLs that returned errors or could not be reached

Fields Included:

URL (page address)

CAN_CRAWL (false)

HTTP_STATUS (404, 500, etc.)

DEPTH (N/A if not reached)

LASTMOD (from sitemap)

CHANGEFREQ (from sitemap)

PRIORITY (from sitemap)

URLS_FETCHED

All pages successfully crawled with metadata

Fields Included:

URL (page address)

HTTP_STATUS (response code)

DEPTH (link depth from start)

CONTENT_TYPE (mime type)

RESPONSE_TIME (milliseconds)

IN_SITEMAP (true/false)

EXTERNAL_URLS

External links discovered during crawl (blocked from following)

Fields Included:

URL (external link)

SOURCE_URL (page it was found on)

REL_ATTRIBUTE (nofollow, etc.)

COUNT (times encountered)

Applications

What Can You Do With Reports?

Real-world use cases for detailed audit reports

Technical SEO Audits

Import report into spreadsheets for analysis. Filter by HTTP status to find 404s, sort by depth to find buried content.

Action:

Use SITEMAP sections to validate coverage

Content Strategy

Identify pages missing from sitemap. Export URLS_FETCHED to find content gaps and prioritize new content creation.

Action:

Use DEPTH column to find orphaned content

Link Building Analysis

Analyze EXTERNAL_URLS to understand outbound link profile. Find opportunities to link to internal content instead.

Action:

Use SOURCE_URL to see linking patterns

Client Reporting

Share comprehensive reports with stakeholders. Professional TSV format imports cleanly into any spreadsheet tool.

Action:

Use SUMMARY for executive overview

Automated Workflows

Parse TSV reports programmatically. Integrate with CI/CD pipelines to detect SEO regressions on deploys.

Action:

Use API to fetch reports automatically

Historical Tracking

Compare reports over time. Track how site structure, sitemap coverage, and crawlability evolve.

Action:

Archive reports for trend analysis

Format

Why TSV Over CSV?

The technical advantages of tab-separated values

Smaller File Size

49% smaller than CSV format

Tabs instead of commas mean less escaping and quoting

Excel Compatible

Opens natively in Excel and Google Sheets

No import wizard needed, just double-click

Easy Parsing

Simple split on tab character

No complex CSV parsing libraries required

No Escaping Issues

URLs and text rarely contain tabs

Commas in URLs require quoting, tabs don't

Process

How Reports Are Generated

From audit start to download

Audit Runs

Crawler processes your website, collecting data on every page, link, and sitemap entry.

Data Stored

All crawl data saved to SQLite database. Ensures no data loss even if process crashes.

Report Generated

Every 1 minute during crawl, TSV report is written to disk with latest data. Updated continuously.

Completion

Final report written on completion with full summary statistics including total time and memory usage.

Download Available

Report accessible via web interface download button or direct API endpoint. Available for 30 days.

Specifications

Report Statistics

Real-world report metrics

49%

Smaller than CSV format

Days report retention

50K

Max URLs per report (Pro)

Generate Your First Report

Get comprehensive TSV reports with all your crawl data. Download, analyze, and optimize your website.

Free plan includes detailed reports • No credit card required