FullStackCrawlerLabs logoFullStackCrawlerLabs
BETA

Web Crawling & Analysis

Self-hosted desktop app for crawling websites and analyzing content. Currently in beta β€” free to use, your data stays on your machine.

Full Site Crawling

Crawl entire websites with configurable depth and limits

Content Capture

Collect HTML, screenshots, and network data

Data Analysis

Analyze page structure, links, and content

Export Options

Export results to CSV, JSON, or download assets

Session Sync

Use browser cookies/sessions for authenticated crawling

Self-Hosted

Your data stays local, no cloud dependency

Bot-Friendly Crawling

Handles automation detection, rate limiting, and stealth modes

Performance Analysis

Lighthouse-style performance metrics and optimization tips

SEO Insights

Analyze meta tags, headings, structured data, and crawlability

Accessibility Audit

Check ADA/WCAG compliance and accessibility issues

Security Scan

Detect mixed content, missing headers, and common vulnerabilities

More Coming

New tools added based on community feedback

Beta Installation Guide

First-time setup instructions for each platform

Why am I seeing security warnings?

The app is in beta and not yet code-signed. Your operating system will flag it as unverified β€” this is expected. The warnings will go away once we purchase signing certificates before the full release.

macOS
Intel & Apple Silicon
macOS 13 & 14
Ventura / Sonoma

Gatekeeper blocks ad-hoc signed apps. Use either method to open it once β€” after that it launches normally.

Option A: Right-click method
1

Open the Applications folder in Finder

2

Right-click (or Control-click) the app

3

Select "Open" from the context menu

4

Click "Open" in the dialog that appears

Option B: System Settings
1

Try opening the app normally (it will be blocked)

2

Open System Settings β†’ Privacy & Security

3

Scroll down β€” you'll see a message about the blocked app

4

Click "Open Anyway" and confirm

macOS 15+
Sequoia

Sequoia removed the right-click bypass for ad-hoc signed apps. Use one of these methods instead.

Option A: System Settings (recommended)
1

Try opening the app normally (it will be blocked)

2

Open System Settings β†’ Privacy & Security

3

Scroll down β€” you'll see a message about the blocked app

4

Click "Open Anyway" and enter your password to confirm

Option B: Terminal command

Remove the quarantine attribute so macOS treats the app as trusted:

xattr -d com.apple.quarantine /Applications/FullStack\ Crawler\ Labs.app
Windows
10 / 11

SmartScreen shows a β€œWindows protected your PC” warning for unsigned apps. This is a one-time bypass.

1

Run the installer β€” SmartScreen will show a blue warning

2

Click "More info" (the text link, not a button)

3

Click "Run anyway" to proceed with installation

🐧

Linux
AppImage

No warnings β€” just make the file executable and run it.

chmod +x FullStack-Crawler-Labs-*.AppImage
./FullStack-Crawler-Labs-*.AppImage