An enterprise-grade hybrid browser mesh engineered for AI agents, swarms, and high-throughput LLM pipelines. Combines sub-millisecond, low-memory DOM extraction with undetectable Chrome DevTools Protocol automation to navigate Cloudflare walls, Turnstile challenges, and complex SPAs.
| Capability | Engine 1: Lightpanda (Zig Core) | Engine 2: Stealth Nodriver (Chrome CDP) |
|---|---|---|
| Primary Role | High-throughput, sub-millisecond DOM & markdown extraction | Anti-bot bypass, Cloudflare challenges, full browser cloning |
| Startup Overhead | < 10ms (Instant Zig binary execution) | ~1.5s (Full Chrome instance lifecycle) |
| RAM Footprint | ~15 MB per thread | ~120 MB per instance |
| Detection Profile | Optimized for content endpoints & reader modes | Undetectable (Native CDP without standard WebDriver flags) |
| Best Use Case | Real-time RAG ingestion, markdown dumps, semantic trees | Bypassing bot-shields, SPA cloning, event interception |
-
Sub-Millisecond Extraction (
lightpanda_scrape)- Native Zig engine compiles web pages into pure Markdown, Semantic Trees, or structured JSON in under 100ms.
- Ideal for agent tool calls where latency must remain strictly constrained.
-
Undetectable Anti-Bot Automation (
stealth_clone_element)- Eliminates
navigator.webdriverartifacts natively by communicating directly via CDP. - Bypasses Cloudflare Turnstile, Queue-It, and fingerprint barriers.
- Eliminates
-
Universal Model Context Protocol (MCP)
- Pre-packaged FastMCP server ready for integration into Claude Code, Codex, Cursor, and custom agentic frameworks.
# Instant sub-millisecond markdown extraction via Lightpanda
python3 engine.py https://example.com
# Dump HTML or semantic trees
python3 engine.py https://example.com --format html
# Run via stealth engine
python3 engine.py https://example.com --engine stealth --selector "#content"
# Launch MCP server
python3 mcp/server.pyRun the test suite and verify syntax:
# Run unit tests
make test
# Verify syntax across all modules
make lintPart of the Awesome Agent Infrastructure curated catalogue of production-grade agent tools, scrapers, and orchestration runtimes.
Licensed under MIT. Engineered by Aamir Zameer (Amz34).

