How the OKF Generator Scans Company Websites
A step-by-step look at how the OKF Generator crawls a public company website and builds an AI-ready knowledge model.
How-To2026-07-10OKF Generator Team
The OKF Generator runs entirely in the browser. Enter any public company URL and it discovers a structured knowledge model.
What happens during a scan
- The URL is resolved and normalized.
- The crawler checks
robots.txtandsitemap.xml. - The homepage is fetched and important pages are discovered.
- Company information, products, contacts, social profiles, technologies, documentation, and API endpoints are extracted.
- The result is packaged for export.
Export formats
You can download the knowledge as Markdown, JSON, YAML, HTML, TXT, CSV, XML, or a complete OKF folder bundle. No signup is required and all processing stays local to your browser.