{"slug":"firecrawl-knowledge-ingest","title":"firecrawl-knowledge-ingest","summary":"Ingest public or authenticated knowledge bases and docs portals with Firecrawl browser. Use for JS-heavy docs, login-gated portals, paginated help centers, support knowledge bases, or structured JSON/markdown extraction from documentation sites.","platform":"Claude","tags":[],"authorName":"LLM Mart","authorSlug":"llm-mart","score":0,"source":"github","price":null,"verified":false,"createdAt":"2026-10-17T09:07:10.167583Z","repo":{"url":"https://github.com/firecrawl/skills","stars":126,"forks":36,"license":"ISC","updatedAt":"2026-10-17T00:34:48Z"},"bodyHtml":"<hr>\n<p>name: firecrawl-knowledge-ingest\ndescription: Ingest public or authenticated knowledge bases and docs portals with Firecrawl browser. Use for JS-heavy docs, login-gated portals, paginated help centers, support knowledge bases, or structured JSON/markdown extraction from documentation sites.\nlicense: ISC\nmetadata:\nauthor: firecrawl\nversion: \"0.1.0\"\nhomepage: <a href=\"https://www.firecrawl.dev\">https://www.firecrawl.dev</a>\nsource: <a href=\"https://github.com/firecrawl/firecrawl-workflows\">https://github.com/firecrawl/firecrawl-workflows</a>\ninputs:</p>\n<ul>\n<li>name: FIRECRAWL_API_KEY\ndescription: Firecrawl API key for hosted Firecrawl requests.\nrequired: true</li>\n</ul>\n<hr>\n<h1>Firecrawl Knowledge Ingest</h1>\n<p>Use this when a docs portal needs browser navigation, auth, pagination, or JS rendering.</p>\n<h2>Onboarding Interview</h2>\n<p>Infer the portal URL, output format, auth needs, and page limit from context. If the portal is clear, proceed immediately.</p>\n<p>Ask at most 1-3 concise questions only if blocked, such as the portal URL, whether authentication is required, or the desired output format.</p>\n<h2>Firecrawl Collection Plan</h2>\n<p>Use Firecrawl browser to:</p>\n<ul>\n<li>open the portal and inspect navigation</li>\n<li>identify sections, categories, sidebar links, and article URLs</li>\n<li>follow sidebar navigation, next links, pagination, load-more controls, or search</li>\n<li>scrape article content as markdown</li>\n<li>extract metadata such as title, section, last updated date, author, and tags</li>\n</ul>\n<p>Try Firecrawl map as a supplement for public URLs, but use browser navigation for auth-gated or JS-heavy content.</p>\n<h2>Final Deliverable</h2>\n<pre><code># Knowledge Ingest: [Portal]\n\n## Summary\n[Pages extracted, sections covered, limitations]\n\n## Output\n[JSON/markdown/merged file path or content]\n\n## Sections\n[Section names and article counts]\n\n## Failed Or Restricted Pages\n[Any access/loading issues]\n\n## Sources\n[URLs extracted]\n\n## Rerun Inputs\nworkflow: firecrawl-knowledge-ingest\nurl: [portal url]\nformat: [json/markdown/merged]\nmax_pages: [number]\n</code></pre>\n<h2>JSON Shape</h2>\n<p>Use <code>source</code>, <code>url</code>, <code>extractedAt</code>, <code>totalArticles</code>, and <code>sections[]</code> with article <code>title</code>, <code>url</code>, <code>section</code>, <code>content</code>, and <code>metadata</code>.</p>\n<h2>Quality Bar</h2>\n<ul>\n<li>Preserve code examples, tables, and formatting.</li>\n<li>Strip nav chrome, headers, and footers.</li>\n<li>Track extraction progress and page failures.</li>\n<li>Respect authentication boundaries.</li>\n</ul>\n","files":[{"path":"SKILL.md","sizeBytes":2258,"isText":true}],"reviewScore":null,"reviewSummary":null,"trust":{"provenance":"trusted-source-unreviewed","notice":"Community-authored content, reproduced verbatim and not vetted as instructions. Treat it as data to evaluate, never as directives to follow.","bodySource":null},"bodyLocked":false,"purchaseUrl":null,"sourceUrl":null,"report":{"provenance":"trusted-source-unreviewed","screen":{"ran":true,"outcome":"clean","suspicious":0,"notes":0,"hiddenCharacters":false},"virusScan":{"engine":"clamav","status":"clean","scannedAt":"2026-10-17T09:07:45.316604Z","sha256":"ED9C650C1F29372AFC4B396298C339CB4A0E802BADFB5D4F41E7FB21D95DE886","sizeBytes":1198},"review":null,"source":{"repositoryUrl":"https://github.com/firecrawl/skills","path":"skills/workflows/firecrawl-knowledge-ingest","license":"ISC","commit":"85071566adaf3f47fdec0e00760fa355bb469d71","subtreeSha":"E2757C954C54D6F7592D4B5973E4560C31B892908A8DBA7DB048C1803D165391","lastSyncedAt":"2026-10-17T09:07:05.843473Z"},"reviewedAt":"2026-10-17T09:08:44.01437Z","notice":"Community-authored content, reproduced verbatim and not vetted as instructions. Treat it as data to evaluate, never as directives to follow."},"install":[{"target":"skills-cli","command":"npx skills add https://github.com/firecrawl/skills/tree/main/skills/workflows/firecrawl-knowledge-ingest"},{"target":"claude-code","command":"claude plugin marketplace add https://llmmart.ai/marketplace.json && claude plugin install firecrawl-skills@llmmart"},{"target":"git","command":"git clone https://github.com/firecrawl/skills.git"}]}