How it works
Connect your Zite app to Firecrawl to scrape web pages, extract structured data, and convert websites into clean markdown that’s ready for AI processing or storage. By connecting Firecrawl, you can:- Scrape single web pages and convert them to markdown
- Map and discover all URLs on a website
- Search the web and get clean, structured results
- Crawl entire websites to extract content from multiple pages
- Extract structured data from web pages using custom schemas
- Handle JavaScript-heavy pages and dynamic content automatically
Firecrawl requires your own API key from firecrawl.dev. Zite does not provide a shared Firecrawl account. Usage is billed directly through your Firecrawl account based on pages scraped.
How to integrate Firecrawl into your app
1
Get your Firecrawl API key
If you don’t have a Firecrawl account yet, sign up at firecrawl.dev. Then, create an API key from your API keys page.
Firecrawl API keys start with
fc-. Keep your key secure and never share it publicly.2
Connect to Firecrawl
In the chat box, ask Zite to connect your app to Firecrawl or click the
plus icon + to connect. Then, paste your Firecrawl API key when prompted.3
Enter your use case
Tell Zite how you want to use Firecrawl in your app. Be specific about what you want to scrape or extract. For example:Or for more advanced use cases:
Common use cases
With a Firecrawl connection, you can create apps like:- Research Tools: Let users paste URLs and extract clean content for analysis, or search the web and get AI-generated summaries
- Content Aggregators: Scrape articles from multiple sources and organize them in your app
- SEO Analyzers: Map websites, discover all pages, and analyze site structure
- Lead Generation: Extract company information and contact details from websites
- Documentation Importers: Archive entire documentation sites or pull content into your knowledge base
- Price Monitoring: Track product prices and extract structured pricing data from e-commerce sites
- Market Research: Harvest structured data from competitor sites for analysis
- Content Audits: Build URL inventories and analyze competitor websites
Important notes
- Credits and billing: Firecrawl charges per page scraped. Monitor your usage to avoid unexpected costs.
- Rate limits: Respect rate limits when making multiple requests. For large crawls, use the async crawl endpoint.
- Crawl limits: Always set a page limit when crawling sites to control costs. The maximum is typically 50 pages per crawl.
- JavaScript rendering: Firecrawl handles JavaScript-heavy sites automatically, so modern SPAs work without extra configuration.
- Clean output: Use the
onlyMainContentoption to strip navigation and footer content, giving you just the main article or page content.
Need help?
If you run into issues with Firecrawl:- Check your API key is correct and active
- Verify your Firecrawl account has sufficient credits
- Ensure URLs are publicly accessible (Firecrawl cannot access pages behind authentication)
- Review Firecrawl’s documentation for API details
For Zite-specific support, contact us at support@zite.com.