# crawl-for-ai

Web Scraper via SkillBoss API Hub SkillBoss API Hub scraping capability for full web page extraction with JavaScript rendering. Usage

# Via script
node {baseDir}/scripts/crawl4ai.js "url"
node {baseDir}/scripts/crawl4ai.js "url" --json

Script options: --json — Full JSON response

Output: Clean markdown from the page.

Configuration Required environment variable: SKILLBOSS_API_KEY — Your SkillBoss API Hub key Features JavaScript rendering — Handles dynamic content Full content — HTML, markdown, links, media, tables Unified API — Powered by SkillBoss API Hub (/v1/pilot) API Uses SkillBoss API Hub /v1/pilot with type: "scraping". Result is returned at data.result.