Openclaw Web Scraper

    1

    A high-performance scraping engine with Playwright stealth, proxy rotation, and anti-bot bypass capabilities.

    Free

    42 usesSecurity scanned

    Works with the AI Agents you already use

    Claude CodeClaude CodeCursorCursorCodex CLICodex CLIMuseMuseDotsDots+21 more

    openclaw-web-scraper

    Example session with this skill installed

    Extract the product name, price, and availability from https://tech-store.com/headphones/premium-wireless using playwright-stealth and a US residential proxy.

    • Read your context and instructions
    • Compiled the openclaw-web-scraper
    {
      "status": "success",
      "data": {
        "product_name": "Premium Wireless Headphones",
        "price": "$299.99",
        "availability": "In Stock",
        "metadata": { "engine": "playwright-stealth", "proxy_id": "res-us-882", "render_time": "1.2s" }
      }
    }
    

    Connects securely to your tools. The creator never sees your data.

    About this skill

    A powerful web scraping skill that handles everything from simple page fetches to complex multi-page crawls with anti-bot bypass and proxy rotation. Features include: Playwright-based dynamic page scraping, stealth mode for Cloudflare bypass, automatic proxy rotation with quality scoring, rate limiting with exponential backoff, structured data extraction, and robots.txt compliance. Works with Claude Code, Codex CLI, Cursor, Gemini CLI and any SKILL.md compatible agent.

    • Cannot bypass all enterprise-grade CAPTCHAs
    • Higher resource usage with Playwright engine
    • Performance depends on proxy provider quality

    How to use

    1. 1

      Connect your agent to the Agensi MCP

      Copy the prompt and paste it into Claude, ChatGPT, Cursor or any agent that supports MCP. It sets up the connection for you. Manual setup

    2. 2

      Sign in to Agensi

      Your agent shows a sign-in link. Sign in and click Allow.

    3. 3

      Ask for what you need

      Your agent loads this skill and uses it on your task. It always asks before any payment.

    Reviews

    No reviews yet

    Be one of the first to try it. Every listed skill goes through the trust checks below.

    Security scanned

    Checked by our 8-point scan before listing

    42 uses

    Times used to date

    Free forever

    No account required to browse

    Trust & safety

    Security scan

    Security scan passed 5 months ago

    • Free with an Agensi account

    Permissions

    Browser
    Listed5 months ago

    What's inside

    Frequently Asked Questions

    This skill automates the extraction of data from websites, specifically solving issues like blocking, bot detection, and Javascript-heavy page loading using integrated stealth tools and proxy rotation.

    The skill is designed for any SKILL.md compatible agent, including Claude Code, Cursor, Codex CLI, and Gemini CLI.

    Your purchase includes the full SKILL.md definition, the pre-configured scraping logic, and documentation on how to integrate your own proxy providers for rotation.

    Yes, the engine includes built-in logic for robots.txt compliance and customizable rate limiting with exponential backoff to ensure respectful and legal scraping practices.

    The skill includes a dedicated stealth mode specifically configured to navigate common anti-bot measures like Cloudflare and various fingerprinting scripts used by modern websites.

    New in Data & Databases