Wick Documentation

Browser-grade web access for AI agents. Install in 30 seconds, fetch any page.

Quick Start

Install Wick, configure your agent, and fetch your first page.

1. Install

macOS (Homebrew):

brew tap wickproject/wick && brew install wick

Linux (apt):

curl -fsSL https://wickproject.github.io/wick/apt/install.sh | bash

Any platform (npm):

npm install -g wick-mcp

2. Configure

wick setup

Auto-detects Claude Code, Cursor, and other MCP clients. Writes the config for you.

3. Fetch

Ask your agent to read a webpage. It will use wick_fetch automatically.

# Or test from the command line:
wick fetch https://www.nytimes.com

Agent Configuration

Make your agent always use Wick instead of its built-in fetch (which gets blocked).

Claude Code

Add to your project's CLAUDE.md:

When fetching web pages, always use the wick_fetch MCP tool
instead of the built-in WebFetch tool. wick_fetch bypasses
anti-bot protection and returns cleaner content.
Use wick_search for web searches.

Cursor

Add to .cursorrules:

When you need to read a webpage or fetch a URL, use the
wick_fetch tool. When you need to search the web, use
the wick_search tool.

Other MCP Agents

Add to AGENTS.md, your system prompt, or equivalent instructions file:

You have access to wick_fetch and wick_search MCP tools.

- Use wick_fetch to read any URL. Returns clean markdown
  and bypasses anti-bot protection.
- Use wick_search to search the web.
- Always prefer these over built-in fetch/browse tools.

Manual MCP Config

If wick setup didn't detect your client, add this to your MCP configuration JSON:

{
  "mcpServers": {
    "wick": {
      "command": "wick",
      "args": ["serve", "--mcp"]
    }
  }
}

Config file locations:

• Claude Code: ~/.claude/claude_desktop_config.json
• Cursor: ~/.cursor/mcp.json

wick_fetch

Fetch a web page and get clean, LLM-friendly content. Uses Chrome's network stack to bypass anti-bot protection.

Example: Markdown (default)

# Returns clean markdown with title
wick fetch https://en.wikipedia.org/wiki/Rust_(programming_language)

# Output:
# Rust (programming language)

Rust is a general-purpose programming language emphasizing
performance, type safety, and concurrency...

Example: Raw HTML

wick fetch https://example.com --format html

# Returns full page HTML source, no extraction

Example: Plain text

wick fetch https://example.com --format text

# Returns visible text content, no formatting

Robots.txt

By default, Wick respects robots.txt. To override:

wick fetch https://reddit.com/r/technology --no-robots

wick_crawl

Crawl a website starting from a URL. Follows same-domain links, fetches each page through Chrome's TLS pipeline, and returns clean markdown for every page.

Example

wick crawl https://docs.example.com --depth 2 --max-pages 10

# Returns structured output:
# Crawl Results: docs.example.com
# Crawled 8 pages in 4.2s
#
# --- Page 1: Introduction ---
# [markdown content]
#
# --- Page 2: Getting Started ---
# [markdown content]

Rate-limited at 500ms between requests. Media (video/audio) is automatically detected on crawled pages.

wick_map

Discover all URLs on a website. Checks sitemap.xml first, then follows links to build a complete URL map.

Example

wick map https://example.com --limit 50

# Site Map: example.com
# Found 47 URLs (12 from sitemap.xml)
#
# - https://example.com/
# - https://example.com/about
# - https://example.com/docs/intro

wick_search

Search the web and get structured results. Use wick_fetch to read any result in full.

Example

wick search "rust async runtime" --num 3

# Output:
1. Tokio - An asynchronous Rust runtime
   The Tokio project provides the building blocks needed
   for writing reliable, high-performance async apps...

2. Async in Rust - The Rust Programming Language
   Rust's async/await syntax makes writing asynchronous
   code feel almost like writing synchronous code...

3. async-std - Async version of the Rust standard library
   async-std provides an async version of std, making
   async programming easy and portable...

wick_download

Download video and audio from Reddit, YouTube, Twitter, and 1000+ other sites. Powered by yt-dlp.

wick download "https://v.redd.it/4uofpbxa97rg1" -o ./archive
# Downloaded: video.mp4
# Size: 33.7 MB

wick_session

Manage persistent browser sessions. Clear cookies and cache to start fresh.

# Clear all stored cookies and cache
wick session clear

HTTP API Server

Wick can run as a local HTTP API server, making browser-grade web access available to any tool on your machine — Python scripts, LangChain, n8n, Jupyter notebooks, custom agents, anything that can make HTTP requests.

wick serve --api
# Wick 0.7.0 + Pro API server running at http://127.0.0.1:8090

Change the port with --port:

wick serve --api --port 3000

Endpoints

Example: Python

import requests

r = requests.get("http://localhost:8090/v1/fetch", params={"url": "https://nytimes.com"})
data = r.json()
print(data["content"])  # clean markdown

Example: curl

curl "http://localhost:8090/v1/fetch?url=https://nytimes.com" | jq .content

Example: JavaScript

const r = await fetch("http://localhost:8090/v1/crawl?url=https://docs.example.com&max_pages=5");
const { pages } = await r.json();
pages.forEach(p => console.log(p.title, p.content.length));

CLI: wick fetch

wick fetch <URL> [OPTIONS]

Options:
  --format <FORMAT>    Output: markdown, html, text  [default: markdown]
  --no-robots          Ignore robots.txt restrictions

Examples

# Fetch as markdown
wick fetch https://www.nytimes.com

# Fetch raw HTML
wick fetch https://www.nytimes.com --format html

# Fetch plain text
wick fetch https://www.nytimes.com --format text

# Ignore robots.txt
wick fetch https://reddit.com/r/technology --no-robots

CLI: wick search

wick search <QUERY> [OPTIONS]

Options:
  -n, --num <NUM>     Number of results  [default: 5]

Examples

wick search "MCP server protocol"
wick search "rust error handling" --num 10

CLI: setup / serve / version

wick setup

Auto-detect and configure MCP clients.

wick setup
# Detects Claude Code, Cursor, etc. and writes MCP config.

wick serve --mcp

Start the MCP server on stdio. Used by MCP clients — you don't usually run this directly.

wick serve --mcp

wick serve --api

Start the HTTP API server. Makes Wick accessible to any tool on your machine.

wick serve --api
# API running at http://127.0.0.1:8090

wick serve --api --port 3000
# API running at http://127.0.0.1:3000

wick version

wick version
# wick 0.7.0 (rust)

Output Formats

Wick supports three output formats via the format parameter:

Markdown (default)

The full page converted to clean markdown. Strips <script>, <style>, <nav>, <header>, <footer>, and <aside> tags. Adds a title as an H1 heading.

Best for: LLM consumption, content extraction, research.

HTML

The raw page HTML exactly as received. No processing or extraction.

Best for: debugging, custom parsing, when you need the full DOM.

Text

Visible text content only. All HTML tags stripped, no markdown formatting.

Best for: word counts, text analysis, simple extraction.

How It Works

When your agent calls wick_fetch, here's what happens:

1. MCP protocol — Your agent sends a tool call via the Model Context Protocol. Wick runs as a local MCP server on stdio.
2. Chrome TLS — The request goes through Chrome's actual network stack (BoringSSL, HTTP/2, QUIC). The TLS fingerprint is identical to a real Chrome browser.
3. Your IP — Because Wick runs locally, the request exits from your residential IP address. No cloud proxy, no datacenter IPs that get flagged.
4. Content extraction — The HTML response is converted to clean markdown. Navigation, ads, and boilerplate are stripped.
5. Response — Your agent receives clean, LLM-friendly content it can reason about immediately.

Troubleshooting

Still getting 403 errors

If your agent is still getting blocked, it may be using its built-in fetch instead of Wick. Check:

1. Run wick fetch <url> from your terminal — if this works, the issue is agent configuration
2. Add instructions to CLAUDE.md or .cursorrules to prefer wick_fetch (see Agent Configuration)
3. Some sites block based on IP reputation — try from a different network

wick: command not found

The binary isn't in your PATH. Try:

# Check if it's installed
which wick
ls /opt/homebrew/bin/wick   # macOS Homebrew
ls /usr/local/bin/wick      # Linux

# Or run from the repo
./rust/target/release/wick version

wick setup didn't detect my client

You can configure manually. See Manual MCP Config above.

Slow responses

First fetches may be slower while the connection pool warms up. Subsequent fetches to the same domain are faster. If consistently slow:

• Check your internet connection
• Some sites intentionally delay automated requests
• Try --format html to skip markdown conversion

robots.txt blocking

Wick respects robots.txt by default. If a site blocks automated access:

wick fetch https://example.com --no-robots

The response will tell you when robots.txt is the reason for a block.