P

web-browser-mcp-server

...
Created 11/29/2024byblazickjp

Language:

Python

Stars:

25

Forks:

6

Twitter Follow smithery badge Python Version License: MIT PyPI Downloads PyPI Version

✨ Features

🌐 Enable AI assistants to browse and extract content from the web through a simple MCP interface.

The Web Browser MCP Server provides AI models with the ability to browse websites, extract content, and understand web pages through the Message Control Protocol (MCP). It enables smart content extraction with CSS selectors and robust error handling.

🀝 Contribute β€’ πŸ“ Report Bug

✨ Core Features

  • 🎯 Smart Content Extraction: Target exactly what you need with CSS selectors
  • ⚑ Lightning Fast: Built with async processing for optimal performance
  • πŸ“Š Rich Metadata: Capture titles, links, and structured content
  • πŸ›‘οΈ Robust & Reliable: Built-in error handling and timeout management
  • 🌍 Cross-Platform: Works everywhere Python runs

πŸš€ Quick Start

Installing via Smithery

            To install Web Browser Server for Claude Desktop automatically via [Smithery](https://smithery.ai/server/web-browser-mcp-server):
npx -y @smithery/cli install web-browser-mcp-server --client claude

Installing Manually

Install using uv:

uv tool install web-browser-mcp-server

For development:

# Clone and set up development environment
git clone https://github.com/blazickjp/web-browser-mcp-server.git
cd web-browser-mcp-server

# Create and activate virtual environment
uv venv
source .venv/bin/activate

# Install with test dependencies
uv pip install -e ".[test]"

πŸ”Œ MCP Integration

Add this configuration to your MCP client config file:

{
    "mcpServers": {
        "web-browser-mcp-server": {
            "command": "uv",
            "args": [
                "tool",
                "run",
                "web-browser-mcp-server"
            ],
            "env": {
                "REQUEST_TIMEOUT": "30"
            }
        }
    }
}

For Development:

{
    "mcpServers": {
        "web-browser-mcp-server": {
            "command": "uv",
            "args": [
                "--directory",
                "path/to/cloned/web-browser-mcp-server",
                "run",
                "web-browser-mcp-server"
            ],
            "env": {
                "REQUEST_TIMEOUT": "30"
            }
        }
    }
}

πŸ’‘ Available Tools

The server provides a powerful web browsing tool:

browse_webpage

Browse and extract content from web pages with optional CSS selectors:

# Basic webpage fetch
result = await call_tool("browse_webpage", {
    "url": "https://example.com"
})

# Target specific content with CSS selectors
result = await call_tool("browse_webpage", {
    "url": "https://example.com",
    "selectors": {
        "headlines": "h1, h2",
        "main_content": "article.content",
        "navigation": "nav a"
    }
})

βš™οΈ Configuration

            Configure through environment variables:
VariablePurposeDefault
REQUEST_TIMEOUTWebpage request timeout in seconds30

πŸ§ͺ Testing

Run the test suite:

python -m pytest

πŸ“„ License

Released under the MIT License. See the LICENSE file for details.


Made with ❀️ by the Pear Labs Team

Last updated: 3/5/2025

Publisher info

blazickjp's avatar

Joe Blazick

Sr. Data Scientist working at Amazon

Amazon
Pittsburgh, PA
8
followers
6
following
25
repos

More MCP servers built with Python

composer-trade-mcp

Create, backtest, and execute trades directly in one chat box. The Composer MCP Server gives LLMs the power to backtest investment ideas and execute automated trading strategies. Trade across stocks, ETFs, and crypto directly in Claude.

By https://github.com/ronnyli
slidespeak-mcp

An MCP to generate presentations with AI. Create and edit PowerPoint presentations with AI.

By https://github.com/SlideSpeak
PaddleOCR

The PaddleOCR MCP server brings enterprise-grade OCR and document parsing capabilities to AI applications. Built on PaddleOCR β€” a proven solution with 50,000+ GitHub stars, deeply integrated by leading projects like MinerU, RAGFlow, and OmniParserβ€” with targeted optimizations based on the MCP concept.

By PaddlePaddle