URL Ingestion Guide #

OpenDocs can automatically fetch and ingest content from external URLs, making it easy to aggregate documentation from multiple sources.

API Endpoint #

POST /api/v1/ingest
Content-Type: application/json

Request Body:

{
  "url": "https://example.com/docs/page",
  "category": "guides",
  "tags": ["external", "imported"],
  "autopublish": false
}

MCP Ingest Tool #

{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/call",
  "params": {
    "name": "ingesturl",
    "arguments": {
      "url": "https://example.com/docs/page"
    }
  }
}

What Gets Captured #

• Title - Extracted from page title or first h1
• Content - Main content converted to Markdown
• Source URL - Original URL preserved
• Source Identifier - Domain automatically captured
• Metadata - Open Graph data, publish date, author

Supported Formats #

• HTML pages (auto-converted to Markdown)
• Markdown files
• Plain text
• JSON (structured content)