Toolkdeps asset
kdeps-tools-web_scraper
v1.0.0Fetch and extract readable text content from any web URL. Returns page title, headers, body content, and links. Use when you need to read a specific web page, article, or documentation URL.
Install
A kdeps asset: kdeps installs it on first run and updates it without a new release.
kdeps update tools/web_scraper
Pin a version with kdeps update tools/web_scraper@<version>.
Contents
Fetch and extract readable text content from any web URL. Returns page title, headers, body content, and links. Use when you need to read a specific web page, article, or documentation URL.
- category
- web
- outputFormat
- HTML page converted to markdown text
- seeAlso
- web_search, wikipedia, http_request
| Parameter | Type | Description |
|---|---|---|
| url * | string | The full URL (including https://) to fetch and extract text from |
constraints: 60s timeout; never scrape the same URL twice in a turn; fails on
authenticated/private URLs; may be blocked by some sites
version: 1.0.0
category: web
description: Fetch and extract readable text content from any web URL. Returns page title, headers, body content, and links. Use when you need to read a specific web page, article, or documentation URL.
constraints: 60s timeout; never scrape the same URL twice in a turn; fails on authenticated/private URLs; may be blocked by some sites
outputFormat: HTML page converted to markdown text
seeAlso: web_search, wikipedia, http_request
parameters:
url:
type: string
description: The full URL (including https://) to fetch and extract text from
required: true
Versions
| Version | Published | Status |
|---|---|---|
| 1.0.0 | 10/11/2026 | active |
Details
- Author
- kdeps
- License
- Apache-2.0
- Latest Version
- 1.0.0
- Published
- 10/11/2026
Tags
kdepstool