mirror of
https://github.com/D4Vinci/Scrapling.git
synced 2026-11-21 02:44:16 +08:00
1.2 KiB
1.2 KiB
title, description
| title | description |
|---|---|
| Scrapling CLI: Scrape from the Terminal | Install Scrapling terminal tools and choose between extract commands, the interactive shell and the MCP server. Follow the guide for your task. |
Command Line Interface
Since v0.3, Scrapling includes a powerful command-line interface that provides three main capabilities:
- Interactive Shell: An interactive Web Scraping shell based on IPython that provides many shortcuts and useful tools
- Extract Commands: Scrape websites from the terminal without any programming
- Utility Commands: Installation and management tools
# Launch interactive shell
scrapling shell
# Convert the content of a page to markdown and save it to a file
scrapling extract get "https://example.com" content.md
# Get help for any command
scrapling --help
scrapling extract --help
Requirements
This section requires you to install the extra shell dependency group, like the following:
pip install "scrapling[shell]"
For browser fetching, also install the browser dependencies:
scrapling install
This downloads Chromium and its system dependencies, and updates the TLD list. HTTP requests do not need this step.