39 Commits
Author SHA1 Message Date
Karim shoair 0b74c0f82b docs: make sure the pages are accurate to the changes 2026-10-31 17:51:13 +02:00
Karim shoair fb5417a958 docs: update pages with latest changes including translations 2026-10-31 16:56:42 +02:00
Karim shoair c8568a4149 docs: update all pages to be clearer, fix mistakes, and improve for SEO 2026-10-15 02:52:19 +03:00
Karim shoair 2228316b40 docs: update the docs accordingly with the latest breaking changes 2026-10-08 23:28:12 +03:00
Karim shoair d5b1995ce6 feat(fetchers): add functions to save browser session state and load it 2026-10-08 23:28:12 +03:00
Karim shoair e45311e2c1 docs!: update pages and skill to cover the recent changes 2026-10-04 22:11:08 +03:00
Karim shoair 00d5f3da6e docs: update pages and the skill with the latest changes 2026-10-04 20:59:43 +03:00
Karim shoair 5dac176917 docs: pump version up, update docs, and contact info 2026-09-25 02:57:37 +03:00
Karim shoair 5edd203076 feat(browsers): Include open Shadow DOM content in the response HTML.
Solves #440
2026-09-13 23:30:08 +03:00
Karim shoair f164713efa feat(fetchers): keep browser tabs open and reuse them across requests
Browser sessions no longer close a tab after its request is completed. The tab returns to the pool as ready, and the next request reuses it, reapplying its own timeouts, extra headers, and resource/domain routes (after `unroute_all`) so nothing leaks between requests. Tabs that hit an error or got closed by the browser are closed and evicted, and the internal response listener is detached after every request so reused tabs don't stack handlers.

Adds `close_pages()` to all browser sessions to close every open tab; the next request opens a fresh one. `PagePool` gains `get_ready_page`/`remove_page`/`clear` and `PageInfo.mark_ready`, new pages start busy, and the unused `cleanup_error_pages` is removed.

Proxy-rotation contexts keep closing per request. Docs and the agent skill describe the new lifecycle.
2026-08-23 20:28:30 +03:00
mehmet turac 35a83d38c7 docs: clarify stealth init script visibility 2026-06-14 07:43:04 +03:00
Karim shoair 835e7ca8c3 docs: update old examples 2026-04-26 02:46:13 +03:00
Karim shoair 9af644ef84 docs: improving the code copy-paste experience and use less tokens for the agent skill 2026-04-22 16:52:59 +02:00
Karim shoair 158ff04c96 docs: add the new page_setup feature 2026-04-13 04:38:23 +02:00
Karim shoair 131b729f22 docs: adding the new features 2026-04-12 18:07:38 +02:00
Karim shoair 1f1e475772 docs: add the browser path to docs 2026-03-30 03:37:38 +02:00
Karim shoair 61cda587be docs: update pages with the XHR feature 2026-03-29 23:12:56 +02:00
Karim shoair 73832f9dfe docs: update the website to reflect the google referer logic 2026-03-09 00:29:54 +02:00
Karim shoair b8b9a7f864 docs: general correction across all the pages
Automated. I don't know how I missed all of that!
2026-02-15 03:58:51 +02:00
Karim shoair 7b4523af8e docs: update the titles for all files 2026-02-15 02:35:39 +02:00
Karim shoair 8902034418 docs: improve wording, style, and use more visual ways 2026-02-11 03:04:35 +02:00
Karim shoair a72886f158 docs: update camoufox instructions for StealthyFetcher 2026-02-10 21:58:08 +02:00
Karim shoair f350800fd7 docs: updating Dynamic websites with protection page and some corrections 2026-02-10 21:48:09 +02:00
Karim shoair 55ff20c238 docs: update replacing AI article 2025-12-31 18:28:28 +02:00
Karim shoair d4ae6c49c0 docs: update the StealthyFetcher page 2025-12-31 00:22:33 +02:00
Karim shoair 6c25dccb05 docs: updating the Fetcher Basics and the HTTP requests pages 2025-12-28 21:57:21 +02:00
Karim shoair 026161c8f8 docs: update docs to add file downloading examples 2025-11-10 03:02:41 +02:00
Karim shoair 372fc1e051 docs: Style updates and a lot of clarifications 2025-11-09 02:15:43 +02:00
Karim shoair f9eff25e24 docs: update website accordingly 2025-10-12 06:59:20 +03:00
Karim shoair 4fea8c2e59 docs: Update docs accordingly 2025-10-12 04:51:11 +03:00
Karim shoair 8ad7cd6343 docs: Update all pages/docstrings to reflect recent changes 2025-09-29 03:57:40 +03:00
Karim shoair f604485a09 docs: Update all pages related to last changes 2025-09-14 04:45:56 +03:00
Karim shoair 80077953f6 docs: update all pages related to last changes 2025-09-13 04:19:16 +03:00
Karim shoair 05a714980d docs: Update all docstring according to the new changes 2025-09-11 04:13:36 +03:00
Karim shoair e06f8d36db docs: add init_script new argument 2025-09-02 16:32:19 +03:00
Karim shoair 9e9e79d9b0 docs: fixes and adjustments 2025-09-01 06:39:17 +03:00
Karim shoair e14522f57a docs: update the StealthyFetcher page 2025-08-28 04:53:22 +03:00
Karim shoair e9d60f65bd Removing invalid example 2025-05-18 13:57:23 +03:00
Karim shoair ed694f0a79 First version of Scrapling full documentation 2025-04-08 03:44:57 +02:00