102 Commits
Author SHA1 Message Date
warm-cloth 1ebee696a7 fix(agent-skill): accept uv for OpenClaw's installer check (#586) 2026-11-14 19:28:42 +02:00
Karim shoair 66b885d811 build: pump version up and deps 2026-11-14 19:24:39 +02:00
Karim shoair 193bd48776 fix(spider)!: make follow function doesn't inherit any request data from parent
Fixes #558 #587
Avoids the whole bug class.
Closes #559
2026-11-14 18:23:25 +02:00
Karim shoair 3eb3b31641 docs: update docs and skill with recent changes 2026-11-03 18:52:25 +02:00
Karim shoair c476b73ce0 docs: updates docs and skill with the latest changes 2026-11-03 18:52:25 +02:00
Karim shoair e3005a1d40 feat(spiders): add logging file encoding parameter
Better fix than #538
2026-11-02 21:50:48 +02:00
Karim shoair 0b74c0f82b docs: make sure the pages are accurate to the changes 2026-10-31 17:51:13 +02:00
Karim shoair 70ded5d253 Merge branch 'main' into dev 2026-10-31 17:04:11 +02:00
Karim shoair e7d435de87 agent: update skill with the current changes 2026-10-31 16:51:30 +02:00
Karim shoair 063feb0cd3 docs: update skill instructions 2026-10-26 14:47:34 +03:00
Karim shoair 9ac748c52a build: pump version up and deps 2026-10-19 18:42:44 +03:00
Karim shoair fbc2465abc feat(mcp): add mouse drag-and-drop action 2026-10-19 18:42:44 +03:00
Karim shoair eec511f76f docs: Move MCP details into relevant sections 2026-10-17 20:19:29 +03:00
Karim shoair d62e5b9854 docs(spiders): document checkpoint data requirements in all languages
Better workaround for #489
2026-10-17 17:06:30 +03:00
Karim shoair e09f595e66 fix(parser)!: remove any left traces of keep_cdata parameter
The parts that didn't get covered in #493
2026-10-16 01:51:32 +03:00
Karim shoair 965415af20 docs(agent): update the skill to catch up with all the changes 2026-10-15 02:54:43 +03:00
Karim shoair 7183891c31 feat(CrawlSpider): Add crawl strategy with values BFS or DFS 2026-10-13 01:39:11 +03:00
Karim shoair 9cf428038b refactor(rag): Renamed SiteToMarkdownSpider to ContentSpider 2026-10-13 01:08:54 +03:00
Karim shoair 2228316b40 docs: update the docs accordingly with the latest breaking changes 2026-10-08 23:28:12 +03:00
Karim shoair 99a2281923 feat(mcp): Add new tools to set and load browser session state 2026-10-08 23:28:12 +03:00
Karim shoair d5b1995ce6 feat(fetchers): add functions to save browser session state and load it 2026-10-08 23:28:12 +03:00
Yuval DinodiaandKarim shoair 1ac8e52fb1 fix: stop response.follow() inheriting the method, params and body (#462)
* fix: stop response.follow() inheriting the method, params and body

* fix: drop inherited Content-Length in response.follow()

---------

Co-authored-by: Karim shoair <D4Vinci@users.noreply.github.com>
2026-10-08 02:06:50 +03:00
Karim shoair 0d5be50317 docs: mention the default encoding issue for websites with bad default encoding
Fixes the docs issue mentioned at #469
2026-10-07 19:38:04 +03:00
Karim shoair 890d0c08c1 feat/refactor(mcp)!: Renamed browser_snapshot to browser_extract while adding more options
This gives the agent more control
2026-10-07 19:37:56 +03:00
Karim shoair 7d97d07276 feat(mcp): Add a dialog handling action 2026-10-07 02:25:18 +03:00
Karim shoair 5c39feb851 feat(mcp): Add snapshot searching 2026-10-07 02:10:19 +03:00
Karim shoair 1c3e355c9f perf(mcp)!: Combine selector and ref into one field called target
Save some tokens in the tools definition and make it simpler to use the server
2026-10-07 00:44:48 +03:00
Karim shoair 84ddced8b2 refactor(mcp)!: Remove all bulk tools to lower tools definition tokens and more optimizations 2026-10-06 17:45:46 +03:00
Karim shoair e45311e2c1 docs!: update pages and skill to cover the recent changes 2026-10-04 22:11:08 +03:00
Karim shoair 00d5f3da6e docs: update pages and the skill with the latest changes 2026-10-04 20:59:43 +03:00
Karim shoair 2a65a0b9da refactor(mcp)!: Make stealth browser the only browser used 2026-09-29 01:29:17 +03:00
Karim shoair 768e615df6 feat(mcp): Add a new tool to execute JS on page 2026-09-27 18:17:59 +03:00
Karim shoair f6f8d77493 feat(mcp): Make the screenshot tool can select an element instead of full page 2026-09-26 22:23:06 +03:00
Karim shoair 5bbc6842bb fix(mcp)!: Make the screenshot tool doesn't reload the page 2026-09-26 21:58:31 +03:00
Karim shoair 9e36038ca9 feat(mcp)!: Combine all four browser action tools into one chain-able tool 2026-09-26 21:44:45 +03:00
Karim shoair b68157f3f8 feat(mcp): Add a new tool to wait for several conditions (Chainable) 2026-09-26 21:04:25 +03:00
Karim shoair 69bdfd5335 refactor(mcp)!: Combine all mouse tools into one mouse actions tool to chain actions 2026-09-26 20:12:21 +03:00
Karim shoair 427f00ffea feat(mcp)!: Replace browser type with fields filling tool to save tokens 2026-09-26 19:07:00 +03:00
Karim shoair 6ed271d33f feat(mcp): add a tool to fill all kinds of inputs in a page 2026-09-26 18:30:20 +03:00
Karim shoair 3cc50aa9f3 feat(mcp): Add tool to chain keyboard keys 2026-09-26 17:19:46 +03:00
Karim shoair e512bc0bc4 feat(mcp): Add tool to control mouse wheel 2026-09-26 16:13:50 +03:00
Karim shoair 230ac0995e feat(mcp): Add tool to write text 2026-09-25 22:59:15 +03:00
Karim shoair a049dd70c8 feat(mcp): Add hover to the mouse movement tool 2026-09-25 02:57:38 +03:00
Karim shoair dc6a8b2480 docs: update docs and skill with the new changes 2026-09-25 02:57:38 +03:00
Karim shoair c8cc8977ff fix(mcp)!: Rename all browser based tools and move session validation inside session look up function 2026-09-25 02:57:38 +03:00
Karim shoair 5dac176917 docs: pump version up, update docs, and contact info 2026-09-25 02:57:37 +03:00
Karim shoair 6e644048eb docs(skill): Update skills files with the updates 2026-09-13 23:42:28 +03:00
Karim shoair f164713efa feat(fetchers): keep browser tabs open and reuse them across requests
Browser sessions no longer close a tab after its request is completed. The tab returns to the pool as ready, and the next request reuses it, reapplying its own timeouts, extra headers, and resource/domain routes (after `unroute_all`) so nothing leaks between requests. Tabs that hit an error or got closed by the browser are closed and evicted, and the internal response listener is detached after every request so reused tabs don't stack handlers.

Adds `close_pages()` to all browser sessions to close every open tab; the next request opens a fresh one. `PagePool` gains `get_ready_page`/`remove_page`/`clear` and `PageInfo.mark_ready`, new pages start busy, and the unused `cleanup_error_pages` is removed.

Proxy-rotation contexts keep closing per request. Docs and the agent skill describe the new lifecycle.
2026-08-23 20:28:30 +03:00
Karim shoair 6ca35d0448 feat(spiders): Adding easy interface for building RAG systems 2026-08-23 16:26:15 +03:00
Karim shoair 6e6373c997 feat(mcp): add two tools to open requests sessions and use them 2026-08-22 19:17:32 +03:00