Files
fullstackjam 2852fc8ad5 fix(extractors): serialize concurrent trafilatura.extract calls (#248)
* fix(extractors): serialize concurrent trafilatura.extract calls

RSS sources can extract full article text from several feeds at once
via asyncio.to_thread. trafilatura 2.1.x–2.3.1 share one module-level
lxml HTMLParser, and concurrent extract() calls can abort the process
with SIGSEGV or SIGABRT. Hold a process-wide lock only around the
parse so HTTP fetching stays concurrent.

See adbar/trafilatura#925 and #1092. The upstream parser-per-call
fix is not in a released trafilatura version yet.

* test(extractors): audit trafilatura lock coverage and reproduction

* docs: distinguish fresh evidence from unavailable historical artifacts
2026-11-22 12:30:45 +08:00
..