Perceive's markdown now reflects what a reader sees rather than how the page was built, and it does so on every page instead of only the ones a particular extractor happened to win. Interface furniture is gone under only_main_content: buttons and tab strips, "Copy page" and "On this page" actions, keyboard shortcut hints, "Was this page helpful?" rating widgets, screen-reader-only labels such as the "Section titled ..." link many docs themes attach to every heading, skip links, breadcrumbs, and blocks a site marks data-nosnippet or data-pagefind-ignore. Structure holds up too: code fences keep their language whichever convention a site uses, so ```python arrives instead of a bare fence; a card link becomes a linked title followed by its description instead of one run-together [DatabaseXYZ provides...] link, with the destination URL preserved; headings stay on one line rather than emitting a bare ## with the text stranded below; and adjacent elements spaced by CSS no longer concatenate into YesNo or EvaluationDeploymentProduction. Zero-width spaces, icon-font glyphs and empty elements that rendered as stray __ are dropped, and duplicate blocks from responsive desktop/mobile twins are collapsed. Inactive tab panels are now kept, so a page's Python and JavaScript samples both reach the markdown instead of only whichever tab was selected at render time. Two new options: truncate_data_arrays collapses long numeric runs such as raw embedding vectors printed in notebook output cells to a leading sample plus a count, following only_main_content unless you set it explicitly, and allow_degraded controls whether an anti-bot challenge with no page content behind it is returned as-is or fails with 502 instead of passing the interstitial off as the page.
Measured across fourteen live documentation and marketing pages, output shrank 67% overall, with one notebook page dropping 94% once its embedding vectors were truncated; the two pages that grew did so because content had previously been lost, regaining a dropped H1, twelve section headings and a table.