Documentation Index
Fetch the complete documentation index at: https://docs.screenpi.pe/llms.txt
Use this file to discover all available pages before exploring further.
week of may 14, 2026
new features
- per-site consent before importing browser cookies — when an agent needs to act on a signed-in site (Gmail, GitHub, your bank), the embedded browser now asks you to approve session access for that specific host before copying any cookies from Arc/Chrome/Brave/Edge. saved passwords are never read.
- CLI flag to skip the meeting detector —
--disable-meeting-detectorskips the v2 meeting watcher entirely (no process / accessibility scan every 5 s). useful for headless or task-mining setups that only consumeaccessibility_textandui_events. see the CLI reference. - CLI flag to skip snapshot compaction —
--disable-snapshot-compactionskips the background JPEG→MP4 worker for users who don’t open the MP4 timeline UI. disk usage falls back to your--retention-dayssetting. see the CLI reference. - codex-style chat queue steering — queue follow-up messages while the agent is still working and reorder or cancel them before they run.
updates
- transcription fallback notice — when your requested transcription engine isn’t available (signed out, no subscription, missing Deepgram key), the audio panel now tells you which engine is actually running and why, instead of failing silently. see meeting transcription.
- multiple OAuth accounts per connection, restored — connections that support more than one account (e.g. multiple Google or GitHub instances) again list each one separately in settings → connections instead of collapsing into a comma-separated label.
- faster, smoother UI — overlay data, health checks, meetings, and timeline hooks have been reworked to cut re-renders and main-thread work on macOS. the timeline streamer now caps batches and stops retrying forever on a broken connection, so a stalled stream recovers cleanly.
- clearer doctor output —
screenpipe doctornow verifies the API port is actually listening and gives a step-by-step macOS fix when ScreenCaptureKit can’t open system audio (including the exact terminal app to grant in System Settings → Privacy & Security → Screen & System Audio Recording). see the CLI reference. - CLI tips use
npx— startup tips for installing bundles and signing in now shownpx screenpipe …so the commands work without a global install. - chat search and switching feel snappier — additional optimization passes on the chat sidebar and search modal.
- Windows timeline hardening — WebView2 startup and the timeline frame stream are more resilient to transient failures, with bounded retries and per-frame limits.
bug fixes
- Windows: no more flashing shell windows — background shell commands triggered by the app no longer pop a console window into focus.
- meeting notifications now open the right live note — clicking a meeting notification deep-links into the correct in-progress note instead of a stale one.
- live transcript order and AI summaries — fixed out-of-order segments and missing summaries in the live meeting transcript and meeting notes panels. see meeting transcription.
- capture exclusions search — the search and “exclude this app” actions in capture exclusions now update reliably and stay in sync with the current query.
- AI gateway error reporting — fixed Sentry regressions in the AI gateway for Anthropic, Gemini, and Vertex providers so failed requests are reported with the right context instead of being swallowed.
week of may 10, 2026
new features
- local AI PII removal — the on-device PII redactor is back, now powered by OPF v3 for text and rfdetr_v9 for images. Defaults to a credentials-only policy that catches Anthropic, OpenAI, Google, Hugging Face, GitHub, and Cloudflare API keys without touching the rest of your timeline. Apple Silicon gets a ~6× faster MLX path on macOS 26+. enable in settings → privacy → AI PII removal. see privacy filter.
- toggle for cloud audio, video, and image analysis — single switch in settings → privacy controls whether agents can call the cloud media analysis enclave. on by default; flip it off to keep media analysis fully local.
- Codex MCP connection — connect Codex from settings → connections to use it as an MCP client alongside Claude Desktop, Claude Code, and the other supported agents.
- Bee wearable integration now works — the connection was registered but TLS-failed against Bee’s private root CA. it now ships a real, logged-in client.
- chat search across past conversations — the existing memory search now finds chats too. press the search shortcut and start typing.
- chat picker in the collapsed sidebar — switch between chats without expanding the sidebar.
- monitor topology toasts — get a notification when a display is plugged in, unplugged, or swapped (e.g. clamshell to external). turn it off in settings → notifications → display changes if it’s noisy on a rotating dock setup.
- hide thinking blocks — collapsible chain-of-thought blocks in chat are hidden by default. toggle from settings → display → hide thinking blocks.
- pipe activity indicators — running pipes now surface a live status indicator in the pipe list.
- rename speakers in the meeting transcript sidebar — click any speaker name in the transcript panel to rename, search similar speakers, and propagate the rename across the meeting.
- copy meeting transcript — new copy button in the meeting view copies the full transcript (not just the filtered view) as plain text.
- pick which pipe summarizes meetings — new picker next to “summarize with AI” lets you choose any installed or store pipe to drive meeting summaries.
- split and merge meetings — new
POST /meetings/:id/splitendpoint and a smarter merge that preserves titles, attendees, and notes from both sides. see the API docs. - back up your real-browser login state into the agent browser (macOS) — the agent’s embedded browser now inherits cookies from Arc, Chrome, Brave, and Edge, so authenticated sites (Twitter/X, Gmail, GitHub, your bank) work without a manual sign-in. each browser is opt-in via a one-time Keychain prompt.
- one-click browser extension pairing — pair the screenpipe browser extension in a single click from the desktop app.
- enterprise managed AI presets — admins can publish managed presets, lock the default, and gate custom presets per employee. see teams.
- Intune deployment guide — IT admins deploying screenpipe to Windows fleets via Microsoft Intune now have a canonical reference. see Intune deployment.
updates
- friendlier “sync now” error — the pipes-sync and memories-sync buttons in the account panel now disable while the engine is still starting, and surface a readable message instead of
Load failed (localhost:3030). - chat tool rail readability — agent actions like
curl -H "Authorization: Bearer ..."are now rendered as plain English (“Searched ChatGPT ‘q’”, “Saved memory”, “Navigated agent browser → calendar.google.com”) with the matching app icon. web tool calls also show the destination site’s favicon. - connection icons in chat tool rail — see at a glance which integration a tool call hit.
- secure team sharing setup from the desktop app — initialize encrypted team sharing without leaving the app. see teams.
- chat works while logged out — suggestion cards and a login button show up in unauthenticated chat sessions instead of an empty screen.
- chat shows suggestions when unauthenticated + the AI preset selector now surfaces a login button so there’s always a clear way in.
- mic capture is faster to recover on USB and Bluetooth devices — phantom audio interfaces (controller adapters, dock stubs, headset descriptors with nothing plugged in) are filtered out, so the device picker only shows mics that actually record. on Windows, format mismatches fall back to the system default format automatically.
- audio reliability under load — increased the write connection pool and improved reconciled-transcript playback so merged audio chunks stay in sync with the timeline.
- embedded browser stays inside the app — the agent browser no longer floats above unrelated apps and now follows the parent window for minimize, hide, and app switch.
- embedded browser performance — kills a 60 Hz polling loop that was driving WindowServer and the SCK audio daemon to 100 % CPU when the browser panel was open.
- embedded browser remembers where you left off — saved browser URLs now reliably restore on app launch.
- monitor recovery after disconnect — vision capture now retries automatically when a display is unplugged and reconnected.
- system audio toggle copy — clearer, shorter description of what “CoreAudio system audio” does and the Zoom/Meet/Teams trade-off.
- changelog is live — the in-app changelog dialog pulls the latest entries from screenpi.pe instead of a stale bundled file.
- AI gateway credits extend daily cost cap 1:1 — the 50 more headroom on Opus / Sonnet instead of getting blocked by the daily cost limit.
- lower idle RAM — local text-PII (~2.8 GB) and image-PII (~150–200 MB) models lazy-load and unload after 60 s idle, freeing several GB when the worker isn’t busy.
- explicit logs when AI PII removal is off — log lines now confirm the model isn’t loaded so you can verify the toggle worked.
- AirPods + Bluetooth health status —
/audio/device/statusnow reportsactive_no_datawhile a hijacked or silent device recovers, instead of misleadingly reportingok. - clamshell mode no longer captures the sleeping built-in display — the lid-closed laptop panel is filtered out of the capture list, saving cycles and black frames.
- meeting detection robustness — added re-entry hysteresis so single-frame UI blips (e.g. Google Meet’s auto-hiding toolbar in Arc) no longer flap the meeting state machine.
- clearer team invite error — server-emailed invite links don’t carry the team encryption key; the error now tells you to grab the full link from the admin’s desktop app.
bug fixes
- Windows audio capture — fully reverted the upstream cpal regression that caused Windows 11 24H2 users to record near-silent audio (-85 dB) on Jabra, Logi, and Communications-class USB mics. capture levels and transcription are restored.
- Windows owned browser — fixed WebView2 startup and loading failures on Windows.
- Windows ONNX runtime — corrected the bundled runtime version so the app launches cleanly.
- Windows ARM64 — release builds and signing pipeline restored.
- connection permission prompts — fixed permission prompts that previously failed to appear when connecting new integrations.
- connection details open in a dialog — selecting a connection no longer scrolls the settings page unexpectedly; details open in a modal instead.
- connection tooltip clipping — tooltips no longer get cut off inside the connection modal.
- Claude Desktop MSIX (Microsoft Store) support on Windows — MCP key injection now finds and patches the MSIX-installed Claude Desktop config.
- Apple Intelligence tile is now hidden on non-macOS platforms.
- Obsidian connection — vault auto-discovery and a cleaner connect/disconnect flow.
- connections cleanup — fixed disconnect reliability, missing icons, and stale state across the connections panel.
- chat preset switching in existing conversations — switching presets mid-conversation no longer drops your selection.
- chat editing preserves what’s on screen — editing a previous message no longer collapses the surrounding context.
- AI model picker — search clears when re-opening, and cancel/close behavior is fixed.
- pipes UX — fixed dropdown lag, the stuck loading skeleton, offline state copy, and missing feedback in pipe discover.
- discover-tab “new” badge on home page is hidden where it didn’t apply.
- speaker email alias deduplication — speakers with multiple aliases are no longer counted as duplicates.
- speaker merge from settings — the “yes, merge” button now actually merges instead of returning a 422.
- macOS clipboard crashes — NSPasteboard reads are now dispatched to the main thread, eliminating a class of EXC_BAD_ACCESS crashes during heavy clipboard activity.
- macOS cursor lag — disabled SCK’s cursor and click-ripple compositing, which was causing visible cursor lag during heavy interaction (Chrome tabs, dropdowns).
- macOS callback panics — wrapped ObjC→Rust callbacks (scroll, magnify, notification action, dock menu) in panic guards so transient errors no longer SIGABRT the app.
- pipe orphan PID cleanup no longer SIGTERMs the app itself — fixed a regression where saving settings could gracefully exit the app via the orphan-pipe cleanup path.
- settings loss on update is now impossible — four-layer defense (snapshot, auto-restore, refuse-overwrite, stop empty-writes) protects your AI presets and settings across updates.
- audio worker shutdown — clean shutdown signals stop the tokio teardown panics that were filling
last-panic.logon every quit. - audio stream stop use-after-free — fixed a macOS crash when stopping or switching audio devices.
- recording start race + health probe — concurrent capture-start invocations can no longer clobber each other, and a dead HTTP serve task after sleep/wake now triggers a real restart instead of an indefinite “connection error”.
- speaker model loading — resilient downloads with retries so flaky networks don’t leave you without speaker recognition.
- ORT initialization panics in the rfdetr image model and speaker init are now caught and surfaced as proper errors instead of crashing the worker.
new features
- Zoom integration — connect Zoom via OAuth so meetings show up alongside other connected apps. configure in settings → connections.
- Hermes Agent connection — drop screenpipe’s MCP server into your
~/.hermes/config.yamlfrom the connections panel. see MCP server. - Bee wearable — pair your Bee device as a connection so its captures join your screenpipe timeline. see connections.
- clipboard capture privacy toggle — turn off clipboard capture from settings or via a new CLI flag when you don’t want copied text recorded. see the CLI reference.
- focused document file paths — screenpipe now records the absolute path of the document you’re editing in TextEdit, Obsidian, Cursor, VS Code, Windsurf, VSCodium, and Trae, so you can search by filename.
- meeting notes timeline scrubber — meeting transcripts now have a scrubber with full transcript playback, speaker rename popover, and an “open in timeline” button. see meeting transcription.
- browser API:
/navigateand/snapshot— drive the embedded browser from your pipes and grab DOM snapshots. see the API docs. - MCP
update-meetingtool — let your AI write summaries back to a meeting note via a typed MCP tool. see MCP server. - manage AI presets from the CLI — create, update, delete, and set the default preset, plus pin a preset to a specific pipe. see the CLI reference.
updates
- meeting summarize button is now front-and-center in the meeting view, and the AI writes its summary back into the note for you.
- chat works without login — the b/w login banner is gone; you can chat on free models without an account.
- browser panel state persists per conversation — width and collapsed state are remembered when you switch chats.
- chat polish — queued messages are visually de-emphasised, the first thought block is collapsed by default, and a live dot pulses in the sidebar while the current chat is streaming.
- pipes list is faster — large stdout/stderr payloads no longer ship with every list request.
- “delete last N minutes” now actually removes the underlying mp4/wav files and drops cached frames.
bug fixes
- clipboard crash protection on macOS — added a watchdog around NSPasteboard reads so a hanging clipboard owner can no longer take down screenpipe.
- Claude Desktop MCP 403s — MCP API key discovery now uses the bundled bun, so auth works without a system bun on
PATH. - privacy scrubs — API keys and tokens are stripped from the feedback console-log bundle, the cloud JWT is hidden from bash subshells, and auth tokens + emails are no longer logged on the server.
- audio reliability — undecodable audio chunks are quarantined instead of retrying forever, and the audio reconciliation retry loop has been killed.
- chat fixes — removing
@inputworks again, new chats appear in the sidebar immediately, duplicate filters from dropdown buttons are deduped, the “writing…” indicator self-heals on session return, and chat history loss on Windows (sanitized filenames + atomic saves) is fixed. - settings — API key regenerate now respects cancel, apply, and manual edits.
- shortcuts — pressing esc or clicking outside cancels a recording capture.
- timeline — applied tag chips have a remove button, and empty-state arrow buttons navigate the right direction.
- meeting notes — sidebar can be expanded again during a focused meeting, broken frame images are fixed, and the scrubber no longer ends early.
- embedded browser — x.com loads again (Safari UA spoof).
- skill install — added the download permission and surfaces loading / saved / error states.
- offline mode actually blocks pipe network calls now (the half-baked toggle has been removed).
- Windows — fixed an a11y crash from the
GetWindowRectimport. - pi config —
pi confignow does a real merge instead of overwriting~/.pi/agent/models.json.
week of april 26, 2026
new features
- new integrations — connect Microsoft 365 and Teams, Google Docs, Google Sheets, QuickBooks Online, Bitrix24, Loops, Resend, Supabase, and the Pocket AI voice recorder. configure in settings → connections.
- PII privacy filter — opt-in filter (powered by a Tinfoil enclave) that redacts personal info from
/searchresults and chat messages before they leave your machine. toggle from the chat composer. learn more. - parallel chats with background streaming — start multiple chats and switch between them; responses keep streaming in the background. a new chat sidebar shows pinned chats, recents, and pipes scheduled to run.
- focus-aware capture — when enabled, screenpipe only records the focused monitor instead of all of them, halving capture cost on multi-display setups. toggle from settings.
- per-machine pipe favorites — star pipes you use most. starred pipes sort to the top of the pipe list and get their own filter chip.
- LAN-access toggle for the API — bind the local API to
0.0.0.0so other devices on your network can reach it. API auth is force-enabled when LAN access is on. see the API docs. screenpipe sync remote— back up your screenpipe data over SSH/SFTP to a server you control. see the CLI reference.screenpipe db {check, recover, cleanup, unlock}— new CLI commands to repair database corruption and reclaim disk space. see the CLI reference.screenpipe logout— sign out of your screenpipe cloud account from the CLI.- connected apps as @mentions in chat — type
@in the chat filter popover to scope a question to a specific connected integration. - AI quota warnings — heads-up notice when you’re close to your daily limit on weighted models, so you don’t get cut off mid-task.
- browser extension v0.2 — new popup with connection status, an options page, and token-based auth.
updates
- CoreAudio Process Tap is now the default for system audio on macOS 14.4 and later — better quality and no virtual driver required.
- API keys are now readable and regeneratable in the UI. user-set custom keys have been removed in favor of a single managed key.
- Cursor-style inline edit — click any of your past chat messages to edit and re-run it.
- redesigned sidebar — collapse button next to the macOS traffic lights, search opens a focused overlay window with a real keyboard shortcut, and starred pipes outrank running pipes in sort order.
- timeline calendar — empty days are now disabled in the day picker and skipped when navigating with arrow keys.
- chat models hot-swap — switching a preset’s model no longer restarts the chat subprocess.
bug fixes
- mic stays connected on sleep/wake — fixed false-positive disconnects.
- Microsoft 365 / Teams OAuth now uses the correct Azure client ID; personal Microsoft accounts are rejected up-front (Teams scope isn’t supported there).
- database reliability — multibyte string truncation no longer panics, and connection starvation under heavy writes has been resolved.
- diarization timeouts — added a
speaker_idindex that fixes 60s+ stalls on long meetings. - memories pipeline silently stopped updating — now back online.
- macOS memory leaks — wrapped clipboard capture, monitor enumeration, and focus-tracker callbacks in autorelease pools.
- search results — keyword flat mode no longer drops entries that lack text positions.
- OAuth flows — auto-refresh of expired tokens in the generic proxy, query params now forwarded through the connection proxy, broader Google Sheets scope, and a fix for tokens being dropped when reconnecting an instance.
- notifications — clicking “Open” on a native macOS notification now reliably brings the screenpipe window forward.
- onboarding — MCP install uses the bundled bun, so it works without a system bun on
PATH. WhatsApp connection now resolves bun the same way. - calendar permission — recovers when the macOS Privacy pane reports denied-but-empty.
- chat polish — drag-select restored in user messages, ”+ new chat” reuses an empty chat instead of spawning duplicates, “Try again” appears when a model returns an empty response, and free models are always allowed regardless of quota.
- Windows — restored ARM64 release builds, switched consumer release to SSL.com EV signing, and propagated system root CAs to bundled bun/node via
NODE_EXTRA_CA_CERTS.