Peekaboo Visual Feedback System
#Overview
The Peekaboo Visual Feedback System provides delightful, informative visual indicators for all agent actions. When the Peekaboo.app is running, CLI and MCP operations automatically get enhanced with animations and visual cues that help users understand what the agent is doing.
#Architecture
#Core Design
- Integration: Built directly into Peekaboo.app
- Communication: Distributed notifications (
boo.peekaboo.visualizer.event) + shared JSON envelopes written byVisualizationClient - Storage: Events live in
~/Library/Application Support/PeekabooShared/VisualizerEvents(override withPEEKABOO_VISUALIZER_STORAGE) - Fallback: CLI/MCP work normally without visual feedback if the app isn't running (events are simply dropped)
- Performance: GPU-accelerated SwiftUI animations with minimal overhead
#Communication Internals
- Event creation (CLI/MCP side)
VisualizationClientbuilds a strongly typedVisualizerEvent.Payload(e.g., screenshot flash, click ripple).- The payload is persisted via
VisualizerEventStore.persist(_:), which writes<uuid>.jsonto the shared VisualizerEvents directory and logs the exact path (look for[VisualizerEventStore][VisualizerSmoke] persisted event …in CLI output when debugging). - Immediately afterwards the client posts
DistributedNotificationCenter.default().post(name: .visualizerEventDispatched, object: "<uuid>|<kind>"). NouserInfodata is used so the bridge remains sandbox friendly.
- Notification delivery
- Any listener (Peekaboo.app, smoke harnesses, or debugging scripts) can subscribe to
boo.peekaboo.visualizer.event. - If Peekaboo.app isn’t running, the distributed notification goes nowhere and the JSON simply ages out (cleanup removes stale files after ~10 minutes).
- Mac app reception
VisualizerEventReceiverruns inside Peekaboo.app. It logs registration at launch (Visualizer event receiver registered …), listens for the distributed notification, parses the<uuid>|<kind>descriptor, and loads the referenced JSON viaVisualizerEventStore.loadEvent(id:).- After successfully handing the payload off to
VisualizerCoordinator, the receiver deletes the JSON (failed deletes are surfaced asVisualizerEventReceiver: failed to delete event …in the logs). - Cleanup safeguards: the CLI schedules periodic
VisualizerEventStore.cleanup(olderThan:)calls so abandoned files disappear. For debugging you can setPEEKABOO_VISUALIZER_DISABLE_CLEANUP=trueto keep files on disk until the mac app consumes them.
#Communication Flow
MCP Server → peekaboo CLI → VisualizerEventStore → Distributed Notification → Peekaboo.app → Visual Feedback
↓
(no app running)
↓
Event file cleaned, CLI logs warning
#Components & Responsibilities
| Component | Location | Role |
|---|---|---|
VisualizationClient | Core/PeekabooVisualizer/Sources/PeekabooVisualizer/Visualizer/VisualizationClient.swift | Runs inside CLI/MCP processes, serializes payloads, persists them, and posts distributed notifications containing the event descriptor. |
VisualizerEventStore | Core/PeekabooVisualizer/Sources/PeekabooVisualizer/Visualizer/VisualizerEventStore.swift | Owns the shared storage directory, defines the VisualizerEvent schema, and exposes helpers to persist, load, and clean up JSON envelopes. |
VisualizerEventReceiver | Core/PeekabooVisualizer/Sources/PeekabooVisualizer/Renderer/VisualizerEventReceiver.swift | Hosted by Peekaboo.app, listens for boo.peekaboo.visualizer.event, loads the referenced JSON, and forwards it to VisualizerCoordinator. |
VisualizerCoordinator | Core/PeekabooVisualizer/Sources/PeekabooVisualizer/Renderer/VisualizerCoordinator.swift | Renders SwiftUI overlays (reticles, HUD chips, comets, annotations) and honors user settings such as animation speed and per-action toggles. |
VisualizerDesign | Core/PeekabooVisualizer/Sources/PeekabooVisualizer/Views/VisualizerDesign.swift | The shared "Ghost HUD" design language: theme tokens, motion curves, HUD chip container, keycaps, and glyph badges every animation composes from. |
#Smoke Testing
- Run
peekaboo visualizer(new CLI command) to fire every animation in sequence. This is the fastest way to confirm Peekaboo.app is rendering flashes, HUDs, window/app/menu highlights, dialog overlays, and the element-detection visuals. Use it before releases or whenever you tweak visualizer code. - Still keep the manual Visualizer Test view handy for ad-hoc previews or stress tests; the smoke command is intentionally short and non-interactive.
#Transport Storage & Format
- Directory:
~/Library/Application Support/PeekabooShared/VisualizerEvents. Override withPEEKABOO_VISUALIZER_STORAGE=/custom/path. When sandboxing the app, setPEEKABOO_VISUALIZER_APP_GROUP=com.example.groupso the store lives inside the App Group container. - File name:
<UUID>.json. Each payload is written atomically so the receiver never reads partial data. - Schema:
VisualizerEventencodes{ id, createdAt, payload }. Payload is aCodableenum covering every animation type; anyData(screenshots, thumbnails) is base64-encoded byJSONEncoder. - Lifetime: Clients schedule
VisualizerEventStore.cleanup(olderThan:)sweeps so abandoned files disappear after roughly 10 minutes. For deep debugging,PEEKABOO_VISUALIZER_DISABLE_CLEANUP=truekeeps envelopes on disk until manually removed.
#Environment Flags
PEEKABOO_VISUAL_FEEDBACK=false– disable the client entirely (no files, no notifications).PEEKABOO_VISUAL_SCREENSHOTS=false– skip screenshot flash events but allow the rest.PEEKABOO_VISUALIZER_MASK_TYPED_TEXT=true– always mask typed characters as bullets. By default the typing HUD shows the text verbatim (that's the point of the caption); secure text fields are detected and masked automatically before the event is persisted.PEEKABOO_VISUALIZER_STDOUT=true|false– force VisualizationClient logs to stderr regardless of bundle context.PEEKABOO_VISUALIZER_STORAGE=/path– override the shared directory.PEEKABOO_VISUALIZER_APP_GROUP=<group>– resolve storage inside an App Group container.PEEKABOO_VISUALIZER_FORCE_APP=true– force “mac-app context” so headless harnesses (e.g., VisualizerSmoke) can emit events without launching Peekaboo.app.PEEKABOO_VISUALIZER_DISABLE_CLEANUP=true– keep envelopes on disk for forensic analysis.
Peekaboo.app still respects user-facing toggles via PeekabooSettings; the coordinator checks those before animating.
#Logging & Diagnostics
- CLI / services:
VisualizationClientlogs to theboo.peekaboo.coresubsystem. Tail with./scripts/visualizer-logs.sh --stream(run inside tmux per AGENTS.md) to watch dispatch attempts and cleanup activity. - Mac app:
VisualizerEventReceiverandVisualizerCoordinatorlog underboo.peekaboo.mac. Look for “Visualizer event receiver registered…” followed by “Processing visualizer event …”. - File inspection:
ls ~/Library/Application\\ Support/PeekabooShared/VisualizerEventsshows outstanding events. A growing list means the mac app hasn’t consumed them (maybe it isn’t running or failed to decode the JSON). - Manual cleanup: When you need a clean slate, run
rm ~/Library/Application\\ Support/PeekabooShared/VisualizerEvents/*.json; both sides recreate the folder automatically. - Smoke harness: The
VisualizerSmokehelper (used in CI) forcesPEEKABOO_VISUALIZER_FORCE_APP=true, emits known payloads, and asserts that the JSON lands in the shared directory—handy when debugging the transport without the full CLI.
#Failure Modes & Fixes
| Symptom | Likely Cause | How to Fix |
|---|---|---|
| CLI debug logs “Peekaboo.app is not running…” and visuals stop | UI isn’t launched (intended best-effort behavior) | Start Peekaboo.app or its login item; visuals resume automatically. |
| JSON files accumulate but the app never animates | App missing permissions or VisualizerEventReceiver never started | Relaunch the app, grant Screen Recording/Accessibility, and confirm logs show receiver registration. |
VisualizerEventStore throws file I/O errors | Shared directory missing or unwritable | Make sure the parent path exists and is writable, or set PEEKABOO_VISUALIZER_STORAGE to a directory with proper permissions. |
| Annotated screenshot payload fails to decode | File deleted before the app could read it (cleanup ran too soon) | Disable cleanup temporarily with PEEKABOO_VISUALIZER_DISABLE_CLEANUP=true or increase the cleanup interval while debugging. |
CLI debug logs mention DistributedNotificationCenter sandbox issues | Sender is sandboxed and tried to include userInfo | Keep using the <uuid>|<kind> object format and load payloads from disk; never rely on userInfo. |
#Smoke Test Checklist
- Launch the UI – Ensure Peekaboo.app is running (rebuild with
./scripts/build-mac-debug.shafter changes). Confirm the log lineVisualizer event receiver registered. - Trigger an event – Run a CLI command that emits visuals, e.g.
peekaboo see --mode screen --annotate --path /tmp/peekaboo-see.png. - Watch logs – In tmux, run
./scripts/visualizer-logs.sh --last 30s --followto confirm both the client and receiver log the same event ID. - Inspect storage – Check the shared directory; files should appear momentarily and disappear after the mac app consumes them. A lingering file means the receiver failed to delete it (inspect logs for the error).
- Negative test – Quit Peekaboo.app and rerun the CLI command. With
--verboseor higher logging, the client should emit a single “Peekaboo.app is not running” debug line and skip event creation until the UI returns. - Optional overrides – Set
PEEKABOO_VISUALIZER_FORCE_APP=trueand re-run inside a headless harness to confirm the transport still works without the UI present (the files remain until you delete them).
#Visual Feedback Designs — the "Ghost HUD" language
All animations share one design system (VisualizerDesign.swift): a single violet accent (VisualizerTheme.accent, cyan secondary for gradients, red strictly for destructive operations), dark translucent HUD chips with hairline strokes, and a common motion vocabulary (VisualizerMotion.pop/settle/enter/exit/glide). Geometry over cartoons: reticles, comets, chevrons, and keycaps — no particle bursts, no clip-art cursors, no rainbow per-action colors.
#Screenshot Capture 📸
- Effect: Viewfinder corner brackets snap onto the captured region while a white veil flashes once
- Intensity: Veil peaks at 18% opacity scaled by the user's effect-intensity setting
- Coverage: Only the captured area, not the full screen
- Easter egg: Every 100th screenshot floats a 👻 up through the frame
#Click Actions 🎯
- Single Click: A targeting ring contracts onto the point, the center dot pops with a glow bloom, and one impact pulse expands
- Double Click: Two staggered impact pulses
- Right Click: Dashed contracting ring in the secondary accent, hinting at a context menu
- No labels: The geometry communicates the action; there is no "Click" text
#Typing Feedback ⌨️
- Style: A caption pill at bottom center streams the typed text verbatim with a blinking caret
- Privacy: Typing into a secure text field (
AXSecureTextField) masks the caption as bullets before the event is persisted or shown. Detection samples the actual delivery focus immediately before every non-empty text segment, so focus-changing sequences such as Tab → password → Return cannot expose the middle segment; background typing scopes the sample to its target process, andPEEKABOO_VISUALIZER_MASK_TYPED_TEXT=truemasks everything for privacy-sensitive setups - Special Keys: Rendered inline as accent glyphs (⏎, ⇥, ⌫, ⎋)
- Cadence: Reveal speed derives from the incoming
TypingCadence(human WPM or fixed delay) - Coalescing: Consecutive type commands crossfade through a single caption slot instead of stacking pills
#Scrolling 📜
- Effect: A compact circular chip at the scroll point with three chevrons flowing along the scroll direction
- Extra: A small "×N" tag beneath the chip when scrolling more than one unit
#Mouse Movement 🖱️
- Effect: A glowing comet head glides from start to destination, stretching a tapered gradient tail
- Landing: A small ring blooms at the destination as the head arrives
#Swipe/Drag Gestures 👆
- Effect: The same comet vocabulary with a thicker stroke (button held)
- Endpoints: A press ring marks touch-down; a release ring plus a direction chevron marks touch-up
#Hotkeys ⌨️
- Style: macOS-style keycaps (symbol plus caption, e.g. ⌘ command) in a HUD chip at screen center
- Effect: Keys press down in sequence with an accent highlight, hold the chord, then release together
#App Launch / Quit 🚀
- Style: A HUD toast with the app icon, name, and a status line ("Launching" / "Quitting") with a colored status dot
- Launch: Icon springs in with a one-shot glow sweep (green status dot)
- Quit: Icon desaturates and sinks while the toast slips away (red status dot)
#Window Operations 🪟
- Style: The window outline plus a glyph badge naming the operation; accent color, red only for close
- Close: Outline contracts and fades. Minimize: outline squashes toward the bottom. Maximize/Focus: outline expands with a glow pulse. Move: outline lifts and settles. Resize/SetBounds: corner brackets pulse inward
#Menu Navigation 📋
- Effect: The menu path renders as a breadcrumb chip ("File ▸ New ▸ Project"); segments illuminate in traversal order
- States: Active segment gets an accent fill, visited segments stay bright, pending segments dim
#Dialog Interactions 💬
- Effect: The target element gets an accent outline with a glyph badge naming the action
- Text entry: A blinking caret at the field's leading edge; click actions pulse once
#Space Switching 🚪
- Effect: A macOS-style Spaces indicator chip: one dot per desktop, the active dot hops to the destination, and a "Desktop N" label updates with a direction arrow
#Element Detection (See) 👁️
- Effect: Every detected element gets an accent outline sized exactly to the control, with its opaque ID in a small HUD tag above
- Coordinates: Element rects in the payload are AppKit screen coordinates. Senders convert global Accessibility bounds through
VisualizerScreenGeometry, flipping once againstNSScreen.screens[0](the primary display); logical point sizes are preserved, so Retina scale is never multiplied into overlay geometry - Rendering: One overlay window per screen holds every highlight (
ElementOverlaySheetView); degenerate and screen-filling container rects are dropped and the count is capped at 120, preferring the smallest rects - Animation: Pop in with slight scale, fade out at the end; a refreshed detection retires every prior per-screen sheet before drawing the new set, including screens that now have no elements
- Duration: 2 seconds (scaled) before fade
#Verbosity: throttles and replace slots
Agents fire actions in bursts, so the coordinator coalesces:
- Throttles (
VisualizerCoordinator.FeedbackThrottle): screenshot flash ≥ 1.2s apart, scroll chips ≥ 0.3s, mouse comets ≥ 0.4s and only for moves ≥ 80pt, element sheets ≥ 1.0s, watch HUD ≥ 1.0s. Throttled events report success without drawing. - Replace slots (
VisualizerCoordinator.OverlaySlot): typing caption, hotkey chip, menu breadcrumb, Space indicator, app toast, watch HUD, annotated screenshot, and per-screen element sheets each keep at most one live overlay — a new event fades the previous one out in 0.12s and takes its place.
#Implementation Details
#Notification Bridge
VisualizationClientencodes strongly typedVisualizerEvent.Payloadvalues (screenshot flash, click feedback, annotated screenshot, etc.) and writes each event to<UUID>.jsoninside the shared VisualizerEvents directory.- After persisting the payload, the client posts
DistributedNotificationCenter.default().post(name: .visualizerEventDispatched, object: "<uuid>|<kind>"). NouserInfois attached so the API remains sandbox-safe. VisualizerEventReceiver(in Peekaboo.app) listens for that notification name, loads the referenced JSON viaVisualizerEventStore.loadEvent(id:), calls the appropriate method onVisualizerCoordinator, and then deletes the file. If the app isn’t running, nothing consumes the event—exactly the desired “best effort” semantics.- Both sides periodically call
VisualizerEventStore.cleanup(olderThan:)so abandoned files (e.g., when the app never launched) are removed automatically.
#Storage Layout
- Directory:
~/Library/Application Support/PeekabooShared/VisualizerEvents - Overrides:
PEEKABOO_VISUALIZER_STORAGE=/custom/path– force a different directory (great for tests)PEEKABOO_VISUALIZER_APP_GROUP=com.example.group– resolve the store inside an App Group container- Format: JSON with ISO8601 timestamps, base64
Datablobs, and strongly typed enums (ClickType,ScrollDirection,WindowOperation, etc.)
#SwiftUI Animation Components
Located in Core/PeekabooVisualizer/Sources/PeekabooVisualizer/Views/:
VisualizerDesign.swift- Shared theme, motion curves, HUD chip, keycap, corner brackets, glyph badgeScreenshotFlashView.swift- Viewfinder brackets + shutter veilClickAnimationView.swift- Targeting reticle with impact pulsesTypeAnimationView.swift- Streaming caption pillScrollAnimationView.swift- Flowing chevron chipMouseTrailView.swift/SwipePathView.swift- Comet trails (window-local coordinates)HotkeyOverlayView.swift- Keycap chord display- ... (one file per animation type)
Overlay invariants worth knowing when adding animations:
- Automation, Accessibility, Core Graphics, and capture geometry enters the visualizer in global display coordinates with an upper-left primary-display origin.
VisualizerAutomationFeedbackClientandSeeToolconvert it exactly once throughVisualizerScreenGeometry; everything downstream uses global AppKit coordinates with a lower-left origin. Both spaces use logical points. - The flip axis is the primary/menu-bar display (
NSScreen.screens[0]), notNSScreen.main, which follows keyboard focus and can change during automation. AnimationOverlayManagerwraps every animation in a flexible container so fixed-size views center on the overlay window; without it they pin to the top-leading corner and misalign by the window padding.- Every overlay window is inflated by a 40pt chrome margin so chip shadows and glows fade out instead of clipping at the window edge. Views that fill the window and use window-local coordinates (comets, capture flash, element sheets) pass
chromeMargin: 0and provide their own breathing room. - Point-based views (mouse trail, swipe) receive window-local SwiftUI coordinates.
VisualizerCoordinator.windowLocalPoint(_:in:)/windowLocalRect(_:in:)convert AppKit screen geometry (bottom-left origin) into flipped view coordinates. - Overlays that should never stack pass a
replaceKey; the manager crossfades the previous window of the same key.
#Integration Points
- Agent Tools: Each tool in
UIAutomationTools.swiftcalls visualizer - Overlay Manager: Extended to handle animation layers
- Window Management: Reuses existing overlay window system
- Performance: Animations auto-cleanup after completion
#Configuration
#Environment Variables
PEEKABOO_VISUAL_FEEDBACK=false # Disable all visual feedback
PEEKABOO_VISUAL_SCREENSHOTS=false # Disable just screenshot flash
PEEKABOO_VISUALIZER_STDOUT=true # Force VisualizationClient logs to stderr/stdout
PEEKABOO_VISUALIZER_STORAGE=/tmp/events # Override the shared events directory
PEEKABOO_VISUALIZER_APP_GROUP=group.boo # Resolve storage inside an App Group container
PEEKABOO_VISUALIZER_DISABLE_CLEANUP=true # Keep JSON envelopes for forensic debugging (off by default)
PEEKABOO_VISUALIZER_FORCE_APP=true # Pretend the CLI is running inside the mac app bundle (forces in-app behavior)
#Debugging Tips
- Verify storage alignment: the CLI and Peekaboo.app must point to the same
VisualizerEventsdirectory. When testing, setPEEKABOO_VISUALIZER_STORAGE=/tmp/viseventsfor both processes so the mac app can load the JSON the CLI just wrote. - Disable cleanup temporarily:
PEEKABOO_VISUALIZER_DISABLE_CLEANUP=truekeeps envelopes on disk until you inspect or replay them. Handy when the UI isn’t consuming events yet. - Listen to notifications: A tiny Swift script that subscribes to
boo.peekaboo.visualizer.eventprints descriptors (<uuid>|<kind>) and proves the distributed notification is firing. - Inspect payloads: Every persisted file logs its path (
[VisualizerEventStore][process] persisted event …). Usecat/jqto view the JSON and even re-post it viaDistributedNotificationCenter. - Mac-side breadcrumbs:
VisualizerEventReceiverlogs when it registers, receives a descriptor, executes, and deletes the event. Tail with - Replay events: If a notification failed, re-trigger it with
- Watch cleanup:
VisualizerEventStore.cleanupdeletes envelopes older than ~10 minutes. Disable it (env var above) or inspect files quickly before they disappear.
log stream --style compact --predicate 'process == "Peekaboo" && (composedMessage CONTAINS "Visualizer" || subsystem == "boo.peekaboo.mac")'.
swift -e 'DistributedNotificationCenter.default().post(name: Notification.Name("boo.peekaboo.visualizer.event"), object: "UUID|screenshotFlash")'.
#User Preferences (in Peekaboo.app)
- Toggle visual feedback on/off
- Adjust animation speed
- Control effect intensity
- Per-action toggles
#Fun Details 🎉
#Screenshot Flash
- Easter Egg: Every 100th screenshot shows a tiny 👻 ghost in the flash
- Sound: Optional subtle camera shutter sound
- Customization: Users can adjust flash intensity
#Click Animations
- Variety: Ring shape distinguishes the click type — solid for left, dashed for right, double pulse for double-click
- Precision: The reticle contracts onto the exact click point, so recordings read like a targeting lock
#Typing Caption
- Content over chrome: Shows the actual text being typed rather than a fake keyboard
- Cadence-aware: Uses the incoming
TypingCadenceto pace the character stream (human WPM or fixed delay).
#App Launch
- Personality: Each app can have custom launch animation
- Sounds: Optional playful sound effects
- Progress: Show actual launch progress if available
#Performance Considerations
- Lazy Loading: Animations load on-demand
- GPU Acceleration: All animations use Metal
- Memory Management: Views removed after animation
- Battery Friendly: Reduced effects on battery power
- Accessibility: Respects "Reduce Motion" setting
#Security & Privacy
- No Screenshots: Visual feedback doesn't capture screen content
- Local Only: No data leaves the machine
- Permission Reuse: Uses Peekaboo.app's existing permissions
- Sandboxed: Runs within app sandbox
#Future Enhancements
- Themes: User-created visual themes
- Sounds: Optional sound effects
- Recording: Save visual feedback as video
- Sharing: Export automation demos with visuals
- AI Feedback: Show agent's "thinking" visually
#Summary
The visual feedback system transforms Peekaboo agent operations from invisible automation into an engaging, understandable experience. By showing users exactly what the agent sees and does, we build trust and make automation accessible to everyone.
The playful touches (like the screenshot flash) add personality while remaining professional and non-intrusive. The system is designed to delight power users while helping newcomers understand automation.
Most importantly, it's completely optional - the CLI and MCP continue to work perfectly without it, making visual feedback a progressive enhancement rather than a requirement.
#Implementation Checklist
#Phase 1: Foundation (Notification Bridge)
#Event Store & Transport
- [x] Create
VisualizerEventStore.swiftin PeekabooCore - [x] Persist events as JSON (with base64
Data) inside~/Library/Application Support/PeekabooShared/VisualizerEvents - [x] Provide cleanup helpers and environment overrides (
PEEKABOO_VISUALIZER_STORAGE,PEEKABOO_VISUALIZER_APP_GROUP)
#Client Dispatch
- [x] Update
VisualizationClientto emitVisualizerEvent.Payloadvalues instead of XPC RPCs - [x] Post distributed notifications (
boo.peekaboo.visualizer.event) containing<uuid>|<kind> - [x] Respect
PEEKABOO_VISUAL_FEEDBACK,PEEKABOO_VISUAL_SCREENSHOTS, andPEEKABOO_VISUALIZER_STDOUT
#App Receiver
- [x] Add
VisualizerEventReceiverinside Peekaboo.app - [x] Load events via
VisualizerEventStore, forward toVisualizerCoordinator, then delete consumed files - [x] Periodically clean stale events so the shared directory stays small
#Overlay Window Enhancement
- [ ] Extend
OverlayManager.swift - [ ] Add animation layer management
- [ ] Create animation queue system
- [ ] Add cleanup timers for animations
- [ ] Support multiple concurrent animations
- [ ] Create
VisualizerOverlayWindow.swift - [ ] Configure for animation display
- [ ] Set proper window level
- [ ] Handle multi-screen setups
- [ ] Add debug mode for testing
#Phase 2–4: Animation Components (shipped as the Ghost HUD redesign)
All per-action views exist in Core/PeekabooVisualizer/Sources/PeekabooVisualizer/Views/ and compose the shared design system in VisualizerDesign.swift:
- [x]
ScreenshotFlashView— viewfinder brackets, shutter veil, 👻 easter egg (every 100th) - [x]
ClickAnimationView— targeting reticle; solid/dashed/double-pulse per click type - [x]
TypeAnimationView— streaming caption pill with cadence-derived pacing - [x]
ScrollAnimationView— flowing chevron chip with amount tag - [x]
MouseTrailView— comet trail with landing ring (window-local coordinates) - [x]
SwipePathView— drag comet with press/release rings - [x]
HotkeyOverlayView— keycap chord with sequenced presses - [x]
AppLifecycleView— launch/quit toast with status dot - [x]
WindowOperationView— outline motion per operation, corner brackets for resize - [x]
MenuNavigationView— breadcrumb with sequential illumination - [x]
DialogInteractionView— element outline, glyph badge, caret for text entry - [x]
SpaceTransitionView— Spaces dot indicator with hopping active dot
#Phase 5: Integration
#Tool Integration
- [ ] Update
UIAutomationTools.swift - [ ] Add visualizer calls to click tool
- [ ] Add visualizer calls to type tool
- [ ] Add visualizer calls to scroll tool
- [ ] Add visualizer calls to swipe tool
- [ ] Update
VisionTools.swift - [ ] Add screenshot flash to see command
- [ ] Add element highlight animations
- [ ] Update
ApplicationTools.swift - [ ] Add app launch/quit animations
- [ ] Update
WindowManagementTools.swift - [ ] Add window operation animations
- [ ] Update
MenuTools.swift - [ ] Add menu navigation highlights
- [ ] Update
DialogTools.swift - [ ] Add dialog interaction feedback
#Configuration System
- [ ] Add environment variable support
- [x]
PEEKABOO_VISUAL_FEEDBACK - [x]
PEEKABOO_VISUAL_SCREENSHOTS - [x]
PEEKABOO_VISUALIZER_STDOUT - [x]
PEEKABOO_VISUALIZER_STORAGE - [x]
PEEKABOO_VISUALIZER_APP_GROUP - [ ] Per-action toggles
- [ ] Add app preferences UI
- [ ] Master on/off toggle
- [ ] Animation speed slider
- [ ] Effect intensity controls
- [ ] Per-action checkboxes
#Phase 6: Performance & Polish
#Optimization
- [ ] Profile animation performance
- [ ] GPU usage monitoring
- [ ] Memory leak detection
- [ ] Frame rate analysis
- [ ] Implement animation pooling
- [ ] Add battery-saving mode
- [ ] Respect "Reduce Motion" setting
#Testing
- [ ] Integration tests for the distributed event bridge
- [ ] Animation timing tests
- [ ] Multi-screen testing
- [ ] Performance benchmarks
- [ ] Accessibility testing
#Documentation
- [ ] API documentation for
VisualizerEventschema - [ ] Animation customization guide
- [ ] Troubleshooting guide
- [ ] Video demos of all animations
#Phase 7: Fun Features
#Easter Eggs
- [x] Screenshot ghost emoji (every 100th)
- [ ] Special animations for specific apps
- [ ] Achievement system
#Sound Effects (Optional)
- [ ] Camera shutter for screenshots
- [ ] Click sounds
- [ ] Typing sounds
- [ ] Success/failure sounds
#Advanced Features
- [ ] Animation recording system
- [ ] Custom theme editor
- [ ] Animation export for demos
- [ ] AI "thinking" visualization
#Phase 8: Release
#Final Testing
- [ ] Full integration test suite
- [ ] Beta testing with users
- [ ] Performance validation
- [ ] Security review
#Documentation
- [ ] Update README.md
- [ ] Create tutorial videos
- [ ] Write blog post
- [ ] Update website
#Distribution
- [ ] Ensure visualizer works with MCP
- [ ] Test npm package integration
- [ ] Verify CLI fallback behavior
- [ ] Release notes
#Success Criteria
- [ ] All agent actions have visual feedback
- [ ] Zero performance impact when disabled
- [ ] < 5% CPU usage during animations
- [ ] Works on all macOS versions (15.0+)
- [ ] Graceful fallback without Peekaboo.app
- [ ] Delightful user experience
- [ ] Professional appearance
- [ ] Fun but not distracting