Update docs and README for voice audio, capture, and the web UI

This commit is contained in:
Fisto
2026-09-14 11:19:11 +02:00
parent c003d9532f
commit c7aad7547f
10 changed files with 356 additions and 66 deletions
+10 -8
View File
@@ -59,11 +59,14 @@ before you stop.
| Response policy (channel or DM) | Implemented |
| Chat commands (`whitelist`) | Implemented. `poll` is paused. |
| Persistent action log | Implemented |
| Web UI and JSON API | Nocturne 7a debug shell + roadmap placeholders. No auth; LAN or Tailscale only. |
| Web UI and JSON API | Nocturne 7a debug shell + roadmap placeholders. Server-side prefs. No auth; LAN or Tailscale only. |
| Core process control and web QR login | Implemented. Core start/stop verified live. |
| User search (cache and guild members) | Implemented |
| Voice state read and `VOICE_STATE_UPDATE` events | Implemented |
| Voice actions, audio, video | Not started. Plan in [docs/voice.md](docs/voice.md). |
| Voice actions (`voice.join`, `voice.leave`, `voice.move`) | Implemented. Auto-leave and `stay @user` pending. |
| Voice audio (TTS, virtual mic, ducking, browser monitor) | Implemented. Microphone puppeting pending. |
| Audio capture and transcript (VAD, WAV, STT hook, live events) | Implemented. STT provider not chosen. |
| Voice video | Not started. Plan in [docs/voice.md](docs/voice.md). |
| Notification parsing | Not started |
| Auth persistence in the core | Implemented and verified live |
| CDP transport | Kept as a development fallback |
@@ -72,12 +75,11 @@ before you stop.
See [CURRENT.md](CURRENT.md) and [TODO.md](TODO.md) for the live list. The main items are:
1. Voice backend behind the Web UI Join/Leave buttons.
2. Voice: `voice.join`, `voice.leave`, `voice.move`, auto-leave, and the `stay @user` command.
3. Notification parsing: edits, deletes, reactions, and replies.
4. Reply-to-puppet as a trigger.
5. Per-user rate limit and command cooldowns.
6. Collector account with read-only voice membership.
1. Voice auto-leave and the `stay @user` command, then live-verify join/leave and audio.
2. Notification parsing: edits, deletes, reactions, and replies.
3. Reply-to-puppet as a trigger.
4. Per-user rate limit and command cooldowns.
5. Collector account with read-only voice membership.
Paused: the `poll` command and the setup command flow. Parked: MCP event delivery and the LLM
attachment. Open decisions wait in [CURRENT.md](CURRENT.md) → Open discussions.