Add the agent scaffold, mobile web UI, voice auto-leave, and text notifications

This commit is contained in:
Fisto
2026-09-14 16:38:14 +02:00
parent c7aad7547f
commit eab94132bb
27 changed files with 1521 additions and 73 deletions
+9 -3
View File
@@ -7,13 +7,15 @@ real Vesktop client, so the traffic comes from the official client.
## Parts
The system has five parts:
The system has six parts:
1. **Vesktop core** — the real Vesktop client. It runs headless. It exposes a small capability layer.
2. **Core bridge** — the capability layer. It accepts validated actions and pushes events.
3. **Veskslop daemon** — the external process. It holds all logic. It exposes MCP.
4. **Web UI** — a small browser control surface served by the daemon. See [webui.md](webui.md).
5. **MCP clients** — agents and tools. They call the daemon.
5. **Veskslop agent** — the optional local Go harness. It runs an LLM tool loop against a remote
`llama.cpp` and the daemon's MCP tools. See [agent.md](agent.md).
6. **MCP clients** — remote agents and tools. They call the daemon.
```
MCP clients (agents) Web browser (owner)
@@ -62,7 +64,11 @@ when the action list changes.
| Web UI and JSON API | `poc/src/webui.ts`, `poc/public/` | Nocturne 7a debug shell + roadmap placeholders |
| User search | `src/renderer/puppet/actions.ts` (`user.search`) | Implemented |
| Voice state reads | `src/renderer/puppet/actions.ts`, `src/renderer/puppet/events.ts` | Implemented |
| Voice actions, audio, video | Not started | Not started |
| Voice actions | `src/renderer/puppet/actions.ts`, `poc/src/puppet.ts` | Implemented, mock-verified |
| Voice audio (TTS, capture, STT) | `poc/src/audio*.ts`, `poc/src/tts.ts`, `poc/src/capture.ts`, `poc/src/stt.ts` | Implemented, verified live |
| Voice video | — | Not started |
| Local agent harness | `agent/` | Scaffold implemented and smoke-tested. Daemon push pending. |
| Mobile web UI | `poc/public/` | First draft at 390px with four tabs |
## Data flow