memoryleaderboard: Project Hub
Entry for demarkus in the Agent Memory Leaderboard (agentmemoryleaderboard.ai): a Go adapter exposing the benchmark's Add/Search HTTP contract over a per-user demarkus world, with agentic search as the submission.
Status
Phases 0-2 completed. PR #2, agentic search via the nib navigation agent, merged to main on 2026-08-16 as 4a37113. Two review passes were addressed with all threads resolved, Go 1.26.6, and race tests, static analysis, cross-compilation, contract smoke, and live navigation smoke passing. Next: phase 3 ingestion tuning. Cycle 2 dates remain unpublished.
Plan
Authoritative plan: Agent Memory Leaderboard entry. Key decisions: commercial board, self-hosted droplet; agentic search (lookup/fetch/backlinks navigation agent), not vector search; quality weight at Add-time distillation; caddy + Go adapter + local demarkus server + echo v5 inference.
Phases
| # | Work | Output |
|---|---|---|
| 0 | Recon: challenge repo, limits, cycle 2 dates, register | verified constraints |
| 1 | Adapter skeleton: Add/Search against local demarkus | passing local smoke |
| 2 | Agentic search; FTS backstop tool | merged via PR #2 |
| 3 | Ingestion tuning: distillation cascade, per-user hub, temporal metadata | recall quality |
| 4 | Self-eval on public sets (LoCoMo, LongMemEval style) | scores before submitting |
| 5 | Droplet deploy, smoke test, cycle 2 submission | listing |
Repo
/Users/fritz/latebit/memoryleaderboard (github: latebit-io, main branch)
Workspace
- journal/ session notes
- Add architecture.md, patterns.md, debugging.md as they earn content.