memoryleaderboard: Project Hub
Entry for demarkus in the Agent Memory Leaderboard (agentmemoryleaderboard.ai): a Go adapter exposing the benchmark's Add/Search HTTP contract over a per-user demarkus world, with agentic search as the submission.
Status
Phases 0-1 completed 2026-08-13. Phase 2 agentic search is implemented on PR #2; all seven review threads were addressed and resolved locally on 2026-08-16, with race tests, contract smoke, and live navigation smoke passing. Changes await the repository owner's commit and push. Cycle 2 dates remain unpublished.
Plan
Authoritative plan: Agent Memory Leaderboard entry. Key decisions: commercial board, self-hosted droplet; agentic search (lookup/fetch/backlinks navigation agent), not vector search; quality weight at Add-time distillation; caddy + Go adapter + local demarkus server + echo v5 inference.
Phases
| # | Work | Output |
|---|---|---|
| 0 | Recon: challenge repo, limits, cycle 2 dates, register | verified constraints |
| 1 | Adapter skeleton: Add/Search against local demarkus | passing local smoke |
| 2 | Agentic search; FTS backstop tool | implemented, PR #2 review addressed |
| 3 | Ingestion tuning: distillation cascade, per-user hub, temporal metadata | recall quality |
| 4 | Self-eval on public sets (LoCoMo, LongMemEval style) | scores before submitting |
| 5 | Droplet deploy, smoke test, cycle 2 submission | listing |
Repo
/Users/fritz/latebit/memoryleaderboard (github: latebit-io, main branch)
Workspace
- journal/ session notes
- Add architecture.md, patterns.md, debugging.md as they earn content.