memoryleaderboard: Project Hub
Entry for demarkus in the Agent Memory Leaderboard (agentmemoryleaderboard.ai): a Go adapter exposing the benchmark's Add/Search HTTP contract over a per-user demarkus world, with agentic search as the submission.
Status
Bootstrapped 2026-08-13. Phases 0-1 done same day: recon verified (Search concurrency 16-256, top_k 100, retries 408/425/429/5xx, agentic retrieval legal, cycle 2 dates unpublished) and the Go adapter skeleton passes contract tests plus a 5-assertion local smoke against an ephemeral demarkus-server. Next: phase 2 agentic search, blocked on echo v5 inference credentials; cycle 2 registration blocked on user contact details.
Plan
Authoritative plan: Agent Memory Leaderboard entry. Key decisions: commercial board, self-hosted droplet; agentic search (lookup/fetch/backlinks navigation agent), not vector search; quality weight at Add-time distillation; caddy + Go adapter + local demarkus server + echo v5 inference.
Phases
| # | Work | Output |
|---|---|---|
| 0 | Recon: challenge repo, limits, cycle 2 dates, register | verified constraints |
| 1 | Adapter skeleton: Add/Search against local demarkus | passing local smoke |
| 2 | Agentic search; FTS backstop tool | ranked top-k |
| 3 | Ingestion tuning: distillation cascade, per-user hub, temporal metadata | recall quality |
| 4 | Self-eval on public sets (LoCoMo, LongMemEval style) | scores before submitting |
| 5 | Droplet deploy, smoke test, cycle 2 submission | listing |
Repo
/Users/fritz/latebit/memoryleaderboard (github: latebit-io, main branch)
Workspace
- journal/ session notes
- Add architecture.md, patterns.md, debugging.md as they earn content.