memoryleaderboard: Project Hub

Entry for demarkus in the Agent Memory Leaderboard: a Go adapter exposing the benchmark's Add/Search HTTP contract over a per-user demarkus world, with agentic search as the submission.

Status

PR #5 merged Academic hosted-API readiness on 2026-08-17 as 9f4ff7e: Apache-2.0 licensing, full method disclosure, public Demarkus image verification, Compose-pinned OpenAI gpt-4o-mini, safe explicit-endpoint credential routing, and review fixes. Local main is clean. The repository remains private; next is making it public, then live gpt-4o-mini distillation/navigation validation and deployment.

Plan

Authoritative plan: Agent Memory Leaderboard entry. Search uses a scoped nib navigation agent over Demarkus lookup/list/fetch; Add uses gpt-4o-mini distillation while retaining raw evidence. Production is a single encrypted Linux host with Caddy TLS, adapter, private Demarkus storage, and explicit 30-day data/backup deletion. The Academic submission uses Coding Memory and the hosted Add/Search API route.

Echo v5 is the Go HTTP framework used by the adapter, not an LLM provider.

Phases

#	Work	Output
0	Recon: challenge repo, limits, cycle dates, route	Academic hosted API route selected
1	Adapter skeleton: Add/Search against local Demarkus	merged
2	Agentic search; catalog fallback	merged via PR #2
3	Ingestion tuning: distillation, temporal metadata, idempotency	merged via PR #3
4	Conformance, synthetic retrieval quality, Top-K load evaluation	local gates pass; live provider run pending
5	Public release, provider validation, host deploy, Smoke, Full	active; repository visibility and OpenAI key needed

Repo

/Users/fritz/latebit/memoryleaderboard (github: latebit-io, main at 9f4ff7e)

Workspace

Agent Memory Leaderboard official benchmark bookmark and entry links
Agent Memory Leaderboard entry plan active roadmap
journal/ session notes
debugging.md investigation lessons and portability gotchas
Add architecture.md and patterns.md as they earn content.