# AX Check: goodmem.ai Checked 2026-09-19. Quickstart, pricing and API docs are clear and ready to use. 19 of 23 checklist items passed. Pricing is stated openly ($15/mo cloud, free self-hosted), though exact hourly rates need a console visit. ## Onboarding needs a login ## Coding sessions All three independent sessions completed and correctly reported pricing: self-hosted is free, Cloud starts at $15/mo with per-second metering by instance size and a 14-day no-card trial, sourced from the public pricing page. ### DeepSeek V4 Pro [View public run](https://agents.withgauge.com/p/runs/473b71ce-5b60-4243-adb7-40ec1adc1755) · [Read transcript](https://www.ax-check.com/goodmem.ai/sessions/deepseek.json) Final output states self-hosted is free (proprietary binary, Apache-2.0 SDKs) and Cloud is 'from $15/mo, metered by the second' with a '14-day free trial, no credit card' and sign-in requirement — naming plan tiers and trial limits as assumptions, sourced from real pricing page text captured at seq 86/94/103. Session findings unavailable. ### Kimi K3 [View public run](https://agents.withgauge.com/p/runs/2f8b726d-96e2-45b0-807c-7db4c64935b4) · [Read transcript](https://www.ax-check.com/goodmem.ai/sessions/kimi.json) Final output states self-hosted is free, Cloud is 'from $15/mo' with 14-day trial/no credit card, usage-based by instance size with storage-only charges when paused — pulled from goodmem.ai/pricing and stated with these plan/trial assumptions. #### End-to-end onboarding - **Onboarding needs a login**: Agent researched GoodMem thoroughly and wrote a working example script using the SDK, but never obtained real API credentials or executed any authenticated call against a hosted GoodMem instance. It correctly identified that GoodMem Cloud signup requires OAuth (Google/GitHub) login through a browser, which it cannot complete itself, and that the only credential-free path (local install) was explicitly disallowed by the session instructions. The example script was only tested with missing/dummy env vars, confirming it exits early rather than reaching any live endpoint. Event 59: ```text GoodMem Cloud signup is OAuth-only (Google or GitHub at cloud.goodmem.ai/login). There's no email/API-key-only signup I can drive programmatically, and I have no browser or credentials — so I can't obtain the gm_... API key and instance URL myself. ``` Event 57: ```text Missing env vars: GOODMEM_BASE_URL, GOODMEM_API_KEY, OPENAI_API_KEY exit=1 ``` Event 59: ```text The alternative quickstart is a local stack — curl -s https://get.goodmem.ai | bash installs a Docker-based GoodMem server + PostgreSQL/pgvector. You asked me not to start local service stacks, so I skipped it. ``` #### Hallucinated URLs None identified in this transcript. #### Blockers - **Cloud signup requires OAuth login the agent cannot perform**: GoodMem Cloud (the hosted product) only supports account creation via Google or GitHub OAuth at cloud.goodmem.ai/login. This is normal product behavior (not a defect) but it is a hard stop for an unattended agent with no browser/session — it cannot self-provision an API key or instance URL, so the example could never be run against the live service. Event 59: ```text GoodMem Cloud signup is OAuth-only (Google or GitHub at cloud.goodmem.ai/login). There's no email/API-key-only signup I can drive programmatically, and I have no browser or credentials — so I can't obtain the gm_... API key and instance URL myself. ``` - **Only alternative path is a local Docker install, which was off-limits**: The self-hosted quickstart (curl | bash) provisions a local Docker server plus PostgreSQL/pgvector, which is exactly the kind of local service stack the task instructions told the agent to avoid. This is a test-environment/instruction constraint, not a product flaw, but it removed the only credential-free route to a working instance. Event 59: ```text The alternative quickstart is a local stack — curl -s https://get.goodmem.ai | bash installs a Docker-based GoodMem server + PostgreSQL/pgvector. You asked me not to start local service stacks, so I skipped it. ``` #### Suggested Changes - **Add a non-OAuth, scriptable way to obtain a GoodMem Cloud trial API key**: On cloud.goodmem.ai/login, provide an API-driven signup path (e.g., email+password or a CLI-issued trial token) alongside Google/GitHub OAuth. Verify by having a script obtain a working GOODMEM_BASE_URL and GOODMEM_API_KEY without opening a browser, then confirm the example script (embedder -> space -> memory -> retrieve) completes end-to-end against that instance. Event 59: ```text GoodMem Cloud signup is OAuth-only (Google or GitHub at cloud.goodmem.ai/login). There's no email/API-key-only signup I can drive programmatically, and I have no browser or credentials — so I can't obtain the gm_... API key and instance URL myself. ``` ### Qwen 3.8 Max [View public run](https://agents.withgauge.com/p/runs/58d2ec53-47bc-40b1-ac20-af4c2b645a6d) · [Read transcript](https://www.ax-check.com/goodmem.ai/sessions/qwen.json) Final output states $15/mo usage-based cloud pricing with named assumptions (per-second metering by instance size, 14-day no-card trial, pausable compute, spend caps) plus a free self-hosted tier and custom enterprise quote. #### End-to-end onboarding - **Onboarding needs a login**: The agent researched Goodmem thoroughly, confirmed the Python SDK installs and imports, and wrote a syntactically valid example script matching the real SDK's method signatures and response models. However it never obtained a real API key or base URL: GoodMem Cloud requires interactive sign-in (Google/GitHub/magic link) through a hosted console, and self-hosting requires standing up a local Docker/Postgres stack, which the task explicitly forbade. No authenticated call against the hosted product was ever made; the script was never executed with real credentials. Event 95: ```text 200 https://app.goodmem.ai/login GoodMem Cloud Console made text metrics depend on a third-party CDN ``` Event 159: ```text OK no GOODMEM_*/OPENAI_* credentials in environment ``` Event 161: ```text I cannot run the example live. GoodMem Cloud requires an interactive sign-in (Google/GitHub/magic link at app.goodmem.ai) to provision an instance and get a gm_... API key, and the example also needs an OpenAI key for the embedder. Neither credential exists in this environment, and signup can't be automated from here. ``` #### Hallucinated URLs None identified in this transcript. #### Blockers - **No self-service way to get a Goodmem Cloud API key**: GoodMem Cloud provisioning requires signing in via Google, GitHub, or an emailed magic link through a hosted console (app.goodmem.ai). This is a normal authentication wall, not a product defect, but it fully prevented any live, authenticated use of the hosted product in this session. The agent correctly avoided the self-hosted Docker/Postgres path per the task's constraints. Event 161: ```text GoodMem Cloud requires an interactive sign-in (Google/GitHub/magic link at app.goodmem.ai) to provision an instance and get a gm_... API key, and the example also needs an OpenAI key for the embedder. Neither credential exists in this environment, and signup can't be automated from here. ``` Event 91: ```text 1 Sign in Google, GitHub, or an emailed magic link. No credit card and nothing to install. Start free 2 Get your instance A managed GoodMem instance is provisioned for you in seconds. ``` - **Missing OpenAI API key for the embedder step**: Even with a Goodmem key, the tutorial's embedder-creation step also requires a separate OpenAI API key, which was not present in the sandbox. This compounds the credential gap needed to run any real example end-to-end. Event 159: ```text no GOODMEM_*/OPENAI_* credentials in environment ``` #### Suggested Changes - **Add a non-interactive/dev-key path for Goodmem Cloud provisioning**: Currently the only way to obtain a GoodMem Cloud API key is through the interactive app.goodmem.ai sign-in flow (Google/GitHub/magic link), which blocks any headless or automated developer workflow. Consider a CLI-issuable or API-issuable trial key path; verify by confirming a script can obtain a working gm_ key without a browser session. Event 91: ```text 1 Sign in Google, GitHub, or an emailed magic link. No credit card and nothing to install. Start free ``` - **Fix broken pricing.html redirect on goodmem.com**: The domain goodmem.com/pricing returns a client-side redirect stub instead of content (114 bytes, JS-only redirect to /lander), forcing the agent to discover the working marketing site at goodmem.ai separately. Point goodmem.com's pricing route directly at the real pricing page or make the redirect server-side; verify by curling https://goodmem.com/pricing and confirming it returns full page content rather than an empty JS-redirect shell. Event 34: ```text ``` ### Task given to each agent Help me build a simple example using Goodmem. Tell me how pricing works, and briefly tell me whether this product will be easy for you to manage. Let me know if you get blocked. If this product has no developer workflow you can act on, say so plainly and stop. Stay light: use the hosted product through its SDK or API. Do not start local service stacks or wait for long-running commands; if the quickstart requires either, say so plainly and stop. No product credentials were supplied and no purchases were authorized. ## Score: B · 79/100 (provisional) Grades come from completed site checks. Coding sessions and skipped checks do not affect the score. ### Clarity - **Failed** — Homepage answers Markdown requests ```text Homepage returned text/html for a text/markdown request; no Markdown representation served. ``` - **Pass** — llms.txt provides an actionable documentation index ```text llms.txt lists docs, quick start, API, SDKs, integrations and a docs index with descriptions. ``` - **Pass** — llms.txt provides navigation guidance ```text llms.txt groups pages under Start here, Evaluate, Evidence, Company and Integration setup headings. ``` - **Pass** — llms.txt mentions offered API, MCP, and skills ```text llms.txt links API reference, MCP server, CLI, SDKs and integration setup guides. ``` - **Pass** — A compact guide representation exists ```text llms.txt links a standalone quick-start.md Markdown guide for GoodMem. ``` - **Pass** — A focused guide is directly retrievable ```text quick-start.md is directly retrievable as text/markdown with concrete install steps. ``` - **Pass** — Equivalent instructions fit a token budget ```text quick-start.md is ~15k tokens but a focused, usable workflow guide. ``` - **Skipped** — Product-docs links survive format changes ```text Homepage Markdown unsupported, so link preservation across formats is unmeasured. ``` - **Pass** — The compact guide is independently actionable ```text Quick-start.md gives concrete steps: curl install, cloud deploy, Codespaces, then next-step guides. ``` - **Pass** — Install and next-step links resolve ```text Fetched quick-start and API reference pages resolve; SDK registry links are listed. ``` ### Onboarding - **Pass** — Docs lead to a relevant quickstart ```text llms.txt links a Quick Start Guide with install, deploy, and SDK integration steps. ``` - **Pass** — Installation commands are extractable ```text Quick start shows curl install commands plus Railway, Fly.io, Lightsail, Hetzner one-liners. ``` - **Pass** — Code examples are available without interaction ```text Quick start lists Python, TypeScript, Java, Go, .NET SDK links and docs without interaction. ``` - **Pass** — Prerequisites and auth boundaries are explicit ```text Cloud trial needs no credit card; self-host and SDK paths are documented with prerequisites. ``` ### Pricing - **Failed** — Pricing units and limits are explicit ```text Cloud bills per second by instance size, but exact hourly rates live only in console rate sheet. ``` - **Pass** — Pricing is readable without interaction ```text Pricing page renders full plan details and usage explanation as static Markdown, no interaction needed. ``` - **Pass** — Prices are stated, not gated ```text Self-hosted Free, Cloud from $15/mo, Enterprise Custom all stated openly. ``` - **Pass** — Agents identify pricing and its assumptions ```text 3 of 3 sessions were judged on pricing; 0 fell short. DeepSeek V4 Pro: Final output states self-hosted is free (proprietary binary, Apache-2.0 SDKs) and Cloud is 'from $15/mo, metered by the second' with a '14-day free trial, no credit card' and sign-in requirement — naming plan tiers and trial limits as assumptions, sourced from real pricing page text captured at seq 86/94/103. Kimi K3: Final output states self-hosted is free, Cloud is 'from $15/mo' with 14-day trial/no credit card, usage-based by instance size with storage-only charges when paused — pulled from goodmem.ai/pricing and stated with these plan/trial assumptions. Qwen 3.8 Max: Final output states $15/mo usage-based cloud pricing with named assumptions (per-second metering by instance size, 14-day no-card trial, pausable compute, spend caps) plus a free self-hosted tier and custom enterprise quote. This behavioural item does not affect the fast grade. ``` ### Activation - **Pass** — An API reference or OpenAPI spec is reachable ```text GoodMem API Reference page documents equivalent gRPC and REST protocols with API-key auth. ``` - **Pass** — An MCP server is documented and well-formed ```text Docs list an MCP Server reference page among GoodMem's reference surfaces. ``` - **Pass** — A CLI install path is documented ```text Quick start installs server, web console, and CLI via curl script, with --cli-only option. ``` - **Pass** — SDK packages resolve on their registries ```text Registry lookup for pypi:goodmem-adk returned HTTP 200. ``` - **Skipped** — Agent skills are published ```text No fetched page documents published GoodMem agent skills. ``` [Full report data](https://www.ax-check.com/goodmem.ai/report.json)