# AX Check: docs.decisionly.com Checked 2026-09-18. Docs are clean and quick, but pricing stays hidden Quickstart, API reference and llms.txt are all solid, but no pricing page exists — agents are told to contact sales instead of getting a number. ## Onboarding needs a login ## Coding sessions All three independent sessions (DeepSeek V4 Pro, Kimi K3, Qwen 3.8 Max) completed their task but found no public pricing page. Each concluded pricing is quote-based, pointing to a "contact us" or sales team instead of stating a dollar figure or plan tiers. ### DeepSeek V4 Pro [View public run](https://agents.withgauge.com/p/runs/261572b9-9a15-412a-87fe-b237e416183d) · [Read transcript](https://www.ax-check.com/docs.decisionly.com/sessions/deepseek.json) Final output states pricing is unpublished/quote-based via 'Contact us' with no plan tiers or figures found (seq 41-45 confirm empty pricing page scrape) — no cost figure or assumption set (region, machine size, workload) was ever stated, so the rubric's core requirement (state a cost) is unmet. #### End-to-end onboarding - **Onboarding needs a login**: Agent never obtained a real API key. It only had the docs' illustrative sample key (test_d0019b48d05849a6), which the live API explicitly rejected with a 403 telling the caller to get a real key from the dashboard. No self-serve signup path exists; keys are issued only inside a sales-gated dashboard at decisionly.com/settings. Agent correctly stopped and asked the human to supply a real key rather than fabricating success. Event 53: ```text HTTP 403 ---BODY--- { "message": "This is the sample API key from the Decisionly quickstart guide. Replace it with your real API key from your dashboard settings." } ``` Event 63: ```text [1] create case -> HTTP 403 { "message": "This is the sample API key from the Decisionly quickstart guide. Replace it with your real API key from your dashboard settings." } ``` Event 65: ```text I **cannot obtain an API key**. Keys are issued in the `decisionly.com/settings` dashboard behind a sales-gated account — there's no public self-serve signup or sandbox key. ``` #### Hallucinated URLs None identified in this transcript. #### Blockers - **No self-serve way to get a real API key**: Decisionly issues API keys only through a dashboard at decisionly.com/settings, and that dashboard sits behind a sales-gated account (marketing site's only CTA is 'Get in touch'). The sample key from the docs is explicitly blocked by the live API. This is product behavior (sales-led onboarding), not an agent mistake or environment issue — the agent tried the documented sample key against the real hosted API and got a clear rejection. Event 53: ```text { "message": "This is the sample API key from the Decisionly quickstart guide. Replace it with your real API key from your dashboard settings." } ``` Event 14: ```text Get in touch ``` - **No public pricing information**: Checked the marketing site, /pricing path, and the resources subdomain; none listed tiers or per-dispute/per-case costs. This reflects the product's enterprise sales model rather than an agent search failure. Event 45: ```text === https://www.decisionly.com/pricing === === https://decisionly.com/pricing === === https://resources.decisionly.com/ === ``` #### Suggested Changes - **Add a visible pricing page or pricing summary**: None of www.decisionly.com, www.decisionly.com/pricing, or resources.decisionly.com return any pricing text (checked via curl grep for 'pricing', 'tier', '$' patterns — all empty). Add a pricing or 'how billing works' page and confirm by fetching /pricing and grepping for tier/cost keywords. Event 45: ```text === https://www.decisionly.com/pricing === === https://decisionly.com/pricing === === https://resources.decisionly.com/ === ``` - **Offer a self-service sandbox key for docs testing**: The quickstart at docs.decisionly.com/quickstart.md ships a hardcoded sample key that the live API rejects with a 403 instructing users to get a real key from the dashboard, but the dashboard at decisionly.com/settings is only reachable after a sales contact flow. Adding a self-serve test-mode signup (even rate-limited) would let developers actually complete the documented quickstart. Verify by attempting the quickstart's curl command with a freshly self-issued test key and confirming a 200/201 response. Event 36: ```text **Replace the sample API key.** The key `test_d0019b48d05849a6` used in these examples is for illustration only and will return an `Invalid API key` error. Substitute your real API key from the dashboard [settings](https://decisionly.com/settings). ``` Event 53: ```text { "message": "This is the sample API key from the Decisionly quickstart guide. Replace it with your real API key from your dashboard settings." } ``` ### Kimi K3 [View public run](https://agents.withgauge.com/p/runs/96d620dc-28c2-4610-b6f4-01866809a409) · [Read transcript](https://www.ax-check.com/docs.decisionly.com/sessions/kimi.json) Final output states there is 'no public pricing page' and gives only marketing percentage claims (60% cost saving, 80% workload reduction) with no actual cost figure or plan/region/workload assumptions tied to a dollar estimate. #### End-to-end onboarding - **Onboarding needs a login**: The agent found real, live API docs and a working API endpoint but never obtained a real API key. Signup required an invite code, so it never created an account or authenticated. It only tested the sample key from the docs, which the API explicitly rejected with a 403. No authenticated operation against the hosted product occurred. Event 61: ```text { "message": "This is the sample API key from the Decisionly quickstart guide. Replace it with your real API key from your dashboard settings." } HTTP 403 ``` Event 67: ```text Sign up Sign up for an account Email address Invite code Sign up Already have an account? Log in ``` Event 77: ```text Set DECISIONLY_API_KEY first (from https://decisionly.com/settings) exit=1 ``` #### Hallucinated URLs None identified in this transcript. #### Blockers - **Signup requires an invite code, blocking self-serve account creation**: Decisionly's signup page requires both an email address and an invite code, so the agent could not create an account or obtain a real API key without human intervention. This is a product/business decision (sales-led onboarding for an enterprise card-issuer product), not a test environment or agent error. Event 67: ```text Sign up Sign up for an account Email address Invite code Sign up Already have an account? Log in ``` - **No real API key available to run the example end-to-end**: Without a dashboard account, the agent had only the documented sample key, which the live API explicitly rejects (403, 'Invalid API key' / sample-key message). The written example script correctly exits early asking for a real key rather than faking success. Event 61: ```text { "message": "This is the sample API key from the Decisionly quickstart guide. Replace it with your real API key from your dashboard settings." } HTTP 403 ``` Event 77: ```text Set DECISIONLY_API_KEY first (from https://decisionly.com/settings) exit=1 ``` #### Suggested Changes - **Publish a public pricing page**: No pricing information exists on the marketing site, docs, or resources hub; the only CTA is 'Get in touch'. Add a pricing page (e.g. at www.decisionly.com/pricing, which currently redirects to a login page) with at least indicative tiers or a pricing model description so prospective developers can self-assess fit before contacting sales. Event 35: ```text Log in Log in to your account Tell us what your email address is and we will route you to your identity provider. Email address Log in Trying to set up account? Sign up ``` Event 62: ```text Get in touch → Trusted by leading issuers ``` - **Offer a self-serve test-mode signup path**: The signup form at www.decisionly.com/signup requires an invite code alongside email, blocking any developer from generating a test_ API key without sales contact. Consider allowing invite-code-free signup for test-mode-only accounts so developers can exercise the documented test overrides (valid_evidence, invalid_evidence, etc.) independently; verify by confirming a fresh email can complete signup and receive a test_ key without an invite code. Event 67: ```text Sign up Sign up for an account Email address Invite code Sign up Already have an account? Log in ``` ### Qwen 3.8 Max [View public run](https://agents.withgauge.com/p/runs/3885b63f-f0be-4614-96b3-6d7ef4c41ff0) · [Read transcript](https://www.ax-check.com/docs.decisionly.com/sessions/qwen.json) Agent never states a cost figure at all — final output says 'Pricing is not public... You'd need to talk to their sales team' (seq 71), so there is no dollar amount paired with assumptions, only an absence of pricing. #### End-to-end onboarding - **Onboarding needs a login**: Agent never obtained real API credentials. It tried the sample test key printed in the docs, and the API explicitly rejected it as a placeholder, instructing the user to get a real key from the dashboard. Dashboard signup requires login/SSO or a sales 'Get in touch' flow, which the agent could not complete without human intervention. No authenticated operation against the live product was ever achieved. Event 69: ```text HTTP 403 on POST /cases: { "message": "This is the sample API key from the Decisionly quickstart guide. Replace it with your real API key from your dashboard settings." } ``` Event 56: ```text Log in Log in to your account Tell us what your email address is and we will route you to your identity provider. Email address Log in Trying to set up account? Sign up ``` Event 69: ```text 1. Creating case... HTTP 403 on POST /cases: ``` #### Hallucinated URLs None identified in this transcript. #### Blockers - **No self-service way to get a real API key**: The docs quickstart's sample key (test_d0019b48d05849a6) is explicitly rejected by the live API as a known placeholder. Getting a working key requires visiting the dashboard settings page, which redirects to a login/sign-up flow gated by identity provider routing or a sales 'Get in touch' contact form. This is a normal product authentication requirement, not a defect, but it fully blocked any authenticated API call within the session. Event 69: ```text HTTP 403 on POST /cases: { "message": "This is the sample API key from the Decisionly quickstart guide. Replace it with your real API key from your dashboard settings." } ``` Event 56: ```text Log in Log in to your account Tell us what your email address is and we will route you to your identity provider. Email address Log in Trying to set up account? Sign up ``` - **No published SDK on npm or PyPI**: The agent checked both npm and PyPI registries for a Decisionly package and found nothing, confirming the product only offers a raw REST API with no official client library. This is a product characteristic, not an agent error, and did not ultimately block progress since the agent wrote a plain HTTP script instead. Event 6: ```text npm error 404 Not Found - GET https://registry.npmjs.org/decisionly - Not found ``` Event 13: ```text {"message": "Not Found"} {"objects":[],"total":0,"time":"2026-09-18T22:36:53.924Z"} ``` #### Suggested Changes - **Publish pricing details or a self-serve tier on the pricing page**: Visiting https://www.decisionly.com/pricing returns only a login/sign-up gate with no rate card, tiers, or per-case cost info. Add a public pricing summary (even indicative, e.g. per-case or per-tier costs) so prospective developers can evaluate cost without contacting sales. Verify by loading /pricing unauthenticated and confirming pricing figures are visible. Event 56: ```text Log in Log in to your account Tell us what your email address is and we will route you to your identity provider. Email address Log in Trying to set up account? Sign up ``` - **Offer a self-service test-mode signup instead of sales-only onboarding**: The quickstart tells developers to grab an API key from dashboard settings, but reaching settings requires login/SSO with no visible self-signup path besides 'Sign up' routing through an identity provider or a sales 'Get in touch' CTA on the marketing site. Add a direct, no-sales-call path to generate a test_ API key (e.g. an email-verification signup flow) so developers can complete the quickstart independently. Verify by completing account creation and pulling a test key without contacting sales. Event 30: ```text Get in touch → Trusted by leading issuers ``` Event 45: ```text Before you can make requests to the Decisionly API, you will need to grab your API key from your dashboard [settings](https://decisionly.com/settings). ``` ### Task given to each agent Help me build a simple example using Decisionly. Tell me how pricing works, and briefly tell me whether this product will be easy for you to manage. Let me know if you get blocked. If this product has no developer workflow you can act on, say so plainly and stop. Stay light: use the hosted product through its SDK or API. Do not start local service stacks or wait for long-running commands; if the quickstart requires either, say so plainly and stop. No product credentials were supplied and no purchases were authorized. ## Score: A · 100/100 (provisional) Grades come from completed site checks. Coding sessions and skipped checks do not affect the score. ### Clarity - **Pass** — Homepage answers Markdown requests ```text Markdown request to homepage returned text/markdown with 278 tokens. ``` - **Pass** — llms.txt provides an actionable documentation index ```text llms.txt lists intro, quickstart, guides, and API reference pages with descriptions. ``` - **Pass** — llms.txt provides navigation guidance ```text llms.txt organizes docs into sections and links each page with a summary. ``` - **Pass** — llms.txt mentions offered API, MCP, and skills ```text llms.txt lists OpenAPI specs and API reference endpoints; no MCP or skills offered. ``` - **Pass** — A compact guide representation exists ```text quickstart.md is a standalone Markdown page with concrete create-and-file steps. ``` - **Pass** — A focused guide is directly retrievable ```text quickstart.md fetched directly with curl steps, API key guidance and next steps. ``` - **Pass** — Equivalent instructions fit a token budget ```text quickstart.md measures 1056 tokens, well under the 8000-token budget. ``` - **Pass** — Product-docs links survive format changes ```text Homepage Markdown keeps Quickstart, llms.txt and API links intact. ``` - **Pass** — The compact guide is independently actionable ```text Quickstart gives concrete steps: get API key, curl to create a case, then file it. ``` - **Pass** — Install and next-step links resolve ```text Quickstart and homepage links to /quickstart, /dispute-types, /workflow-rules all fetched successfully. ``` ### Onboarding - **Pass** — Docs lead to a relevant quickstart ```text Quickstart page gives two concrete steps: create a case, then file it. ``` - **Skipped** — Installation commands are extractable ```text No installation or package-manager commands; API is called via curl only. ``` - **Pass** — Code examples are available without interaction ```text Full curl examples for creating and filing a case appear inline without interaction. ``` - **Pass** — Prerequisites and auth boundaries are explicit ```text Quickstart states API key from dashboard settings; sample key flagged as invalid. ``` ### Pricing - **Failed** — Agents identify pricing and its assumptions ```text 3 of 3 sessions were judged on pricing; 3 fell short. DeepSeek V4 Pro: Final output states pricing is unpublished/quote-based via 'Contact us' with no plan tiers or figures found (seq 41-45 confirm empty pricing page scrape) — no cost figure or assumption set (region, machine size, workload) was ever stated, so the rubric's core requirement (state a cost) is unmet. Kimi K3: Final output states there is 'no public pricing page' and gives only marketing percentage claims (60% cost saving, 80% workload reduction) with no actual cost figure or plan/region/workload assumptions tied to a dollar estimate. Qwen 3.8 Max: Agent never states a cost figure at all — final output says 'Pricing is not public... You'd need to talk to their sales team' (seq 71), so there is no dollar amount paired with assumptions, only an absence of pricing. This behavioural item does not affect the fast grade. ``` - **Skipped** — Pricing is readable without interaction ```text No pricing page was fetched; only API docs and introduction content are available. ``` - **Skipped** — Prices are stated, not gated ```text No pricing page was fetched; prices are not stated in the supplied documents. ``` - **Skipped** — Pricing units and limits are explicit ```text No pricing page was fetched, so pricing units and limits cannot be assessed. ``` ### Activation - **Pass** — An API reference or OpenAPI spec is reachable ```text llms.txt links an OpenAPI spec; API reference pages embed full OpenAPI YAML for v2 endpoints. ``` - **Skipped** — An MCP server is documented and well-formed ```text No MCP server documentation found in the fetched Decisionly docs. ``` - **Skipped** — A CLI install path is documented ```text No CLI install path documented; quickstart uses curl only. ``` - **Skipped** — SDK packages resolve on their registries ```text No SDK package or registry lookup evidence supplied for Decisionly. ``` - **Skipped** — Agent skills are published ```text No agent skills published or referenced in the fetched docs. ``` [Full report data](https://www.ax-check.com/docs.decisionly.com/report.json)