# AX Check: saastoolindex.com Checked 2026-10-28. Agents can't find real pricing info for this tool index The llms.txt guide is well-structured and token-efficient, but no pricing page exists, so 2 of 3 agent sessions guessed the site is free rather than confirming it. ## End-to-end onboarding not demonstrated ## Coding sessions All three sessions completed but struggled with pricing. DeepSeek V4.1 Flash assumed free access since /pricing 404'd. Kimi K3 called it free based only on a missing sitemap path, without checking any page. Qwen 3.8 Max gave up entirely, stating it had no pricing information to offer. ### DeepSeek V4.1 Flash [View public run](https://agents.withgauge.com/p/runs/5c623bb0-3e73-4284-919b-d10ae0ae52ab) · [Read transcript](https://www.ax-check.com/saastoolindex.com/sessions/deepseek.json) The agent said the site costs nothing to browse and gave its basis: /pricing returned 404, there is no developer product or paid tier, and site prices refer to reviewed vendors. It hedged the affiliate-revenue guess. (seq 19, seq 40, seq 47, seq 57) #### End-to-end onboarding - **End-to-end onboarding not demonstrated**: No credential acquisition was attempted or needed, because the agent determined the product is a static editorial review website with no API, SDK, signup gate, or developer console. No authenticated operation was possible or attempted. Event 57: ```text There is no SDK and no API to build against. So per your instruction, I'm saying that plainly and stopping the "build an example" part rather than inventing one. ``` Event 57: ```text the product exposes no developer workflow to act on ``` #### Hallucinated URLs None identified in this transcript. #### Blockers - **No developer product exists to build against**: The agent probed common developer paths (/docs, /api, /developers, /pricing, /sdk) and machine-readable manifests (openapi.json, api.json, .well-known/ai-plugin.json, llms-full.txt), all returning 404. The site is confirmed via llms.txt and about/methodology pages to be a read-only editorial review index of 176 SaaS/AI tools, not a platform with an SDK, API, or signup flow. This is product behavior (the product simply has no developer surface), not agent error or missing credentials. Event 19: ```text docs -> 404 api -> 404 developers -> 404 pricing -> 404 sdk -> 404 ``` Event 48: ```text llms-full.txt -> 404 api.json -> 404 openapi.json -> 404 .well-known/ai-plugin.json -> 404 ``` Event 40: ```text SaaSToolIndex is an English-language index of 176 software-as-a-service and AI tools. ``` #### Suggested Changes None identified in this transcript. ### Kimi K3 [View public run](https://agents.withgauge.com/p/runs/9de1afd5-18bc-4956-9b9b-899bc2d8ad44) · [Read transcript](https://www.ax-check.com/saastoolindex.com/sessions/kimi.json) Called it a 'free, ad/content-style' site without checking any pricing or about page; the only basis was the absence of a pricing path in the sitemap's top-level segments (seq 34, seq 35, seq 36) #### End-to-end onboarding - **End-to-end onboarding not demonstrated**: The agent never obtained or used any product credentials. It determined there was no SDK, package, or API surface for SaaSToolIndex at all (only a content website), so no onboarding or authenticated operation was attempted. Event 34: ```text about ai-tool-digest categories category comparisons contact list methodology privacy-policy saas terms-of-service tools ``` Event 36: ```text No API: `/api`, `/api-docs`, `/openapi.json`, `/developers`, `/docs` all return 404. ``` #### Hallucinated URLs None identified in this transcript. #### Blockers - **SaaSToolIndex has no developer-facing product surface**: The product is a read-only content/directory website, not a SaaS with an SDK, API, or account system. The agent confirmed no npm or PyPI package exists, and common developer endpoints all 404'd. This is product behavior (or rather, absence of a developer product), not an agent error or missing credentials — there was nothing to authenticate against or build an example with. Event 14: ```text npm error 404 Not Found - GET https://registry.npmjs.org/saastoolindex - Not found ``` Event 30: ```text /developers: 404 /developer: 404 /docs: 404 /api-docs: 404 /openapi.json: 404 /sitemap.xml: 200 ``` Event 36: ```text SaaSToolIndex has no developer workflow I can act on. ``` #### Suggested Changes None identified in this transcript. ### Qwen 3.8 Max [View public run](https://agents.withgauge.com/p/runs/1882b540-e0e5-4760-9c7a-fa6f886366db) · [Read transcript](https://www.ax-check.com/saastoolindex.com/sessions/qwen.json) The agent explicitly declined to explain pricing ('I have no pricing information'). It gave no cost figure, plan or assumptions. (seq 12) #### End-to-end onboarding - **End-to-end onboarding not demonstrated**: The agent never attempted to obtain credentials or reach any hosted product. It inspected an empty local repo, found no SDK, docs, or API reference for "SaaSToolIndex," and stopped immediately without any authentication attempt or network call. Event 12: ```text "SaaSToolIndex" isn't a product I have any documentation, SDK, or API access for. I have no credentials, endpoints, or installable package to reach a hosted version through. ``` #### Hallucinated URLs None identified in this transcript. #### Blockers - **No product information available in environment**: The sandboxed repo contained only a .gitignore and an initial commit—no SDK, docs, API config, or reference to SaaSToolIndex. This is a test-environment limitation (missing seed materials) rather than a product defect, since the agent had no documented starting point to locate the product's SDK or API. Event 5: ```text total 16 drwxr-xr-x 3 root root 4096 Sep 18 08:00 . drwxr-xr-x 7 root root 4096 Oct 28 18:15 .. drwxr-xr-x 8 root root 4096 Sep 24 20:05 .git -rw-r--r-- 1 root root 408 Sep 18 08:00 .gitignore ``` Event 12: ```text `/sandbox/repo` is an empty workspace — just a `.gitignore` and a single "Initial workspace" commit. No code, docs, SDK, or API config for SaaSToolIndex exists here. ``` #### Suggested Changes - **Provide a discoverable quickstart or package reference for SaaSToolIndex**: The agent had no way to find an SDK package name, API base URL, or docs link from the sandbox alone and asked for any of these to proceed. Supplying a well-known install command or docs URL reachable without prior context would let a first-time developer agent locate the product and verify the fix by confirming the agent can install/import the SDK and make an authenticated call on the next attempt. Event 12: ```text To unblock me, provide any one of: the SDK package name / install command, API base URL + credentials (e.g., in env vars), or a link to the product's docs or quickstart. ``` ### Task given to each agent Help me build a simple example using SaaSToolIndex. Tell me how pricing works, and briefly tell me whether this product will be easy for you to manage. Let me know if you get blocked. If this product has no developer workflow you can act on, say so plainly and stop. Stay light: use the hosted product through its SDK or API. Do not start local service stacks or wait for long-running commands; if the quickstart requires either, say so plainly and stop. No product credentials were supplied and no purchases were authorized. ## Score: C · 63/100 (provisional) Grades come from completed site checks. Coding sessions and skipped checks do not affect the score. ### Clarity - **Failed** — Homepage answers Markdown requests ```text Homepage returned text/html for a text/markdown request; no Markdown representation offered. ``` - **Pass** — llms.txt provides an actionable documentation index ```text llms.txt lists Start here, all categories, comparison hubs, reviews and digest with descriptions. ``` - **Pass** — llms.txt provides navigation guidance ```text llms.txt opens with a Start here section linking home, about, methodology and categories. ``` - **Skipped** — llms.txt mentions offered API, MCP, and skills ```text llms.txt describes an index of SaaS tools; no API, MCP or skills are offered by this product. ``` - **Pass** — A compact guide representation exists ```text llms.txt is a compact Markdown guide to the index, categories, comparisons and reviews. ``` - **Pass** — A focused guide is directly retrievable ```text llms.txt fetched directly at 200 as text/plain Markdown with organized sections. ``` - **Pass** — Equivalent instructions fit a token budget ```text llms.txt measured 5422 tokens, well under the 8000-token budget. ``` - **Skipped** — Product-docs links survive format changes ```text Homepage Markdown unsupported, so link preservation across formats cannot be measured. ``` - **Skipped** — The compact guide is independently actionable ```text No compact agent guide fetched; only llms.txt index and homepage links, no standalone workflow page. ``` - **Skipped** — Install and next-step links resolve ```text No install or next-step links were fetched; only homepage and llms.txt index observed. ``` ### Onboarding - **Skipped** — Docs lead to a relevant quickstart ```text SaaSToolIndex is a tool-review index; no developer quickstart or install docs were fetched. ``` - **Skipped** — Installation commands are extractable ```text No installation or setup commands appear; the product is a review site, not an installable tool. ``` - **Skipped** — Code examples are available without interaction ```text No code examples were fetched; the index offers reviews and comparisons, not code. ``` - **Skipped** — Prerequisites and auth boundaries are explicit ```text No API, auth or prerequisite documentation was fetched for this review index. ``` ### Pricing - **Failed** — Agents identify pricing and its assumptions ```text 3 of 3 sessions were judged on pricing; 2 fell short. DeepSeek V4.1 Flash: The agent said the site costs nothing to browse and gave its basis: /pricing returned 404, there is no developer product or paid tier, and site prices refer to reviewed vendors. It hedged the affiliate-revenue guess. (seq 19, seq 40, seq 47, seq 57) Kimi K3: Called it a 'free, ad/content-style' site without checking any pricing or about page; the only basis was the absence of a pricing path in the sitemap's top-level segments (seq 34, seq 35, seq 36) Qwen 3.8 Max: The agent explicitly declined to explain pricing ('I have no pricing information'). It gave no cost figure, plan or assumptions. (seq 12) This behavioural item does not affect the fast grade. ``` - **Skipped** — Pricing is readable without interaction ```text SaaSToolIndex is a directory; no pricing page for the product itself was fetched. ``` - **Skipped** — Prices are stated, not gated ```text No SaaSToolIndex pricing page fetched; only third-party vendor pricing pages appear. ``` - **Skipped** — Pricing units and limits are explicit ```text No SaaSToolIndex pricing units or limits were observed in fetched evidence. ``` ### Activation - **Skipped** — An API reference or OpenAPI spec is reachable ```text No API reference or OpenAPI spec for SaaSToolIndex itself was fetched; only third-party vendor API pages. ``` - **Skipped** — An MCP server is documented and well-formed ```text No MCP server for SaaSToolIndex is documented; fetched MCP pages belong to Typeform and Jasper. ``` - **Skipped** — A CLI install path is documented ```text No CLI install path for SaaSToolIndex appears in the fetched llms.txt or any subject page. ``` - **Skipped** — SDK packages resolve on their registries ```text No SaaSToolIndex SDK or package registry result was supplied; only foreign vendor pages. ``` - **Skipped** — Agent skills are published ```text No agent skills published by SaaSToolIndex are shown in the fetched evidence. ``` [Full report data](https://www.ax-check.com/saastoolindex.com/report.json)