# AX Check: tinyfn.io Checked 2026-09-18. Docs and pricing are clear, but agents still botch pricing. Homepage lists Free/Starter/Pro prices and quotas in plain text, yet 2 of 3 coding sessions refused to state any pricing figure when asked. ## Onboarding needs a login ## Coding sessions All three sessions completed. DeepSeek V4 Pro read the homepage and reported a full pricing table with a noted docs discrepancy. Kimi K3 and Qwen 3.8 Max both declined to state any pricing, saying they could not verify or invent figures. ### DeepSeek V4 Pro [View public run](https://agents.withgauge.com/p/runs/cced7393-45c8-4ed6-a83c-e61dc838b896) · [Read transcript](https://www.ax-check.com/tinyfn.io/sessions/deepseek.json) Final output gives a full pricing table (Free/Starter/Pro/Enterprise with $ and req limits) sourced explicitly from the live homepage tinyfn.io/#pricing, and flags a docs-vs-homepage discrepancy as an assumption caveat. #### End-to-end onboarding - **Onboarding needs a login**: The agent never obtained a real TinyFn API key. It only tested the hosted API with no key and with a fabricated fake key, both returning 401 Unauthorized. Signup requires a human to create an account via email/password on the hosted dashboard, which the agent explicitly declined to do, so no authenticated operation was ever demonstrated. Event 88: ```text == fake key == HTTP/2 401 ... {"detail":{"error":"Invalid API key","code":"invalid_api_key"}} ``` Event 105: ```text signing up for an API key requires creating an account (email/password) via the hosted dashboard, which I can't and shouldn't do on your behalf. That doesn't block building or reviewing the product, but it means I couldn't verify a successful authenticated response. ``` Event 103: ```text == fake key (exercises real API + error handling) == TinyFn error (401): Invalid API key exit=1 ``` #### Hallucinated URLs None identified in this transcript. #### Blockers - **Signup requires human-created account credentials**: TinyFn's quickstart and authentication docs require creating an account (email/password) through the hosted signup form to obtain an API key. This is normal product behavior (a standard login/signup wall), not a product defect, but it prevented the agent from completing a successful authenticated request end-to-end. Event 105: ```text signing up for an API key requires creating an account (email/password) via the hosted dashboard, which I can't and shouldn't do on your behalf. ``` Event 63: ```text ## 1. Get your API key Create an account and get your API key instantly. No credit card required. ``` #### Suggested Changes - **Reconcile mismatched pricing between homepage and rate-limits doc page**: The rate-limits guide (tinyfn.io/docs/guides/rate-limits) lists Starter at $5/mo and Pro at $15/mo, while the homepage pricing section (tinyfn.io/#pricing) lists Starter at $9/mo and Pro at $30/mo. Update one source to match the other and verify by re-fetching both pages and comparing the price fields. Event 69: ```text | **Starter** | \$5/mo | 10,000 | 100 | | **Pro** | \$15/mo | 100,000 | 1,000 | ``` Event 75: ```text Starter $9 /month Great for side projects 10,000 requests/month ``` - **Fix broken llms.txt and introduction.md at docs.tinyfn.io root**: Requests to https://docs.tinyfn.io/llms.txt and https://docs.tinyfn.io/introduction.md returned NOT_FOUND, even though the docs page itself links to docs.tinyfn.io/docs/introduction as the canonical URL. Confirm whether docs.tinyfn.io should redirect root-level paths to the /docs/ prefix, and verify by curling both paths and checking for a 200 response instead of NOT_FOUND. Event 45: ```text llms.txt 84 The page could not be found NOT_FOUND ``` Event 37: ```text href="https://docs.tinyfn.io/docs/introduction" ``` ### Kimi K3 [View public run](https://agents.withgauge.com/p/runs/30c234e3-0461-4c4e-af4e-27032d1fed1b) · [Read transcript](https://www.ax-check.com/tinyfn.io/sessions/kimi.json) Final output explicitly states 'I can't tell you anything accurate... I won't invent pricing details for a product I can't verify' — no pricing figure or assumptions given at all. #### End-to-end onboarding - **End-to-end onboarding not demonstrated**: No credentials existed for TinyFn and none were obtained. The agent found no npm/PyPI package, no resolving domain, and no API keys in the environment, then correctly stopped without fabricating any product interaction or credentials. Event 17: ```text TinyFn doesn't appear to exist as a product I can act on. ``` Event 6: ```text PI_GATEWAY_API_KEY=unused ``` #### Hallucinated URLs None identified in this transcript. #### Blockers - **TinyFn product could not be located anywhere**: The agent searched npm, PyPI, and the domain tinyfn.dev, plus the local repo and environment variables, and found zero evidence the product exists. This is not a product defect or agent error — it reflects the test setup referencing a product with no discoverable public presence, so the agent correctly halted per its instructions rather than guessing. Event 10: ```text npm error 404 Not Found - GET https://registry.npmjs.org/tinyfn - Not found ``` Event 15: ```text {"message": "Not Found"}--- ERROR: No matching distribution found for tinyfn ``` Event 17: ```text npm registry** — no `tinyfn` package, no search matches ``` #### Suggested Changes None identified in this transcript. ### Qwen 3.8 Max [View public run](https://agents.withgauge.com/p/runs/40b4db32-d472-4228-8301-b44daa844cd8) · [Read transcript](https://www.ax-check.com/tinyfn.io/sessions/qwen.json) Final output explicitly states "I can't tell you how pricing works" and refuses to give any figure — no pricing number or assumptions were stated at all. #### End-to-end onboarding - **End-to-end onboarding not demonstrated**: Agent never obtained TinyFn credentials or reached a real TinyFn API/SDK. It searched npm, PyPI, and the bare domain, found nothing, and stopped without any authenticated operation. Event 13: ```text curl: (28) Operation timed out after 10002 milliseconds with 0 bytes received 000 200 404 ``` Event 21: ```text I can't find TinyFn as a real product ``` #### Hallucinated URLs None identified in this transcript. #### Blockers - **TinyFn product not discoverable anywhere**: The agent checked the most likely distribution points for a product called TinyFn (npm registry, PyPI, and the bare tinyfn.com domain) and found no package, no site response, and no local repo content referencing it. This is not a credentials or environment issue — the product itself appears unreachable/nonexistent under this name, so the agent correctly stopped rather than fabricate details. Event 13: ```text curl: (28) Operation timed out after 10002 milliseconds with 0 bytes received 000 200 404 ``` Event 19: ```text {"message": "Not Found"} {"objects":[],"total":0,"time":"2026-09-18T21:58:10.816Z"} ``` Event 21: ```text there's no vendored SDK, docs, or config pointing to it ``` #### Suggested Changes - **Publish a discoverable package or docs site under the TinyFn name**: Because npm, PyPI, and the tinyfn.com domain all failed to resolve to anything, a first-time developer following the seed prompt has zero entry point. If TinyFn is a real product, publish its SDK to a standard registry (npm/PyPI) under a findable name and ensure the marketing/docs domain resolves, then confirm by re-running the same npm/PyPI search and domain curl used here. Event 13: ```text curl: (28) Operation timed out after 10002 milliseconds with 0 bytes received 000 200 404 ``` Event 19: ```text {"objects":[],"total":0,"time":"2026-09-18T21:58:10.816Z"} ``` ### Task given to each agent Help me build a simple example using TinyFn. Tell me how pricing works, and briefly tell me whether this product will be easy for you to manage. Let me know if you get blocked. If this product has no developer workflow you can act on, say so plainly and stop. Stay light: use the hosted product through its SDK or API. Do not start local service stacks or wait for long-running commands; if the quickstart requires either, say so plainly and stop. No product credentials were supplied and no purchases were authorized. ## Score: B · 84/100 (provisional) Grades come from completed site checks. Coding sessions and skipped checks do not affect the score. ### Clarity - **Failed** — Homepage answers Markdown requests ```text Homepage returned text/html even when text/markdown was requested; no Markdown representation offered. ``` - **Pass** — llms.txt provides an actionable documentation index ```text llms.txt links API docs, API reference, MCP setup, tools directory and blog with quick-start config. ``` - **Pass** — llms.txt provides navigation guidance ```text llms.txt gives Quick Start MCP config and REST examples plus a Documentation section of links. ``` - **Pass** — llms.txt mentions offered API, MCP, and skills ```text llms.txt mentions MCP config, REST API endpoints, and links MCP setup and API reference. ``` - **Pass** — A compact guide representation exists ```text llms.txt and /docs/quickstart.md are site-published Markdown guides for TinyFn. ``` - **Pass** — A focused guide is directly retrievable ```text Quickstart.md returns 200 text/markdown with API key, request, and response steps. ``` - **Pass** — Equivalent instructions fit a token budget ```text Quickstart.md is 695 tokens, well under the 8000-token budget. ``` - **Skipped** — Product-docs links survive format changes ```text Homepage Markdown unsupported, so link preservation across formats cannot be measured. ``` - **Pass** — The compact guide is independently actionable ```text Quickstart gives API key signup, cURL/JS/Python/Go first request, sample response, next steps. ``` - **Pass** — Install and next-step links resolve ```text Quickstart and API reference pages fetched successfully; signup and docs links resolve. ``` ### Onboarding - **Pass** — Docs lead to a relevant quickstart ```text Docs quickstart page gives concrete first steps: get API key, make request, see response. ``` - **Pass** — Installation commands are extractable ```text Quickstart shows extractable cURL, JavaScript, Python, and Go request commands. ``` - **Pass** — Code examples are available without interaction ```text Quickstart provides copyable code examples in four languages plus JSON response. ``` - **Pass** — Prerequisites and auth boundaries are explicit ```text Authentication page states X-API-Key required and how to obtain key. ``` ### Pricing - **Failed** — Agents identify pricing and its assumptions ```text 3 of 3 sessions were judged on pricing; 2 fell short. DeepSeek V4 Pro: Final output gives a full pricing table (Free/Starter/Pro/Enterprise with $ and req limits) sourced explicitly from the live homepage tinyfn.io/#pricing, and flags a docs-vs-homepage discrepancy as an assumption caveat. Kimi K3: Final output explicitly states 'I can't tell you anything accurate... I won't invent pricing details for a product I can't verify' — no pricing figure or assumptions given at all. Qwen 3.8 Max: Final output explicitly states "I can't tell you how pricing works" and refuses to give any figure — no pricing number or assumptions were stated at all. This behavioural item does not affect the fast grade. ``` - **Pass** — Pricing is readable without interaction ```text Homepage pricing section lists Free $0, Starter $9/month, Pro $30/month in plain text. ``` - **Pass** — Prices are stated, not gated ```text Prices are stated directly on the homepage; no gating or interaction required. ``` - **Pass** — Pricing units and limits are explicit ```text Plans state request quotas (100, 10,000, 100,000/month) and rate limits (10/100/1,000 per minute). ``` ### Activation - **Pass** — An API reference or OpenAPI spec is reachable ```text OpenAPI 3.1 spec at api.tinyfn.io/openapi.json returns 200 with 572 paths. ``` - **Pass** — An MCP server is documented and well-formed ```text MCP docs list 29 category servers plus /mcp/all with config and auth. ``` - **Skipped** — A CLI install path is documented ```text No CLI install path documented; only REST and MCP usage shown. ``` - **Skipped** — SDK packages resolve on their registries ```text No SDK or packaged CLI registry result supplied for TinyFn. ``` - **Skipped** — Agent skills are published ```text No agent skills published or referenced in fetched TinyFn docs. ``` [Full report data](https://www.ax-check.com/tinyfn.io/report.json)