# AX Check: dataville.com Checked 2026-10-12. Quickstart and pricing are clear, but llms.txt is missing Docs give a working quickstart with code examples and an API reference; pricing lists Free/Developer/Pro with clear rates. llms.txt returns a 404, so there's no documentation index. ## Onboarded with real credentials ## Coding sessions All three independent sessions completed. Two agents (DeepSeek V4.1 Flash and Qwen 3.8 Max) laid out pricing clearly with plan tiers, per-request rates, and usage assumptions like SQL row billing. The third, Kimi K3, refused to state a price, saying it could not verify the product exists. ### DeepSeek V4.1 Flash [View public run](https://agents.withgauge.com/p/runs/812c0663-2225-49fe-a6dc-859c662dd0f0) · [Read transcript](https://www.ax-check.com/dataville.com/sessions/deepseek.json) Pricing is stated with clear plan tiers, per-request rates by source, and billing caveats (SQL row billing, top-offs, free connected-sheet queries) rather than a bare number. Evidence: README.md pricing table and notes list Free/Developer/Pro plans, $/credit rates per source, and billing rules, matching the docs fetched at seq 44. #### End-to-end onboarding - **Onboarded with real credentials**: No human-supplied credentials were used. The agent relied on Dataville's documented anonymous tier (no signup needed) to call the live hosted API at api.dataville.com, getting real production data back with decrementing rate-limit counters, proving a genuine authenticated-equivalent operation against the real hosted product rather than a mock. Event 59: ```text source: arxiv id: arxiv_1706.03762 title: Attention Is All You Need usage: {"requests_remaining":44,"request_limit":50} ``` Event 63: ```text source: sec-edgar id: edgar_0001628280-26-058715 title: HOME DEPOT, INC. — 10-Q (2026-08-25) ``` Event 21: ```text Requires a Dataville API key — get one from the [Dataville dashboard](https://app.dataville.com/api-keys). ``` #### Hallucinated URLs None identified in this transcript. #### Blockers - **No API key obtained, limited to anonymous tier**: The agent never created a real Dataville account or API key (that requires human signup via app.dataville.com/signup), so all testing ran on the documented anonymous allowance (50 requests/24h/IP) rather than an authenticated account. This is a session/test-environment limitation, not a product defect, and did not block the agent's deliverable since the anonymous tier fully validated the API. Event 21: ```text Requires a Dataville API key — get one from the [Dataville dashboard](https://app.dataville.com/api-keys). ``` Event 59: ```text usage: {"requests_remaining":44,"request_limit":50} ``` #### Suggested Changes - **Add a working pricing page at dataville.com/pricing**: Direct navigation to https://www.dataville.com/pricing and https://dataville.com/pricing both returned HTTP 404, even though pricing content exists at docs.dataville.com/plans-and-credits and as a #pricing anchor on the marketing homepage. Add a redirect or real page at the /pricing path on the main marketing site so visitors who guess that URL land on pricing info instead of a 404. Event 30: ```text === https://www.dataville.com/pricing === http=404 final=https://www.dataville.com/pricing ``` Event 38: ```text ===== /pricing ===== http=404 size=114389 ``` ### Kimi K3 [View public run](https://agents.withgauge.com/p/runs/945b88ac-501f-43a3-a6f4-deb8e51f4eed) · [Read transcript](https://www.ax-check.com/dataville.com/sessions/kimi.json) No pricing figure or assumptions were given — the agent explicitly refused to state any cost since it could not verify the product exists. Evidence: seq 8 final output explicitly says it 'won't invent ... pricing details' and gives no number or assumptions. #### End-to-end onboarding - **End-to-end onboarding not demonstrated**: The agent never located Dataville as a real product. It checked an empty local repo, PyPI, and npm, found nothing, and stopped without attempting any signup, credential acquisition, or authenticated API call. No onboarding flow was ever reached. Event 4: ```text pip index versions dataville 2>&1 | head -5; npm view dataville 2>&1 | head -10 ``` Event 6: ```text npm error 404 Not Found - GET https://registry.npmjs.org/dataville - Not found ``` #### Hallucinated URLs None identified in this transcript. #### Blockers - **Dataville package/product not discoverable**: The agent searched the local repo, PyPI, and npm for any trace of a 'Dataville' SDK or package and found nothing. This is not a product defect by the agent — it reflects either a test-environment setup issue (no docs/URL supplied) or that the product name/package differs from what was given in the prompt. Without any seed link or package name, the agent had no path to the real product and correctly stopped rather than fabricate a workflow. Event 5: ```text total 16 drwxr-xr-x 3 root root 4096 Sep 18 08:00 . drwxr-xr-x 8 root root 4096 Sep 24 20:05 .git -rw-r--r-- 1 root root 408 Sep 18 08:00 .gitignore ``` Event 6: ```text ERROR: No matching distribution found for dataville ``` Event 8: ```text I can't find any evidence that "Dataville" is a real, accessible product. There's no SDK in the Python or Node package registries, nothing in this repo, and I have no way to browse the web from this environment to look up an API or pricing page. ``` #### Suggested Changes - **Supply a discoverable package name or quickstart link for Dataville**: Since neither PyPI nor npm returned any match for 'dataville', the product owner should confirm the exact published package name (if any) and include it, or a direct quickstart/docs URL, in the test prompt or seed context so the agent has a real entry point. Verify by rerunning the session and checking that 'npm view ' or 'pip index versions ' returns a valid result instead of a 404. Event 6: ```text npm error 404 Not Found - GET https://registry.npmjs.org/dataville - Not found ``` ### Qwen 3.8 Max [View public run](https://agents.withgauge.com/p/runs/ded298a6-95cf-4c7e-bea7-a1a0a6c8cd52) · [Read transcript](https://www.ax-check.com/dataville.com/sessions/qwen.json) Pricing was laid out with concrete plan tiers, per-request rates by source, and usage-based assumptions (e.g. SQL cost per row, anonymous rate limits). Evidence: Final output lists Free/Developer/Pro plan costs, per-request rates for Wikipedia vs other sources, and billing-hygiene rules pulled from docs.dataville.com/plans-and-credits (seq 54). #### End-to-end onboarding - **End-to-end onboarding not demonstrated**: The agent never obtained a real Dataville API key. It only used the anonymous, unauthenticated tier of the API (50 requests/24h/IP) for all three lookups. The agent explicitly noted account creation requires a human step it could not perform itself. No authenticated operation was demonstrated. Event 62: ```text usage : {'requests_remaining': 47, 'request_limit': 50} ``` Event 64: ```text the API key requires signing up at app.dataville.com (a human step — I can't create accounts), and one-active-key-per-account means rotating a key invalidates the old one immediately ``` #### Hallucinated URLs None identified in this transcript. #### Blockers - **Account signup requires human-operated web flow**: Getting a real Dataville API key requires creating an account via a web signup form at app.dataville.com, which the agent cannot do autonomously. This is a normal authentication requirement, not a product defect, but it meant the session only exercised the unauthenticated anonymous tier instead of a fully onboarded developer flow. Event 64: ```text the API key requires signing up at app.dataville.com (a human step — I can't create accounts) ``` #### Suggested Changes - **Fix the broken /pricing and /docs links on the marketing site**: Visiting https://dataville.com/pricing and https://dataville.com/docs both returned 404s even though pricing content exists on the homepage and docs exist at the separate docs.dataville.com subdomain. Update the marketing site's nav links (or add redirects) so '/pricing' and '/docs' resolve, and verify with a curl or browser check that both paths return 200 instead of the 404 page-not-found response observed. Event 29: ```text 404 404 - Page not found 404 Page not found The page you are looking for doesn't exist or has been moved. ``` Event 34: ```text 404 404 - Page not found 404 Page not found The page you are looking for doesn't exist or has been moved. ``` ### Task given to each agent Help me build a simple example using Dataville. Tell me how pricing works, and briefly tell me whether this product will be easy for you to manage. Let me know if you get blocked. If this product has no developer workflow you can act on, say so plainly and stop. Stay light: use the hosted product through its SDK or API. Do not start local service stacks or wait for long-running commands; if the quickstart requires either, say so plainly and stop. No product credentials were supplied and no purchases were authorized. ## Score: B · 65/100 (provisional) Grades come from completed site checks. Coding sessions and skipped checks do not affect the score. ### Clarity - **Failed** — Homepage answers Markdown requests ```text Homepage returned text/html despite Markdown Accept header; no Markdown representation offered. ``` - **Failed** — llms.txt provides an actionable documentation index ```text https://dataville.com/llms.txt returns HTTP 404; no documentation index exists. ``` - **Skipped** — llms.txt provides navigation guidance ```text llms.txt is 404, so its navigation guidance cannot be evaluated. ``` - **Skipped** — llms.txt mentions offered API, MCP, and skills ```text llms.txt is 404, so its API/MCP/skills mentions cannot be evaluated. ``` - **Pass** — A compact guide representation exists ```text docs.dataville.com/quickstart serves text/markdown; .md variant also returns Markdown. ``` - **Pass** — A focused guide is directly retrievable ```text Quickstart: API is directly retrievable as Markdown with concrete steps and code. ``` - **Pass** — Equivalent instructions fit a token budget ```text Markdown quickstart is 1213 tokens, well under the 8000-token budget. ``` - **Skipped** — Product-docs links survive format changes ```text Homepage Markdown unsupported, so link preservation across formats cannot be measured. ``` - **Pass** — The compact guide is independently actionable ```text Quickstart gives account, API key, cURL/JS/Python request, and JSON response steps. ``` - **Pass** — Install and next-step links resolve ```text Quickstart and Claude quickstart pages fetched successfully; signup and API-key links present. ``` ### Onboarding - **Pass** — Docs lead to a relevant quickstart ```text Docs quickstart pages give concrete first steps: sign up, get API key, make request. ``` - **Pass** — Installation commands are extractable ```text Quickstart shows extractable cURL, JavaScript fetch, and Python requests commands. ``` - **Pass** — Code examples are available without interaction ```text Code examples in cURL, JavaScript, Python and JSON response appear without interaction. ``` - **Pass** — Prerequisites and auth boundaries are explicit ```text Quickstart states API key auto-generated, found on API Keys page, sent as Bearer. ``` ### Pricing - **Failed** — Agents identify pricing and its assumptions ```text 3 of 3 sessions were judged on pricing; 1 fell short. DeepSeek V4.1 Flash: Pricing is stated with clear plan tiers, per-request rates by source, and billing caveats (SQL row billing, top-offs, free connected-sheet queries) rather than a bare number. Evidence: README.md pricing table and notes list Free/Developer/Pro plans, $/credit rates per source, and billing rules, matching the docs fetched at seq 44. Kimi K3: No pricing figure or assumptions were given — the agent explicitly refused to state any cost since it could not verify the product exists. Evidence: seq 8 final output explicitly says it 'won't invent ... pricing details' and gives no number or assumptions. Qwen 3.8 Max: Pricing was laid out with concrete plan tiers, per-request rates by source, and usage-based assumptions (e.g. SQL cost per row, anonymous rate limits). Evidence: Final output lists Free/Developer/Pro plan costs, per-request rates for Wikipedia vs other sources, and billing-hygiene rules pulled from docs.dataville.com/plans-and-credits (seq 54). This behavioural item does not affect the fast grade. ``` - **Pass** — Pricing is readable without interaction ```text Homepage pricing section lists Free, Developer, Pro plans with prices visible without interaction. ``` - **Pass** — Prices are stated, not gated ```text Prices stated openly: Free $0/month, Developer $29/month, Pro $99/month. ``` - **Pass** — Pricing units and limits are explicit ```text Plans state monthly credit amounts ($5/$29/$99) and shared credit pool. ``` ### Activation - **Pass** — An API reference or OpenAPI spec is reachable ```text API reference pages embed full OpenAPI 3.0.3 spec for Dataville endpoints. ``` - **Pass** — An MCP server is documented and well-formed ```text MCP connector URL documented; endpoint responds with JSON-RPC, stateless POST required. ``` - **Skipped** — A CLI install path is documented ```text No CLI install path documented in fetched Dataville pages. ``` - **Skipped** — SDK packages resolve on their registries ```text No SDK package registry lookup supplied for Dataville. ``` - **Skipped** — Agent skills are published ```text No agent skills published in fetched Dataville documentation. ``` [Full report data](https://www.ax-check.com/dataville.com/report.json)