# AX Check: saucelabs.com Checked 2026-10-30. Sauce Labs docs, pricing, and setup are clear and agent-ready 20 of 23 checks passed: quickstarts, CLI/API/MCP install paths, and plan prices ($39-$199/mo) are all stated plainly without login walls. ## Onboarding needs a login ## Coding sessions All three independent agent sessions completed the pricing task. Each found stated plan prices without hitting a login wall; two cited exact figures from the pricing page, while one recalled approximate figures from memory and flagged them as unverified. ### DeepSeek V4.1 Flash [View public run](https://agents.withgauge.com/p/runs/69476802-9565-427e-aab9-5266b20cd437) · [Read transcript](https://www.ax-check.com/saucelabs.com/sessions/deepseek.json) Quoted prices by plan, per parallel test per month, with annual vs monthly rates and how cost scales with parallel tests. Figures match the fetched pricing page. One small unsupported claim: extra snapshots are metered. (seq 17, seq 63, README.md) #### End-to-end onboarding - **Onboarding needs a login**: The agent never obtained real Sauce Labs credentials. It confirmed no SAUCE env vars existed, could not sign up for an account from the sandbox, and explicitly stated it has no account and cannot create one. It only exercised the public, unauthenticated status endpoint (no auth, no resource created) and verified that both missing and dummy credentials produce failures (missing creds error locally; dummy creds return 401 from the real API). No authenticated operation against the hosted product was ever completed. Event 7: ```text no sauce env vars ``` Event 51: ```text us-west-1 OPERATIONAL wait_time=0.319s Basic service status checks passed. ``` Event 56: ```text 401 Unauthorized: check SAUCE_USERNAME / SAUCE_ACCESS_KEY and SAUCE_REGION. ``` Event 63: ```text I have no account and cannot create one (signup requires a browser/email, and this is a paid product). ``` #### Hallucinated URLs None identified in this transcript. #### Blockers - **No self-serve way to obtain Sauce Labs API credentials**: Every authenticated REST endpoint (whoami, jobs) requires SAUCE_USERNAME and SAUCE_ACCESS_KEY from an existing paid or trial account. The sandbox had no credentials and no way to create an account (would require a browser-based signup/email flow), so the agent could only test the public, unauthenticated status endpoint. This is a session/environment limitation tied to normal account-gated API access, not a product defect. Event 56: ```text Missing credentials. Set SAUCE_USERNAME and SAUCE_ACCESS_KEY (from Sauce Labs > User Settings). Sign up for a free trial at https://saucelabs.com/sign-up to get them. ``` Event 63: ```text The only blocker is access: Sauce Labs has no anonymous/free API tier, and I cannot create an account or obtain credentials from this environment. ``` #### Suggested Changes - **Fix the broken API Testing quickstart doc link**: A direct curl to https://docs.saucelabs.com/api-testing/quickstart/ returned a 404 while other docs pages (dev/api, dev/cli/saucectl, playwright quickstart) returned 200. Check whether this page was moved or removed, and if it's still a valid topic, restore or redirect the link so it resolves with a 200. Event 27: ```text == https://docs.saucelabs.com/api-testing/quickstart/ -> 404 == ``` ### Kimi K3 [View public run](https://agents.withgauge.com/p/runs/1a227306-143d-46fa-92ba-57d4de44ea4f) · [Read transcript](https://www.ax-check.com/saucelabs.com/sessions/kimi.json) Priced it by concurrency: about $50/mo per parallel session on annual billing, about $39/mo for Live, plus a 14-day trial and a free Open Sauce tier; figures from memory, with a note to check the pricing page (seq 27) #### End-to-end onboarding - **Onboarding needs a login**: Agent never obtained Sauce Labs credentials. It checked the sandbox environment for SAUCE_USERNAME/SAUCE_ACCESS_KEY, found none, and confirmed via live API calls that authenticated endpoints return 401. It wrote an example script but never executed it against the real product, stopping explicitly due to missing credentials. Event 6: ```text PI_CODING_AGENT=true PI_REASONING_LEVEL=medium... ``` Event 17: ```text {"detail":"Authorization failed"} HTTP 401 ``` Event 19: ```text The sandbox has no `SAUCE_USERNAME` / `SAUCE_ACCESS_KEY` (or any Sauce API token). ``` Event 27: ```text **Blocker to unblock me:** provide `SAUCE_USERNAME` and `SAUCE_ACCESS_KEY` (from a trial or paid account), and I can run the example end-to-end ``` #### Hallucinated URLs None identified in this transcript. #### Blockers - **No Sauce Labs credentials available in sandbox**: The test environment had no SAUCE_USERNAME or SAUCE_ACCESS_KEY set, and there was no self-service way to obtain them. The agent confirmed the hosted API was live (200 on public status/platform endpoints) but authenticated endpoints (users, webdriver sessions) returned 401. This is a missing-credentials limitation of the test setup, not a product defect, since Sauce Labs requires standard account credentials by design. Event 6: ```text PI_CODING_AGENT=true PI_REASONING_LEVEL=medium PI_SESSION_FILE=... ``` Event 17: ```text {"detail":"Authorization failed"} HTTP 401 ``` Event 19: ```text Without an account's access key I can't actually execute a test on Sauce's cloud, so I've stopped short of running anything. ``` #### Suggested Changes - **Add a free trial signup link directly in API 401 error response**: When hitting https://api.us-west-1.saucelabs.com/rest/v1.1/users/someuser without valid credentials, the API returns a bare {"detail":"Authorization failed"} with no pointer to how to obtain credentials. Including a signup/trial URL in the 401 body would let a new developer self-serve credentials instead of stalling. Verify by re-running the same curl against that endpoint without auth and checking the response body includes a usable link. Event 17: ```text {"detail":"Authorization failed"} HTTP 401 ``` ### Qwen 3.8 Max [View public run](https://agents.withgauge.com/p/runs/9b1bdf89-6921-4473-88a6-1d6170c54f54) · [Read transcript](https://www.ax-check.com/saucelabs.com/sessions/qwen.json) Quoted small plans at about $30–50/month, mid plans $150+, enterprise custom, plus a trial. Basis: parallel sessions and minutes; real devices cost more. Figures marked unchecked. (seq 33, seq 32) #### End-to-end onboarding - **Onboarding needs a login**: The agent never obtained Sauce Labs credentials on its own. It checked the environment for existing credentials, found none, and built a local example script that exits immediately with an error message whenever it is run, since SAUCE_USERNAME/SAUCE_ACCESS_KEY are required and absent. No authenticated call to the Sauce Labs hosted grid was ever made. Event 4: ```text env | grep -iE 'sauce|SAUCE' ; echo "---"; ls ~/.netrc 2>/dev/null; git -C /sandbox/repo log --oneline | head -5 ``` Event 8: ```text Where I'll be blocked:** actually *executing* a test requires a Sauce Labs account (username + access key). I don't have credentials, so I can build and syntax-check the example, but can't run it end-to-end against their grid. ``` Event 26: ```text Missing SAUCE_USERNAME / SAUCE_ACCESS_KEY. Get them at: https://app.saucelabs.com/user/settings/access-keys exit=1 ``` Event 33: ```text I **can't execute it end-to-end**: Sauce Labs requires an account (`SAUCE_USERNAME` + `SAUCE_ACCESS_KEY`) and none exist in this environment. Give me trial credentials and I can run it for real; otherwise it's ready for you to run with `npm run test:sauce`. ``` #### Hallucinated URLs None identified in this transcript. #### Blockers - **No Sauce Labs account credentials available**: The sandbox had no SAUCE_USERNAME or SAUCE_ACCESS_KEY, and there is no self-service way shown in-session to create a Sauce Labs account or generate keys without a human. This is a credentials/environment limitation, not a product defect — Sauce Labs legitimately requires an account to run cloud-grid tests. The agent correctly stopped rather than faking a run. Event 4: ```text env | grep -iE 'sauce|SAUCE' ; echo "---"; ls ~/.netrc 2>/dev/null; git -C /sandbox/repo log --oneline | head -5 ``` Event 26: ```text Missing SAUCE_USERNAME / SAUCE_ACCESS_KEY. Get them at: https://app.saucelabs.com/user/settings/access-keys exit=1 ``` Event 33: ```text I **can't execute it end-to-end**: Sauce Labs requires an account (`SAUCE_USERNAME` + `SAUCE_ACCESS_KEY`) and none exist in this environment. ``` #### Suggested Changes None identified in this transcript. ### Task given to each agent Help me build a simple example using Sauce Labs. Tell me how pricing works, and briefly tell me whether this product will be easy for you to manage. Let me know if you get blocked. If this product has no developer workflow you can act on, say so plainly and stop. Stay light: use the hosted product through its SDK or API. Do not start local service stacks or wait for long-running commands; if the quickstart requires either, say so plainly and stop. No product credentials were supplied and no purchases were authorized. ## Score: B · 84/100 (provisional) Grades come from completed site checks. Coding sessions and skipped checks do not affect the score. ### Clarity - **Failed** — Homepage answers Markdown requests ```text Homepage returned text/html for a text/markdown request; no Markdown representation offered. ``` - **Pass** — llms.txt provides an actionable documentation index ```text llms.txt links docs, quickstarts, API, CLI, MCP and pricing with organized sections. ``` - **Pass** — llms.txt provides navigation guidance ```text llms.txt groups Products, Use Cases, Getting Started and Documentation with descriptive guidance. ``` - **Pass** — llms.txt mentions offered API, MCP, and skills ```text llms.txt mentions REST API, saucectl CLI, and the sauce-api-mcp MCP server. ``` - **Pass** — A compact guide representation exists ```text llms.txt is a compact Markdown guide covering products, pricing, MCP, quickstarts and docs. ``` - **Pass** — A focused guide is directly retrievable ```text llms.txt fetched directly at saucelabs.com/llms.txt as text/plain Markdown. ``` - **Pass** — Equivalent instructions fit a token budget ```text llms.txt is 1377 tokens, well under the 8000-token budget. ``` - **Skipped** — Product-docs links survive format changes ```text Homepage Markdown unsupported, so link preservation across formats cannot be measured. ``` - **Pass** — The compact guide is independently actionable ```text llms.txt quickstart section gives concrete steps: clone demo repo, set credentials, run first test. ``` - **Pass** — Install and next-step links resolve ```text Selenium quickstart and docs, API, CLI, MCP links all fetched successfully. ``` ### Onboarding - **Pass** — Docs lead to a relevant quickstart ```text llms.txt links framework-specific quickstarts; Selenium quickstart gives concrete first steps and demo repo. ``` - **Pass** — Installation commands are extractable ```text saucectl page lists extractable install commands: npm install -g saucectl, brew, curl, PowerShell. ``` - **Pass** — Code examples are available without interaction ```text Quickstart and CLI pages show inline code blocks and commands without interaction. ``` - **Pass** — Prerequisites and auth boundaries are explicit ```text Quickstart and saucectl list account, SAUCE_USERNAME and SAUCE_ACCESS_KEY prerequisites with settings link. ``` ### Pricing - **Pass** — Pricing is readable without interaction ```text Pricing page renders plan cards with prices directly in fetched HTML, no interaction needed. ``` - **Pass** — Prices are stated, not gated ```text Live Testing $39/mo, Virtual Device Cloud $149/mo, Real Device Cloud $199/mo stated openly. ``` - **Pass** — Pricing units and limits are explicit ```text Plans list per-month pricing, parallel test counts, and included limits like 500 snapshots. ``` - **Pass** — Agents identify pricing and its assumptions ```text 3 of 3 sessions were judged on pricing; 0 fell short. DeepSeek V4.1 Flash: Quoted prices by plan, per parallel test per month, with annual vs monthly rates and how cost scales with parallel tests. Figures match the fetched pricing page. One small unsupported claim: extra snapshots are metered. (seq 17, seq 63, README.md) Kimi K3: Priced it by concurrency: about $50/mo per parallel session on annual billing, about $39/mo for Live, plus a 14-day trial and a free Open Sauce tier; figures from memory, with a note to check the pricing page (seq 27) Qwen 3.8 Max: Quoted small plans at about $30–50/month, mid plans $150+, enterprise custom, plus a trial. Basis: parallel sessions and minutes; real devices cost more. Figures marked unchecked. (seq 33, seq 32) This behavioural item does not affect the fast grade. ``` ### Activation - **Pass** — An API reference or OpenAPI spec is reachable ```text Sauce REST API reference documents base URLs, auth, versioning, and endpoints. ``` - **Pass** — An MCP server is documented and well-formed ```text Official MCP server documented: pip install, two servers, env vars, client configs. ``` - **Pass** — A CLI install path is documented ```text saucectl CLI install documented via npm, Homebrew, curl, and PowerShell. ``` - **Pass** — SDK packages resolve on their registries ```text PyPI registry lookup for sauce-api-mcp returned HTTP 200; npm saucectl also 200. ``` - **Skipped** — Agent skills are published ```text No agent skills surface found in fetched Sauce Labs documents. ``` [Full report data](https://www.ax-check.com/saucelabs.com/report.json)