# AX Check: jetbrains.com
Checked 2026-09-19.

Agents can't find JetBrains docs or pricing without guessing
No documentation index exists and the homepage offers no agent-readable format, so pricing and setup details are largely unassessed or vague.

## Onboarding needs a login

## Coding sessions
Of three independent sessions, one did not complete. The other two gave pricing answers: one offered only vague generalities with no concrete figures, while the other listed specific per-product prices but flagged them as approximate and unverified against the live site.

### DeepSeek V4 Pro
[View public run](https://agents.withgauge.com/p/runs/92216eb6-3903-4c32-a440-41746fef60ef) · [Read transcript](https://www.ax-check.com/jetbrains.com/sessions/deepseek.json)

#### End-to-end onboarding
- **Onboarding needs a login**: The agent never obtained real developer credentials for any JetBrains product. It only ever hit YouTrack's public, unauthenticated REST API as an anonymous guest user, which permits read-only queries on JetBrains' own public bug tracker. When it tried a write operation (POST to create an issue) without a token, the API returned 403 Forbidden, confirming that a real account/token would be required to actually act on the product. No signup, API key generation, or OAuth flow was performed anywhere in the session.
  Event 159:

  ```text
  {"login":"guest","guest":true,"name":"guest","id":"11-1","$type":"Me"}
  ```
  Event 169:

  ```text
  === POST /api/issues without token (expect 401/403) ===
  HTTP/2 403 
  ```
  Event 169:

  ```text
  HTTP/2 403 
  server: nginx
  ```

#### Hallucinated URLs
- **Guessed JetBrains Space end-of-life blog URL returned 404**: The agent guessed a specific blog post URL about Space's discontinuation announcement without having seen it linked anywhere in the transcript, and the URL returned a 404. This is a plausible-looking but invented URL pattern (dated blog slug), distinguishable from an ambiguous broken-link case because the agent was fabricating a specific date and slug to test a hypothesis rather than following a discovered link.
  Event 32:

  ```text
  https://blog.jetbrains.com/space/2024/06/03/space-cloud-end-of-life/
  ```
  Event 33:

  ```text
  <title>404 Page Not Found</title>
  ```
- **Guessed YouTrack Cloud pricing/marketing URLs returned 404**: The agent tried several invented YouTrack marketing URLs (/youtrack/pricing/ and /youtrack/cloud/) that are reasonable guesses based on URL conventions but were not discovered via any link on a JetBrains page; both returned Error 404, while a sibling guess (/youtrack/features/) happened to resolve.
  Event 104:

  ```text
  === https://www.jetbrains.com/youtrack/pricing/ ===
  exit=0
  <title>Error 404</title>
  === https://www.jetbrains.com/youtrack/cloud/ ===
  exit=0
  <title>Error 404</title>
  ```

#### Blockers
- **JetBrains Space is discontinued, blocking the requested product**: The seed prompt asked to build an example using JetBrains, and the agent's first target (Space) turned out to be end-of-life: the official Space docs page includes a sunset banner stating the product and new subscriptions are no longer available. This is a product lifecycle fact, not an agent or environment error, and it forced a pivot to a different JetBrains product (YouTrack).
  Event 48:

  ```text
  Space and SpaceCode have been discontinued. New license subscriptions are no longer available.
  ```
- **No self-service way to get a real YouTrack account/token in this session**: After pivoting to YouTrack, the agent could only reach the public YouTrack REST API anonymously as a guest. It probed whether write access was possible without credentials (POST to create an issue) and got a 403 Forbidden, confirming that creating real data requires an authenticated account that this session had no way to provision on its own. This is a missing-credentials blocker inherent to the test environment/task setup, not a defect in YouTrack itself, since account creation normally requires a human-driven signup and email.
  Event 169:

  ```text
  HTTP/2 403 
  server: nginx
  ```
  Event 159:

  ```text
  {"login":"guest","guest":true,"name":"guest","id":"11-1","$type":"Me"}
  ```

#### Suggested Changes
- **Add a redirect from jetbrains.com/space to the discontinuation notice**: A direct fetch of https://www.jetbrains.com/space/ returns a normal-looking marketing page with no immediate indication the product is discontinued; the sunset banner is only visible on the getting-started docs page. Add a prominent banner or redirect on the main jetbrains.com/space marketing page itself (not just the docs subpage) so users evaluating the product for the first time see the end-of-life notice before spending time investigating pricing or SDK options. Verify by curling https://www.jetbrains.com/space/ and confirming the sunset text appears in the response.
  Event 16:

  ```text
  <link rel="preload" as="image" href="/_assets/rr/air-logo-DgnR2Kpo.svg"/>
  ```
  Event 48:

  ```text
  Space and SpaceCode have been discontinued. New license subscriptions are no longer available.
  ```
- **Publish a plain-text YouTrack Cloud pricing page instead of only embedded JSON**: Pricing figures for YouTrack Cloud are buried inside a large inline JSON blob (editions/incloudPlans) on the /youtrack/buy/ page rather than presented as readable text, forcing the agent to write a Python script to extract per-user monthly prices. Publish a simple pricing table (e.g., on /youtrack/buy/ or a dedicated /youtrack/pricing/ page, which currently 404s) with per-user/month figures in plain HTML text. Verify by fetching the page and confirming price figures like per-user monthly cost appear as visible text, not only inside a script tag's JSON.
  Event 141:

  ```text
  "incloudPlans": [{"shopTokenNew": "U:N:YTIUSGPR", "shopTokenUpgrade": "U:U:YTIUSGPR", "annual": "54.00", "pricePerMonth": "4.50"
  ```
  Event 104:

  ```text
  === https://www.jetbrains.com/youtrack/pricing/ ===
  exit=0
  <title>Error 404</title>
  ```

### Kimi K3
[View public run](https://agents.withgauge.com/p/runs/7d97bf2f-294b-4072-b230-0d5ad3b99977) · [Read transcript](https://www.ax-check.com/jetbrains.com/sessions/kimi.json)
Final output (seq 6) gives only vague generalities ('per-user subscription licensing with ~20%/yr continuity discounts... exact numbers vary per product') with no concrete figure and no named plan/region/machine-size/workload assumptions tied to a number.
#### End-to-end onboarding
- **End-to-end onboarding not demonstrated**: The agent never attempted to obtain or use any credentials. It stopped immediately after finding an empty repo, on the grounds that "JetBrains" is a vendor with many distinct products and not a single hosted SDK/API. No sign-up, token creation, or authenticated API call was attempted against any JetBrains product.
  Event 6:

  ```text
  There's no single "JetBrains" hosted SDK/API I can build an example against. They make many distinct products with very different developer workflows
  ```

#### Hallucinated URLs
None identified in this transcript.

#### Blockers
- **Ambiguous product scope halted work before any API attempt**: The agent treated "JetBrains" as too broad a target (IDEs, TeamCity, YouTrack, Space, Datalore, Qodana Cloud) and decided none could be acted on without the user specifying an exact product. This is an agent judgment call rather than a product or credential failure — it never tried any single JetBrains hosted API to see if it was reachable or would need only a token.
  Event 6:

  ```text
  The repo is empty, so there's no context pointing me at which one you mean.
  ```
  Event 6:

  ```text
  As stated ("JetBrains" alone), there is no developer workflow I can act on, so I'm stopping here.
  ```

#### Suggested Changes
- **Clarify which JetBrains product the quickstart prompt should target**: Since the session prompt only said "JetBrains" without naming a specific hosted product, the agent could not proceed. If a product-owner-authored quickstart or onboarding prompt is meant to be actionable, name a specific product with a hosted API (e.g., YouTrack Cloud or Qodana Cloud) up front so an agent does not stop at the vendor-selection step. Verify by rerunning the same prompt with a named product and confirming the agent proceeds to an actual API call.
  Event 6:

  ```text
  Tell me the specific product — ideally one with a hosted cloud instance and an API token you can provide — and I'll build a quick example against it.
  ```

### Qwen 3.8 Max
[View public run](https://agents.withgauge.com/p/runs/d7853178-5944-4722-b641-35d2d8f08cde) · [Read transcript](https://www.ax-check.com/jetbrains.com/sessions/qwen.json)
Final output lists per-product pricing (IDE individual vs org license, AI Pro per-user/month, YouTrack free tier + per-user) and flags it as 'approximate, as of my knowledge — verify at jetbrains.com/pricing', naming plan-tier assumptions.
#### End-to-end onboarding
- **End-to-end onboarding not demonstrated**: No credentials were obtained or used, and no authenticated operation occurred against any hosted JetBrains product. The agent found no JetBrains env vars/config, hit a DNS failure trying to reach api.jetbrains.team, and stopped without attempting sign-up or token retrieval.
  Event 4:

  ```text
  env | grep -iE "jetbrains|space|youtrack|jb_" ; ls -la /sandbox/repo ; ls ~/.config 2>/dev/null
  ```
  Event 12:

  ```text
  000
  exit: 6
  
  ```
  Event 14:

  ```text
  this sandbox has no JetBrains credentials (I checked env vars and config — nothing), and it has no network egress (DNS resolution fails for `api.jetbrains.team`)
  ```

#### Hallucinated URLs
None identified in this transcript.

#### Blockers
- **No network egress to reach JetBrains hosted APIs**: The sandbox environment could not resolve/connect to JetBrains' hosted API domain, so even a credentialed attempt at Space/YouTrack/TeamCity APIs was impossible. This is a test-environment limitation (no network egress), not a product defect.
  Event 8:

  ```text
  exit: 0
  
  ```
  Event 12:

  ```text
  000
  exit: 6
  
  ```
- **No JetBrains credentials present in sandbox**: The agent checked environment variables and config directories for any JetBrains/Space/YouTrack tokens and found none, meaning no self-service or human-supplied credential path was available in this session. This is a missing-credentials blocker rather than a product issue.
  Event 4:

  ```text
  total 16
  drwxr-xr-x 3 root root 4096 Sep 18 08:00 .
  drwxr-xr-x 7 root root 4096 Sep 19 05:20 ..
  drwxr-xr-x 8 root root 4096 Sep 18 08:00 .git
  -rw-r--r-- 1 root root  408 Sep 18 08:00 .gitignore
  
  
  Command exited with code 2
  ```
- **JetBrains framed as primarily desktop IDEs with no headless workflow**: The agent concluded that 'JetBrains' as a brand is mostly local GUI IDE software with no hosted SDK/API it could drive headlessly, distinguishing this from JetBrains' separate hosted products (Space, YouTrack, TeamCity). This is an agent judgment call about product scope rather than a demonstrated product defect.
  Event 14:

  ```text
  "JetBrains" is primarily a family of desktop IDEs (IntelliJ IDEA, PyCharm, WebStorm…) — local GUI software with no hosted API/SDK I can drive headlessly.
  ```

#### Suggested Changes
None identified in this transcript.

### Task given to each agent
Help me build a simple example using JetBrains. Tell me how pricing works, and briefly tell me whether this product will be easy for you to manage. Let me know if you get blocked. If this product has no developer workflow you can act on, say so plainly and stop. Stay light: use the hosted product through its SDK or API. Do not start local service stacks or wait for long-running commands; if the quickstart requires either, say so plainly and stop.

No product credentials were supplied and no purchases were authorized.

## Score: F · 0/100 (provisional)
Grades come from completed site checks. Coding sessions and skipped checks do not affect the score.

### Clarity
- **Failed** — Homepage answers Markdown requests

  ```text
  Homepage returned text/html despite text/markdown Accept header; no Markdown representation offered.
  ```

- **Failed** — llms.txt provides an actionable documentation index

  ```text
  https://www.jetbrains.com/llms.txt returns HTTP 404; no documentation index exists.
  ```

- **Skipped** — llms.txt provides navigation guidance

  ```text
  llms.txt is 404, so no navigation guidance could be evaluated.
  ```

- **Skipped** — llms.txt mentions offered API, MCP, and skills

  ```text
  llms.txt is 404, so no API, MCP, or skills mentions could be evaluated.
  ```

- **Skipped** — A compact guide representation exists

  ```text
  No compact guide representation was fetched; only homepage and a 404 llms.txt.
  ```

- **Skipped** — A focused guide is directly retrievable

  ```text
  No focused guide page was fetched to assess direct retrievability.
  ```

- **Skipped** — Equivalent instructions fit a token budget

  ```text
  No guide content was fetched, so token budget cannot be measured.
  ```

- **Skipped** — Product-docs links survive format changes

  ```text
  Homepage Markdown unsupported, so link preservation across formats is unassessed.
  ```

- **Skipped** — The compact guide is independently actionable

  ```text
  No compact agent guide was fetched; only the homepage and a 404 llms.txt were retrieved.
  ```

- **Skipped** — Install and next-step links resolve

  ```text
  No install or next-step pages were fetched, so their link resolution cannot be judged.
  ```


### Onboarding
- **Skipped** — Docs lead to a relevant quickstart

  ```text
  No docs or quickstart pages were fetched; only a 404 llms.txt was retrieved.
  ```

- **Skipped** — Installation commands are extractable

  ```text
  No installation or CLI guide pages were fetched for JetBrains.
  ```

- **Skipped** — Code examples are available without interaction

  ```text
  No documentation pages with code examples were fetched.
  ```

- **Skipped** — Prerequisites and auth boundaries are explicit

  ```text
  No docs pages describing prerequisites or auth boundaries were fetched.
  ```


### Pricing
- **Failed** — Agents identify pricing and its assumptions

  ```text
  2 of 3 sessions were judged on pricing; 1 fell short. Kimi K3: Final output (seq 6) gives only vague generalities ('per-user subscription licensing with ~20%/yr continuity discounts... exact numbers vary per product') with no concrete figure and no named plan/region/machine-size/workload assumptions tied to a number. Qwen 3.8 Max: Final output lists per-product pricing (IDE individual vs org license, AI Pro per-user/month, YouTrack free tier + per-user) and flags it as 'approximate, as of my knowledge — verify at jetbrains.com/pricing', naming plan-tier assumptions. This behavioural item does not affect the fast grade.
  ```

- **Skipped** — Pricing is readable without interaction

  ```text
  Only the homepage was fetched; no JetBrains pricing page content was retrieved.
  ```

- **Skipped** — Prices are stated, not gated

  ```text
  No pricing page fetched; homepage only links to /store/ without stating prices.
  ```

- **Skipped** — Pricing units and limits are explicit

  ```text
  No pricing page fetched, so units and limits could not be observed.
  ```


### Activation
- **Skipped** — An API reference or OpenAPI spec is reachable

  ```text
  No API reference or OpenAPI spec was fetched; only a 404 llms.txt page is available.
  ```

- **Skipped** — An MCP server is documented and well-formed

  ```text
  No MCP server documentation was fetched in the supplied evidence.
  ```

- **Skipped** — A CLI install path is documented

  ```text
  No CLI install path documentation was fetched in the supplied evidence.
  ```

- **Skipped** — SDK packages resolve on their registries

  ```text
  No SDK package registry lookup was supplied for any JetBrains developer package.
  ```

- **Skipped** — Agent skills are published

  ```text
  No agent skills documentation was fetched in the supplied evidence.
  ```



[Full report data](https://www.ax-check.com/jetbrains.com/report.json)