# AX Check: info.devpost.com Checked 2026-11-05. Devpost has no real pricing page, only a demo request form Agents could only infer pricing from site copy: free for hackathon participants, quote-based for organizers via sales contact. No pricing page exists to confirm figures. ## End-to-end onboarding not demonstrated ## Coding sessions All three independent sessions completed and described Devpost as free for hackathon participants with custom, sales-driven pricing for organizers. None found an actual pricing page; two noted pricing pages returned errors or were absent, so cost claims came from homepage copy rather than a verifiable source. ### DeepSeek V4.1 Flash [View public run](https://agents.withgauge.com/p/runs/b0663a9f-3742-45d4-af8e-790080cf32a7) ยท [Read transcript](https://www.ax-check.com/info.devpost.com/sessions/deepseek.json) Pricing given by plan type with its basis: public hackathons $0 (schema price 0), student-only free per site copy, private/employee/managed quote-based via Book a demo; noted no public pricing page (seq 34, seq 47, seq 26, seq 59) #### End-to-end onboarding - **End-to-end onboarding not demonstrated**: No credentials of any kind were obtained or used. Devpost exposes no public API, SDK, or docs (api.devpost.com, devpost.com/api, docs.devpost.com, developers.devpost.com all 404). The agent only read an undocumented, unauthenticated JSON endpoint (devpost.com/api/hackathons) that requires no login. No account was created, no API key was issued, and no authenticated write operation was performed, so self-service onboarding was never attempted or demonstrated. Event 57: ```text Open hackathons: 53 total, showing 4 - PayPal AI Hackathon (PayPal) ``` Event 19: ```text https://docs.devpost.com -> 404 https://developers.devpost.com -> 404 https://devpost.com/api/v1 -> 404 https://devpost.com/software/devpost-api -> 404 ``` #### Hallucinated URLs - **Guessed developer/docs subdomains that don't exist**: The agent probed several plausible but invented developer-facing URLs (docs.devpost.com, developers.devpost.com, devpost.com/api/v1, devpost.com/software/devpost-api, devpost.com/hackathons/new, info.devpost.com/host-a-hackathon, info.devpost.com/pricing) based on common SaaS URL conventions rather than any link found on the site. All returned 404, and there is no evidence these are broken documented links Devpost ever published -- they were pattern-guessed. Event 19: ```text https://docs.devpost.com -> 404 https://developers.devpost.com -> 404 https://devpost.com/api/v1 -> 404 https://devpost.com/software/devpost-api -> 404 ``` Event 48: ```text https://devpost.com/hackathons/new -> 404 https://devpost.com/hackathons/new https://info.devpost.com/host-a-hackathon -> 404 https://info.devpost.com/host-a-hackathon ``` #### Blockers - **No public API, SDK, or developer docs exist**: This is a product gap rather than agent error or a test-environment restriction: Devpost does not publish any official developer API, SDK, or docs site. The agent confirmed this by hitting every plausible endpoint and docs subdomain and getting 404s across the board. This prevented any authenticated or supported developer workflow; the only workaround was reading an undocumented internal JSON endpoint used by Devpost's own frontend. Event 11: ```text 200 --- 404 --- 404 ``` Event 19: ```text https://docs.devpost.com -> 404 https://developers.devpost.com -> 404 https://devpost.com/api/v1 -> 404 https://devpost.com/software/devpost-api -> 404 ``` - **No published pricing page**: Product behavior: Devpost has no dedicated, discoverable pricing page (info.devpost.com/pricing returns 404). Pricing information had to be inferred indirectly from marketing copy (free for public/student hackathons, 'Book a demo'/'Contact' for others), which is less reliable than an actual pricing page. Event 18: ```text ---pricing--- 404 ``` Event 26: ```text https://info.devpost.com/pricing/ -> 404 https://info.devpost.com/pricing ``` #### Suggested Changes - **Publish an official public API or SDK with docs**: Currently the only programmatic access is an undocumented endpoint (devpost.com/api/hackathons) that the agent discovered by guessing, not through any documentation. Add a docs.devpost.com or devpost.com/api page describing supported endpoints, auth, and rate limits. Verify by confirming docs.devpost.com or devpost.com/api returns a real page instead of 404. Event 19: ```text https://docs.devpost.com -> 404 https://developers.devpost.com -> 404 https://devpost.com/api/v1 -> 404 https://devpost.com/software/devpost-api -> 404 ``` - **Add a dedicated pricing page**: info.devpost.com/pricing currently 404s, forcing visitors to piece together cost info from scattered marketing copy ('Book a demo', 'free on Devpost'). Publish a pricing page at that URL or link one clearly from the main nav, and verify by loading info.devpost.com/pricing and confirming it returns 200 with plan details. Event 26: ```text https://info.devpost.com/pricing/ -> 404 https://info.devpost.com/pricing ``` Event 33: ```text Book a demo Student-run, student-only hackathons are free on Devpost. ``` ### Kimi K3 [View public run](https://agents.withgauge.com/p/runs/2fa4b06d-8b68-4e14-9775-0e2655581dc0) ยท [Read transcript](https://www.ax-check.com/info.devpost.com/sessions/kimi.json) Said Devpost is free for participants and that organizers get custom pricing through sales, but gave no cost figure or plan details and never fetched a pricing page to back the claim. (seq 16) #### End-to-end onboarding - **End-to-end onboarding not demonstrated**: The agent never attempted credential acquisition or an authenticated operation. It concluded early that Devpost has no public API/SDK and stopped without signing up, obtaining a key, or calling any hosted endpoint with credentials. Event 16: ```text No official public API or SDK. Devpost (the hackathon platform) offers no documented REST/GraphQL API, no API keys, and no official client libraries. ``` #### Hallucinated URLs None identified in this transcript. #### Blockers - **No public Devpost API or SDK found**: The agent probed devpost.com/api and PyPI for an official SDK and found nothing; the /api path returned 404 and no official package exists. This is product behavior (Devpost simply does not expose a documented API), not agent error or a missing-credential issue, since no credential flow was ever reached. Event 8: ```text 404 {"message": "Not Found"} ``` Event 16: ```text `https://devpost.com/api` returns 404, and PyPI has no official `devpost` package. ``` - **Only unofficial scrapers exist as alternatives**: GitHub search surfaced only third-party, unofficial scraping projects (e.g., ViRb3/devpost-api, thegu5/devpost-api) rather than a sanctioned developer path, so the agent judged building on these to be unreliable and out of scope for the task's 'use the hosted product through its SDK or API' constraint. Event 9: ```text "full_name": "ViRb3/devpost-api", "description": "๐Ÿ“œ An unofficial API for DevPost" ``` Event 16: ```text What exists on GitHub ... are unofficial screen-scrapers built by third parties. They're unmaintained, fragile, against the spirit of "use the hosted product through its SDK or API," ``` #### Suggested Changes - **Publish a documented public API or SDK for Devpost**: The agent found no official API endpoint (devpost.com/api returned 404) and no PyPI package, forcing reliance on unofficial scrapers. Add a documented REST/GraphQL API with an official client library and verify by confirming a request like GET https://devpost.com/api/ returns valid data instead of 404. Event 8: ```text 404 {"message": "Not Found"} ``` Event 16: ```text There's nothing to authenticate against, no endpoints to call, no quickstart to run. ``` ### Qwen 3.8 Max [View public run](https://agents.withgauge.com/p/runs/622b2515-768b-412e-9473-0c62f6923044) ยท [Read transcript](https://www.ax-check.com/info.devpost.com/sessions/qwen.json) Priced by role: free for participants and read-only use, quote-based for organizers since pricing pages return 404; the free community tier claim has no source (seq 18, seq 24, seq 48, seq 50) #### End-to-end onboarding - **End-to-end onboarding not demonstrated**: The agent never obtained or used real Devpost credentials. It only hit public, unauthenticated JSON endpoints (hackathon search and project gallery search) that require no login. It explicitly identified that write operations (registering, submitting, managing a hackathon) require a logged-in session or organizer account and did not attempt or obtain any such credentials. Event 28: ```text {'total_count': 31, 'per_page': 1, 'fuzzy': False} AI OpenBuild ``` Event 50: ```text Writes: no. Registering, submitting a project, judging, or managing a hackathon requires a logged-in session and an organizer account. There's no API token, no OAuth app, no documented write API I can act on. ``` #### Hallucinated URLs - **Guessed pricing and organizer pages that don't exist**: The agent probed several plausible-sounding URLs (devpost.com/pricing, manage.devpost.com/pricing, devpost.com/hackathons/manage, devpost.com/organizers, devpost.com/about, devpost.com/features) that all returned 404. These look like guesses based on common SaaS site conventions rather than links found in any Devpost documentation, and all failed, so they qualify as invented/guessed URLs that did not work. Event 18: ```text == https://devpost.com/pricing 404 https://devpost.com/pricing == https://www.devpost.com/pricing 404 https://devpost.com/pricing == https://devpost.com/hackathons/manage 404 https://devpost.com/hackathons/manage ``` Event 24: ```text == https://manage.devpost.com/pricing 404 https://manage.devpost.com/pricing == https://devpost.com/organizers 404 https://devpost.com/organizers ``` Event 48: ```text == https://devpost.com/about 404 https://devpost.com/about == https://devpost.com/features 404 https://devpost.com/features ``` #### Blockers - **No self-serve path to authenticated/write operations**: Devpost's management and account interfaces require a human login (manage.devpost.com redirects to a login page with email/password or OAuth-via-GitHub/Google/etc.), and there is no documented API token or OAuth app flow the agent could use to register, submit, or manage a hackathon programmatically. This is normal product behavior (an expected login wall for write/management actions), not an environment or agent error, and it was not overcome within the session. Event 23: ```text Log in to Devpost Log in with GitHub Log in with Facebook Log in with Google Log in with LinkedIn We'll never post without your permission. OR Email Password Forgot your password? Log in with email New to Devpost? Sign up for an account ``` Event 50: ```text Anything past read-only needs a human at a browser, plus a sales conversation for organizer access. ``` - **No published pricing information**: Devpost does not have a public pricing page; direct attempts to find one (devpost.com/pricing, manage.devpost.com/pricing) returned 404s, forcing the agent to infer pricing structure indirectly (free for participants, quote-based for organizers) rather than citing a documented source. This is a product content gap, not an agent or environment issue. Event 18: ```text == https://devpost.com/pricing 404 https://devpost.com/pricing ``` Event 24: ```text == https://manage.devpost.com/pricing 404 https://manage.devpost.com/pricing ``` #### Suggested Changes - **Publish a pricing page for organizer/enterprise hackathon hosting**: Direct requests to devpost.com/pricing and manage.devpost.com/pricing both 404'd, leaving no documented source for cost information. Add a public pricing or plans page (e.g. at devpost.com/pricing) describing the free participant tier and organizer/enterprise terms, and verify it by confirming the URL returns 200 with actual tier/cost details instead of a 404. Event 18: ```text == https://devpost.com/pricing 404 https://devpost.com/pricing ``` Event 24: ```text == https://manage.devpost.com/pricing 404 https://manage.devpost.com/pricing ``` - **Document the public hackathon/software search JSON endpoints**: The agent found and relied on undocumented endpoints (devpost.com/api/hackathons and devpost.com/software/search.json) by trial and error against guessed URL patterns. Publish official API documentation listing these endpoints, their query parameters, and response schema (e.g. under help.devpost.com or a dedicated /api/docs page) so developers do not need to reverse-engineer the frontend's network calls. Verify by confirming the documented parameters match the endpoint's actual accepted query string behavior. Event 17: ```text { "hackathons": [ { "id": 31302, "title": "PayPal AI Hackathon", ``` Event 32: ```text ['class_name', 'name', 'tagline', 'slug', 'url', 'members', 'tags', 'winner', 'photo', 'has_video', 'like_count', 'comment_count'] ``` ### Task given to each agent Help me build a simple example using Devpost. Tell me how pricing works, and briefly tell me whether this product will be easy for you to manage. Let me know if you get blocked. If this product has no developer workflow you can act on, say so plainly and stop. Stay light: use the hosted product through its SDK or API. Do not start local service stacks or wait for long-running commands; if the quickstart requires either, say so plainly and stop. No product credentials were supplied and no purchases were authorized. ## Score: C ยท 63/100 (provisional) Grades come from completed site checks. Coding sessions and skipped checks do not affect the score. ### Clarity - **Failed** โ€” Homepage answers Markdown requests ```text Homepage returned text/html for a text/markdown request; no Markdown representation offered. ``` - **Pass** โ€” llms.txt provides an actionable documentation index ```text llms.txt lists products, guides, research, case studies and company pages with descriptive links. ``` - **Pass** โ€” llms.txt provides navigation guidance ```text llms.txt groups links under clear headings and explains info.devpost.com vs devpost.com audiences. ``` - **Skipped** โ€” llms.txt mentions offered API, MCP, and skills ```text llms.txt describes hackathon products and guides but no API, MCP or skills offerings. ``` - **Pass** โ€” A compact guide representation exists ```text llms.txt is a compact Markdown guide covering products, guides, research and company info. ``` - **Pass** โ€” A focused guide is directly retrievable ```text llms.txt fetched directly at 200 as text/plain Markdown with organized sections. ``` - **Pass** โ€” Equivalent instructions fit a token budget ```text llms.txt measured 949 tokens, well under the 8000-token budget. ``` - **Skipped** โ€” Product-docs links survive format changes ```text Homepage Markdown unsupported, so link preservation across formats cannot be measured. ``` - **Skipped** โ€” The compact guide is independently actionable ```text No compact agent-specific guide was fetched; only llms.txt index and homepage links are available. ``` - **Skipped** โ€” Install and next-step links resolve ```text No install or next-step links were fetched, so their resolution cannot be judged. ``` ### Onboarding - **Skipped** โ€” Docs lead to a relevant quickstart ```text Only llms.txt fetched; no docs or quickstart pages retrieved to assess. ``` - **Skipped** โ€” Installation commands are extractable ```text No installation or setup pages fetched; llms.txt lists no install commands. ``` - **Skipped** โ€” Code examples are available without interaction ```text No documentation or code example pages were fetched for this product. ``` - **Skipped** โ€” Prerequisites and auth boundaries are explicit ```text No docs or API pages fetched; auth boundaries not observable in evidence. ``` ### Pricing - **Failed** โ€” Agents identify pricing and its assumptions ```text 3 of 3 sessions were judged on pricing; 1 fell short. DeepSeek V4.1 Flash: Pricing given by plan type with its basis: public hackathons $0 (schema price 0), student-only free per site copy, private/employee/managed quote-based via Book a demo; noted no public pricing page (seq 34, seq 47, seq 26, seq 59) Kimi K3: Said Devpost is free for participants and that organizers get custom pricing through sales, but gave no cost figure or plan details and never fetched a pricing page to back the claim. (seq 16) Qwen 3.8 Max: Priced by role: free for participants and read-only use, quote-based for organizers since pricing pages return 404; the free community tier claim has no source (seq 18, seq 24, seq 48, seq 50) This behavioural item does not affect the fast grade. ``` - **Skipped** โ€” Pricing is readable without interaction ```text No pricing page was fetched; homepage only offers 'Book a demo' with no prices. ``` - **Skipped** โ€” Prices are stated, not gated ```text No pricing page was fetched; homepage shows no stated prices or plans. ``` - **Skipped** โ€” Pricing units and limits are explicit ```text No pricing page was fetched, so units and limits cannot be assessed. ``` ### Activation - **Skipped** โ€” An API reference or OpenAPI spec is reachable ```text No API reference or OpenAPI spec appears in the fetched llms.txt or homepage evidence. ``` - **Skipped** โ€” An MCP server is documented and well-formed ```text No MCP server is documented in the fetched llms.txt content. ``` - **Skipped** โ€” A CLI install path is documented ```text No CLI install path is documented in the fetched llms.txt content. ``` - **Skipped** โ€” SDK packages resolve on their registries ```text No SDK or package registry evidence was fetched for Devpost. ``` - **Skipped** โ€” Agent skills are published ```text No agent skills are published in the fetched llms.txt content. ``` [Full report data](https://www.ax-check.com/info.devpost.com/report.json)