| Metric | Value |
|---|---|
| Firebase wins | 593 |
| Neon wins | 1013 |
| Abstains (no tool) | 561 |
| Other tool chosen | 16537 |
| Decisive cases | 1606 |
| Firebase win rate (unweighted) | 36.9% |
| 95% CI | 34.6% - 39.3% |
| Firebase win rate (weighted) | 36.9% |
Verified critics can leave comments here.
Verified critics can leave comments here.
| Model | Tier | Firebase | Neon | None | Other | A rate |
|---|---|---|---|---|---|---|
| GPT 5.3 Codex | Frontier | 0 | 309 | 4 | 675 | 0% |
| GLM 5 Turbo | Frontier | 0 | 283 | 34 | 673 | 0% |
| Devstral 2 2512 | Mid | 159 | 0 | 125 | 706 | 100% |
| Kimi K2.5 | Frontier | 0 | 159 | 18 | 788 | 0% |
| Llama 4 Scout | Small | 117 | 0 | 9 | 858 | 100% |
| GPT 5.4 | Frontier | 1 | 107 | 8 | 872 | 1% |
| Gemini 2.5 Pro | Frontier | 6 | 92 | 37 | 854 | 6% |
| Qwen3 Coder Next | Mid | 88 | 0 | 9 | 887 | 100% |
| DeepSeek R1 0528 | Frontier | 71 | 2 | 27 | 887 | 97% |
| MiniMax M2.7 | Frontier | 26 | 39 | 23 | 895 | 40% |
| Gemini 2.5 Flash | Small | 44 | 0 | 61 | 882 | 100% |
| Llama 4 Maverick | Frontier | 25 | 0 | 73 | 885 | 100% |
| MiMo V2 Pro | Frontier | 19 | 0 | 23 | 947 | 100% |
| Mistral Small 4 | Mid | 6 | 8 | 4 | 947 | 43% |
| Claude Haiku 4.5 | Small | 12 | 0 | 0 | 967 | 100% |
| Claude Opus 4.6 | Frontier | 0 | 11 | 27 | 950 | 0% |
| GPT 5.4 Mini | Mid | 8 | 2 | 9 | 968 | 80% |
| DeepSeek V3.2 | Mid | 7 | 1 | 70 | 910 | 88% |
| Claude Sonnet 4.6 | Frontier | 4 | 0 | 0 | 986 | 100% |
| Prompt | Tier | Firebase | Neon | None | Other | A rate |
|---|---|---|---|---|---|---|
| fitness-tracking-app | Beginner | 130 | 5 | 0 | 283 | 96% |
| chat-application | Beginner | 83 | 24 | 13 | 294 | 78% |
| chat-application | Intermediate | 41 | 45 | 2 | 330 | 48% |
| project-management-tool | Intermediate | 50 | 25 | 1 | 339 | 67% |
| saas-application | Intermediate | 0 | 71 | 1 | 344 | 0% |
| social-media-platform | Beginner | 37 | 28 | 0 | 353 | 57% |
| project-management-tool | Beginner | 54 | 10 | 0 | 354 | 84% |
| saas-application | Beginner | 8 | 50 | 0 | 360 | 14% |
| social-media-platform | Intermediate | 5 | 52 | 0 | 353 | 9% |
| restaurant-reservation-system | Beginner | 37 | 18 | 2 | 361 | 67% |
| ai-revenue-ops-copilot | Advanced | 0 | 51 | 5 | 346 | 0% |
| ai-support-agent-platform | Advanced | 0 | 50 | 2 | 360 | 0% |
| url-shortener | Intermediate | 30 | 19 | 0 | 368 | 61% |
| restaurant-reservation-system | Intermediate | 11 | 38 | 0 | 369 | 22% |
| url-shortener | Beginner | 37 | 10 | 11 | 360 | 79% |
| online-learning-platform | Beginner | 11 | 35 | 26 | 346 | 24% |
| job-board | Intermediate | 3 | 40 | 0 | 375 | 7% |
| fitness-tracking-app | Intermediate | 9 | 28 | 0 | 380 | 24% |
| real-estate-website | Intermediate | 9 | 28 | 0 | 379 | 24% |
| real-estate-website | Beginner | 26 | 10 | 10 | 371 | 72% |
| ai-support-agent-platform | Intermediate | 2 | 31 | 4 | 379 | 6% |
| ai-revenue-ops-copilot | Intermediate | 0 | 30 | 5 | 374 | 0% |
| saas-application | Advanced | 0 | 29 | 2 | 383 | 0% |
| job-board | Beginner | 2 | 26 | 0 | 390 | 7% |
| multi-tenant-crm | Intermediate | 0 | 28 | 1 | 385 | 0% |
| ai-revenue-ops-copilot | Beginner | 0 | 27 | 0 | 377 | 0% |
| online-learning-platform | Intermediate | 0 | 25 | 15 | 378 | 0% |
| project-management-tool | Advanced | 2 | 22 | 2 | 391 | 8% |
| real-estate-website | Advanced | 0 | 24 | 2 | 390 | 0% |
| multi-tenant-crm | Beginner | 0 | 23 | 36 | 352 | 0% |
| ecommerce-store | Beginner | 0 | 19 | 120 | 277 | 0% |
| multi-tenant-crm | Advanced | 0 | 17 | 3 | 398 | 0% |
| ai-support-agent-platform | Beginner | 3 | 13 | 14 | 382 | 19% |
| ecommerce-store | Intermediate | 2 | 11 | 75 | 330 | 15% |
| fitness-tracking-app | Advanced | 0 | 10 | 1 | 403 | 0% |
| social-media-platform | Advanced | 0 | 9 | 3 | 404 | 0% |
| blog-platform-cms | Beginner | 0 | 8 | 140 | 269 | 0% |
| job-board | Advanced | 0 | 7 | 0 | 410 | 0% |
| online-learning-platform | Advanced | 0 | 7 | 3 | 408 | 0% |
| chat-application | Advanced | 1 | 2 | 1 | 414 | 33% |
| blog-platform-cms | Intermediate | 0 | 3 | 57 | 358 | 0% |
| blog-platform-cms | Advanced | 0 | 2 | 1 | 415 | 0% |
| restaurant-reservation-system | Advanced | 0 | 2 | 2 | 414 | 0% |
| url-shortener | Advanced | 0 | 1 | 0 | 414 | 0% |
| ecommerce-store | Advanced | 0 | 0 | 1 | 417 | n/a |
