| Metric | Value |
|---|---|
| Amazon SNS wins | 132 |
| Resend wins | 153 |
| Abstains (no tool) | 86 |
| Other tool chosen | 4151 |
| Decisive cases | 285 |
| Amazon SNS win rate (unweighted) | 46.3% |
| 95% CI | 40.6% - 52.1% |
| Amazon SNS win rate (weighted) | 46.3% |
Verified critics can leave comments here.
BEIt's crazy how much taste and craft matter. I used SendGrid for 10 years and always hated having to check their API docs or log in to the web app to change an email template. I've been using Resend for a year now, and I always notice how happy I am to do something there. Honestly, not just happy — I feel excited about it. And we're talking about email APIs here... You can feel the attention to detail.
| Model | Tier | Amazon SNS | Resend | None | Other | A rate |
|---|---|---|---|---|---|---|
| DeepSeek V3.2 | Mid | 0 | 44 | 12 | 182 | 0% |
| Gemini 2.5 Flash | Small | 36 | 0 | 6 | 197 | 100% |
| MiMo V2 Pro | Frontier | 31 | 1 | 4 | 204 | 97% |
| Mistral Small 4 | Mid | 0 | 27 | 0 | 209 | 0% |
| Claude Haiku 4.5 | Small | 25 | 1 | 0 | 206 | 96% |
| Claude Sonnet 4.6 | Frontier | 0 | 21 | 0 | 219 | 0% |
| GPT 5.4 Mini | Mid | 5 | 13 | 6 | 214 | 28% |
| Gemini 2.5 Pro | Frontier | 1 | 16 | 2 | 217 | 6% |
| Devstral 2 2512 | Mid | 12 | 0 | 0 | 225 | 100% |
| GLM 5 Turbo | Frontier | 0 | 10 | 13 | 217 | 0% |
| Claude Opus 4.6 | Frontier | 4 | 5 | 0 | 231 | 44% |
| GPT 5.4 | Frontier | 0 | 9 | 0 | 231 | 0% |
| GPT 5.3 Codex | Frontier | 7 | 0 | 0 | 233 | 100% |
| Llama 4 Scout | Small | 6 | 0 | 3 | 227 | 100% |
| MiniMax M2.7 | Frontier | 2 | 4 | 13 | 215 | 33% |
| DeepSeek R1 0528 | Frontier | 3 | 1 | 19 | 215 | 75% |
| Kimi K2.5 | Frontier | 0 | 1 | 7 | 230 | 0% |
| Llama 4 Maverick | Frontier | 0 | 0 | 1 | 239 | n/a |
| Qwen3 Coder Next | Mid | 0 | 0 | 0 | 240 | n/a |
| Prompt | Tier | Amazon SNS | Resend | None | Other | A rate |
|---|---|---|---|---|---|---|
| project-management-tool | Beginner | 1 | 64 | 19 | 295 | 2% |
| project-management-tool | Advanced | 27 | 37 | 4 | 303 | 42% |
| social-media-platform | Advanced | 60 | 2 | 3 | 312 | 97% |
| project-management-tool | Intermediate | 0 | 43 | 12 | 316 | 0% |
| chat-application | Advanced | 27 | 1 | 6 | 344 | 96% |
| chat-application | Intermediate | 11 | 0 | 3 | 365 | 100% |
| social-media-platform | Beginner | 3 | 3 | 6 | 368 | 50% |
| social-media-platform | Intermediate | 1 | 2 | 0 | 375 | 33% |
| restaurant-reservation-system | Advanced | 2 | 0 | 16 | 358 | 100% |
| chat-application | Beginner | 0 | 1 | 12 | 362 | 0% |
| restaurant-reservation-system | Beginner | 0 | 0 | 3 | 375 | n/a |
| restaurant-reservation-system | Intermediate | 0 | 0 | 2 | 378 | n/a |
