Society
Tested
- Avg AIMAC Debt 7.50
- Avg Cost $0.14
- Models Tested 72
- Zero Debt 2
- Avg Violations 23.9
Insights for Society
- Common Issues: Elements must meet minimum color contrast ratio thresholds, Links must have discernible text, Images must have alternative text
- Category Difficulty: Rank #20 of 28 categories (based on average model performance)
- Real-World Comparison: The WebAIM Million audits accessibility across 1 million real websites annually. Using different automated tools, AI models showed 59.4% fewer detected issues than real Society websites (23.9 axe-core violations vs 59.0 WAVE errors).
Model Gallery
Click a screenshot to view the generated HTML page, or click the model name for detailed results and prompts.
Model Results
AIMAC Debt:The model's accessibility debt for this category (lower = better)
| lower = better | in usd | |||
|---|---|---|---|---|
| GPT 5.4 Mini | 0.00 | $0.03 | 0 | 0 |
| Ling 3.0 Flash | 0.00 | $0.0008 | 0 | 0 |
| Qwen3.8 Flash | 2.00 | $0.015 | 0 | 1 |
| GPT 6.1 Terra | 2.00 | $0.05 | 0 | 1 |
| GPT 6 Luna Pro | 2.66 | $0.014 | 0 | 2 |
| Inkling Small | 3.05 | $0.013 | 0 | 3 |
| GPT 6.1 Sol Pro | 3.05 | $0.37 | 0 | 3 |
| GPT 6.1 Terra Pro | 3.05 | $0.12 | 0 | 3 |
| GPT 6.1 Sol | 3.32 | $0.19 | 0 | 4 |
| GLM 5.3 Flash | 3.32 | $0.03 | 0 | 4 |
| Gemma 4 31B | 3.71 | $0.007 | 0 | 6 |
| GPT 6 Luna | 3.71 | $0.005 | 0 | 6 |
| Nemotron 3.5 Super VL | 3.71 | $0.005 | 0 | 6 |
| Step 3.7 Flash | 3.85 | $0.017 | 0 | 7 |
| gpt oss 120b | 3.98 | $0.004 | 0 | 8 |
| Inkling | 3.98 | $0.03 | 0 | 8 |
| Mistral Small 4 | 4.00 | $0.004 | 0 | 4 |
| Muse Glimmer 30B | 4.09 | $0.007 | 0 | 9 |
| GPT 6 Astra | 4.09 | $0.82 | 0 | 9 |
| GPT 6 Astra Pro | 4.09 | $1.94 | 0 | 9 |
| Claude Haiku 5.5 | 4.09 | $0.011 | 0 | 9 |
| Step 5 Preview | 4.09 | $0.07 | 0 | 9 |
| Beam 1.0 501B A23B | 4.28 | $0.015 | 0 | 11 |
| Hy4 | 4.37 | $0.025 | 0 | 12 |
| Nemotron 3.5 Lightning | 4.44 | $0.0012 | 0 | 13 |
| Grok 4.7 | 4.44 | $0.04 | 0 | 13 |
| DeepSeek V4.1 Flash 1017 | 4.44 | $0.008 | 0 | 13 |
| Qwen3.7 Plus | 4.51 | $0.025 | 0 | 14 |
| Muse Spark 1.3 | 4.85 | $0.06 | 0 | 20 |
| Ripple 65B Preview | 4.85 | $0.004 | 0 | 20 |
| Flint (free) | 5.05 | $0.00 | 0 | 4 |
| Nex N2.5 Mini | 5.06 | $0.004 | 0 | 25 |
| Particle 1 | 5.10 | $0.012 | 0 | 26 |
| DeepSeek V4 Pro 0813 | 5.14 | $0.09 | 0 | 27 |
| Qwen3.8 27B | 5.14 | $0.14 | 0 | 27 |
| Qwen3.8 Max (0902) | 5.14 | $0.18 | 0 | 27 |
| Kimi K3.1 Pro | 5.14 | $0.52 | 0 | 27 |
| Nex N2.6 | 5.14 | $0.007 | 0 | 27 |
| Kimi K2.7 Code | 5.27 | $0.13 | 0 | 31 |
| Qwen3 Coder Next | 5.30 | $0.008 | 0 | 32 |
| Mistral Large 4 | 5.36 | $0.25 | 0 | 34 |
| Claude Sonnet 5.5 | 5.56 | $0.25 | 0 | 42 |
| GLM 5.3 | 5.99 | $0.27 | 0 | 66 |
| Qwen3.8 2.4T A95B | 6.03 | $0.23 | 0 | 69 |
| Ember 1 | 6.05 | $0.66 | 0 | 70 |
| Claude Fable 5.2 | 6.70 | $1.72 | 0 | 18 |
| MiMo V2.6 Pro | 8.10 | $0.03 | 0 | 17 |
| Grok Build 0.1 | 8.19 | $0.04 | 0 | 14 |
| MiniMax M3.1 Flash | 8.44 | $0.024 | 0 | 39 |
| Claude Opus 5.5 | 9.09 | $0.46 | 1 | 9 |
| GLM 4.7 Flash | 9.28 | $0.003 | 1 | 11 |
| Gemma 4 26B A4B | 9.28 | $0.0015 | 1 | 11 |
| Codestral 2508 | 9.33 | $0.005 | 0 | 37 |
| Gemini 4 Carbon | 9.44 | $0.29 | 1 | 13 |
| Solar Pro 4 | 9.57 | $0.0025 | 0 | 29 |
| Seed 2.1 Turbo | 9.73 | $0.06 | 0 | 41 |
| Gemini 3.8 Flash | 10.10 | $0.08 | 1 | 26 |
| MiMo V2.6 Flash | 10.33 | $0.007 | 1 | 33 |
| Muse Ember | 10.91 | $0.012 | 1 | 61 |
| Nemotron 3 Ultra | 11.05 | $0.05 | 1 | 70 |
| Qwen3.8 Omni Flash | 11.19 | $0.023 | 0 | 234 |
| Mistral Medium 3.5 | 11.49 | $0.05 | 0 | 34 |
| Gemini 3.5 Flash Lite | 11.85 | $0.03 | 0 | 15 |
| Nova 2 Lite | 12.39 | $0.016 | 0 | 32 |
| LongCat 2.0 | 12.85 | $0.023 | 1 | 10 |
| Muse Spark Open | 14.02 | $0.06 | 2 | 31 |
| MiniMax M3 | 16.48 | $0.03 | 3 | 41 |
| Gemini 4 Hydrogen | 16.75 | $0.18 | 2 | 19 |
| Granite 4.2 8B | 17.30 | $0.0015 | 4 | 19 |
| Solar Mini 4 | 20.14 | $0.0016 | 4 | 10 |
| Gemini 4 Argon | 21.15 | $0.28 | 4 | 29 |
| Muse Wonder | 48.57 | $0.27 | 20 | 12 |