Real production work, handed to the models unedited: the actual batches, the actual mess, the actual judgement calls. Every input here is a verbatim row from a system that runs — not a scenario written to look like one.
| Model | Translate video titles | Average |
|---|---|---|
1gemini-3.6-flash | 95excellent | 95excellent |
2solar-pro4 | 30bad | 30bad |
3nemotron-3.5-lightning | 10very bad | 10very bad |