Compare runs
Pick two or more runs to compare. deepseek/deepseek-v4.1-flash-1017 on OpenRouter is the first; add another below.
No other run of deepseek/deepseek-v4.1-flash-1017 to add yet.
Scrolls sideways to show every run.
| RunA check marks the best of each row. | deepseek/deepseek-v4.1-flash-1017OpenRouter · OpenRouterRemove deepseek/deepseek-v4.1-flash-1017 |
|---|---|
| Score | 5,298Gold |
| Tasks passed | 24 of 24 |
| Speed | 53 tok/s |
| Tokens | 8,703 |
| Summarizing | 5/5 |
| One-sentence summary | Passed48.7 tok/s |
| Meeting notes in three bullets | Passed63.4 tok/s |
| Review sentiment and complaint | Passed31.7 tok/s |
| Faithful summary of a study | Passed115 tok/s |
| Action items from an email thread | Passed67.2 tok/s |
| Extracting | 5/5 |
| Fields from an email as JSON | Passed42 tok/s |
| Every email address, once | Passed64.5 tok/s |
| A list as CSV | Passed39.1 tok/s |
| The real deadline | Passed36.8 tok/s |
| Warnings and errors from a log | Passed45.7 tok/s |
| Following instructions | 5/5 |
| Exactly one word | Passed9.5 tok/s |
| Three lowercase lines | Passed83.3 tok/s |
| Exact JSON shape | Passed44.9 tok/s |
| Sort a list | Passed60.6 tok/s |
| A name with three rules | Passed37.3 tok/s |
| Reasoning | 5/5 |
| Unit price | Passed28.4 tok/s |
| Day and date | Passed98.5 tok/s |
| Who owns each pet | Passed107 tok/s |
| Arrival time | Passed30.1 tok/s |
| Filling a tank | Passed33.2 tok/s |
| Reading code | 4/4 |
| What does it print | Passed36.6 tok/s |
| Trace a loop | Passed12.6 tok/s |
| Find the bug | Passed32.2 tok/s |
| Run a query in your head | Passed38.3 tok/s |