Compare runs

Pick two or more runs to compare. deepseek/deepseek-v4.1-flash-1017 on OpenRouter is the first; add another below.

No other run of deepseek/deepseek-v4.1-flash-1017 to add yet.

The runs side by side: score, tasks passed, speed, tokens read and written, each category and each task
RunA check marks the best of each row.deepseek/deepseek-v4.1-flash-1017OpenRouter · OpenRouterRemove deepseek/deepseek-v4.1-flash-1017
Score5,298Gold
Tasks passed24 of 24
Speed53 tok/s
Tokens8,703
Summarizing5/5
One-sentence summaryPassed48.7 tok/s
Meeting notes in three bulletsPassed63.4 tok/s
Review sentiment and complaintPassed31.7 tok/s
Faithful summary of a studyPassed115 tok/s
Action items from an email threadPassed67.2 tok/s
Extracting5/5
Fields from an email as JSONPassed42 tok/s
Every email address, oncePassed64.5 tok/s
A list as CSVPassed39.1 tok/s
The real deadlinePassed36.8 tok/s
Warnings and errors from a logPassed45.7 tok/s
Following instructions5/5
Exactly one wordPassed9.5 tok/s
Three lowercase linesPassed83.3 tok/s
Exact JSON shapePassed44.9 tok/s
Sort a listPassed60.6 tok/s
A name with three rulesPassed37.3 tok/s
Reasoning5/5
Unit pricePassed28.4 tok/s
Day and datePassed98.5 tok/s
Who owns each petPassed107 tok/s
Arrival timePassed30.1 tok/s
Filling a tankPassed33.2 tok/s
Reading code4/4
What does it printPassed36.6 tok/s
Trace a loopPassed12.6 tok/s
Find the bugPassed32.2 tok/s
Run a query in your headPassed38.3 tok/s