Compare runs

Pick two or more runs to compare. Qwen3.5-0.8B-Autocomplete on an unnamed computer is the first; add another below.

Runs of the same model, or on the same computer, the newest first.

The runs side by side: score, tasks passed, speed, tokens generated, each category and each task
RunQwen3.5-0.8B-AutocompleteNo computer named · Ollama v262Take out Qwen3.5-0.8B-Autocomplete
Score—No score
Tasks passed13 of 44
Points13 of 64
Speed309 tok/s
Tokens33,077
Summarizing1/5
One-sentence summaryPassed191 tok/s
Meeting notes in three bulletsFailed279 tok/s
Review sentiment and complaintFailed317 tok/s
Faithful summary of a studyFailed275 tok/s
Action items from an email threadFailed260 tok/s
Extracting3/5
Fields from an email as JSONPassed321 tok/s
Every email address, onceNot run
A list as CSVPassed319 tok/s
The real deadlinePassed314 tok/s
Warnings and errors from a logFailed327 tok/s
Following instructions3/5
Exactly one wordPassed145 tok/s
Three lowercase linesFailed228 tok/s
Exact JSON shapePassed236 tok/s
Sort a listPassed317 tok/s
A name with three rulesFailed221 tok/s
Reasoning0/5
Unit priceNot run
Days of the weekNot run
Who owns the catNot run
Arrival timeNot run
Filling a tankNot run
Reading code1/4
What does it printNot run
Trace a loopNot run
Find the bugPassed284 tok/s
Run a query in your headNot run
Using tools5/5
Call one toolPassed308 tok/s
Don't call a tool when none is neededPassed323 tok/s
Two calls for two answersPassed318 tok/s
Chain two toolsPassed309 tok/s
Handle a failed call honestlyPassed304 tok/s
Building pages0/5
A small websiteFailed311 tok/s
A pricing table with a toggleFailed311 tok/s
An accessible sign-up formFailed301 tok/s
A to-do app that remembersFailed307 tok/s
A bar chart in SVGNot run
Building games0/2
Build 2048Not run
Build SnakeNot run
Writing code0/3
Merge intervalsNot run
An LRU cacheNot run
Evaluate arithmeticNot run
Fixing code0/2
Fix the bookings moduleNot run
Fix the CSV readerNot run
Planning and data0/3
A query over hidden dataNot run
Schedule five meetingsNot run
A replacement in ten calls or fewerNot run

A check marks the best of each row. tok/s is tokens a second: how fast the model writes. How the score works.