Compare runs

Pick two or more runs to compare. Qwen3.5-0.8B-Autocomplete on an unnamed computer is the first; add another below.

Runs of the same model, or on the same computer, the newest first.

The runs side by side: score, tasks passed, speed, tokens generated, each category and each task
RunQwen3.5-0.8B-AutocompleteNo computer named · Ollama v262Take out Qwen3.5-0.8B-Autocomplete
Score—No score
Tasks passed13 of 44
Points13 of 64
Speed308 tok/s
Tokens33,077
Summarizing1/5
One-sentence summaryPassed155 tok/s
Meeting notes in three bulletsFailed292 tok/s
Review sentiment and complaintFailed320 tok/s
Faithful summary of a studyFailed277 tok/s
Action items from an email threadFailed268 tok/s
Extracting3/5
Fields from an email as JSONPassed316 tok/s
Every email address, onceNot run
A list as CSVPassed323 tok/s
The real deadlinePassed317 tok/s
Warnings and errors from a logFailed328 tok/s
Following instructions3/5
Exactly one wordPassed144 tok/s
Three lowercase linesFailed234 tok/s
Exact JSON shapePassed236 tok/s
Sort a listPassed310 tok/s
A name with three rulesFailed225 tok/s
Reasoning0/5
Unit priceNot run
Days of the weekNot run
Who owns the catNot run
Arrival timeNot run
Filling a tankNot run
Reading code1/4
What does it printNot run
Trace a loopNot run
Find the bugPassed285 tok/s
Run a query in your headNot run
Using tools5/5
Call one toolPassed309 tok/s
Don't call a tool when none is neededPassed318 tok/s
Two calls for two answersPassed308 tok/s
Chain two toolsPassed266 tok/s
Handle a failed call honestlyPassed249 tok/s
Building pages0/5
A small websiteFailed312 tok/s
A pricing table with a toggleFailed311 tok/s
An accessible sign-up formFailed300 tok/s
A to-do app that remembersFailed308 tok/s
A bar chart in SVGNot run
Building games0/2
Build 2048Not run
Build SnakeNot run
Writing code0/3
Merge intervalsNot run
An LRU cacheNot run
Evaluate arithmeticNot run
Fixing code0/2
Fix the bookings moduleNot run
Fix the CSV readerNot run
Planning and data0/3
A query over hidden dataNot run
Schedule five meetingsNot run
A replacement in ten calls or fewerNot run

A check marks the best of each row. tok/s is tokens a second: how fast the model writes. How the score works.