Compare runs

Pick two or more runs to compare. Qwen3.5-0.8B-Autocomplete on an unnamed computer is the first; add another below.

Runs of the same model, or on the same computer, the newest first.

The runs side by side: score, tasks passed, speed, tokens generated, each category and each task
RunQwen3.5-0.8B-AutocompleteNo computer named · Ollama v262Take out Qwen3.5-0.8B-Autocomplete
Score—No score
Tasks passed13 of 44
Points13 of 64
Speed308 tok/s
Tokens33,077
Summarizing1/5
One-sentence summaryPassed263 tok/s
Meeting notes in three bulletsFailed299 tok/s
Review sentiment and complaintFailed315 tok/s
Faithful summary of a studyFailed276 tok/s
Action items from an email threadFailed272 tok/s
Extracting3/5
Fields from an email as JSONPassed321 tok/s
Every email address, onceNot run
A list as CSVPassed323 tok/s
The real deadlinePassed325 tok/s
Warnings and errors from a logFailed326 tok/s
Following instructions3/5
Exactly one wordPassed150 tok/s
Three lowercase linesFailed236 tok/s
Exact JSON shapePassed240 tok/s
Sort a listPassed320 tok/s
A name with three rulesFailed238 tok/s
Reasoning0/5
Unit priceNot run
Days of the weekNot run
Who owns the catNot run
Arrival timeNot run
Filling a tankNot run
Reading code1/4
What does it printNot run
Trace a loopNot run
Find the bugPassed287 tok/s
Run a query in your headNot run
Using tools5/5
Call one toolPassed306 tok/s
Don't call a tool when none is neededPassed325 tok/s
Two calls for two answersPassed321 tok/s
Chain two toolsPassed308 tok/s
Handle a failed call honestlyPassed308 tok/s
Building pages0/5
A small websiteFailed308 tok/s
A pricing table with a toggleFailed310 tok/s
An accessible sign-up formFailed303 tok/s
A to-do app that remembersFailed308 tok/s
A bar chart in SVGNot run
Building games0/2
Build 2048Not run
Build SnakeNot run
Writing code0/3
Merge intervalsNot run
An LRU cacheNot run
Evaluate arithmeticNot run
Fixing code0/2
Fix the bookings moduleNot run
Fix the CSV readerNot run
Planning and data0/3
A query over hidden dataNot run
Schedule five meetingsNot run
A replacement in ten calls or fewerNot run

A check marks the best of each row. tok/s is tokens a second: how fast the model writes. How the score works.