Compare runs

Pick two or more runs to compare. Qwen3.8-Flash-Next on M4 Max 128 GB is the first; add another below.

The runs side by side: score, tasks passed, speed, tokens read and written, each category and each task
RunA check marks the best of each row.Qwen3.8-Flash-NextM4 Max 128 GB · llama.cppRemove Qwen3.8-Flash-Next
Score2,312Silver
Tasks passed49 of 50
Points79 of 82
Speed24 tok/s
Tokens528,551
Summarizing5/5
One-sentence summaryPassed22.8 tok/s
Meeting notes in three bulletsPassed26.4 tok/s
Review sentiment and complaintPassed25.6 tok/s
Faithful summary of a studyPassed29.8 tok/s
Action items from an email threadPassed28.2 tok/s
Extracting5/5
Fields from an email as JSONPassed29.8 tok/s
Every email address, oncePassed31.8 tok/s
A list as CSVPassed35 tok/s
The real deadlinePassed25.6 tok/s
Warnings and errors from a logPassed27.9 tok/s
Following instructions5/5
Exactly one wordPassed24.4 tok/s
Three lowercase linesPassed31.5 tok/s
Exact JSON shapePassed29.4 tok/s
Sort a listPassed27.7 tok/s
A name with three rulesPassed30.8 tok/s
Reasoning5/5
Unit pricePassed25.1 tok/s
Day and datePassed24.5 tok/s
Who owns each petPassed32.6 tok/s
Arrival timePassed19.3 tok/s
Filling a tankPassed27 tok/s
Reading code4/4
What does it printPassed25.9 tok/s
Trace a loopPassed26.9 tok/s
Find the bugPassed28.9 tok/s
Run a query in your headPassed22.5 tok/s
Using tools5/5
Call one toolPassed28.2 tok/s
Don't call a tool when none is neededPassed28.2 tok/s
Two calls for two answersPassed30.9 tok/s
Chain two toolsPassed30.6 tok/s
Handle a failed call honestlyPassed25.8 tok/s
Building pages5/5
A small websitePassed27.5 tok/s
A pricing table with a togglePassed30.1 tok/s
An accessible sign-up formPassed30.3 tok/s
A to-do app that remembersPassed20.6 tok/s
A bar chart in SVGPassed29.1 tok/s
Building games4/4
Build 2048Passed23.5 tok/s
Build SnakePassed28.7 tok/s
Box-pushing puzzlePassed18 tok/s
MinesweeperPassed26.4 tok/s
Building apps3/4
Step sequencerFailed22 tok/s
Grow a branching plantPassed25.5 tok/s
Falling sandPassed25.6 tok/s
Focus timerPassed23.9 tok/s
Writing code3/3
Merge intervalsPassed33.9 tok/s
An LRU cachePassed28.8 tok/s
Evaluate arithmeticPassed26.9 tok/s
Fixing code2/2
Fix the bookings modulePassed33.4 tok/s
Fix the CSV readerPassed33.5 tok/s
Planning and data3/3
A query over hidden dataPassed32.5 tok/s
Schedule five meetingsPassed30.1 tok/s
A replacement in ten calls or fewerPassed34.1 tok/s