Compare runs
Pick two or more runs to compare. OpenAI-gpt-oss-120b on M4 Max 128 GB is the first; add another below.
| Run | OpenAI-gpt-oss-120bM4 Max 128 GB · llama.cpp llama-swap (version not exposed)Take out OpenAI-gpt-oss-120b |
|---|---|
| Score | —No score |
| Tasks passed | 29 of 44 |
| Points | 49 of 64 |
| Speed | 75.9 tok/s |
| Tokens | 38,299 |
| Summarizing | 0/5 |
| One-sentence summary | Not run |
| Meeting notes in three bullets | Not run |
| Review sentiment and complaint | Not run |
| Faithful summary of a study | Not run |
| Action items from an email thread | Not run |
| Extracting | 0/5 |
| Fields from an email as JSON | Not run |
| Every email address, once | Not run |
| A list as CSV | Not run |
| The real deadline | Not run |
| Warnings and errors from a log | Not run |
| Following instructions | 0/5 |
| Exactly one word | Not run |
| Three lowercase lines | Not run |
| Exact JSON shape | Not run |
| Sort a list | Not run |
| A name with three rules | Not run |
| Reasoning | 5/5 |
| Unit price | Passed76.8 tok/s |
| Days of the week | Passed77.1 tok/s |
| Who owns the cat | Passed76.5 tok/s |
| Arrival time | Passed76 tok/s |
| Filling a tank | Passed76.5 tok/s |
| Reading code | 4/4 |
| What does it print | Passed76.8 tok/s |
| Trace a loop | Passed76.5 tok/s |
| Find the bug | Passed76.6 tok/s |
| Run a query in your head | Passed76.4 tok/s |
| Using tools | 5/5 |
| Call one tool | Passed76.5 tok/s |
| Don't call a tool when none is needed | Passed76.5 tok/s |
| Two calls for two answers | Passed76.7 tok/s |
| Chain two tools | Passed76.2 tok/s |
| Handle a failed call honestly | Passed76.4 tok/s |
| Building pages | 5/5 |
| A small website | Passed76.1 tok/s |
| A pricing table with a toggle | Passed76.3 tok/s |
| An accessible sign-up form | Passed76.3 tok/s |
| A to-do app that remembers | Passed76.3 tok/s |
| A bar chart in SVG | Passed76.3 tok/s |
| Building games | 2/2 |
| Build 2048 | Passed74.5 tok/s |
| Build Snake | Passed76.1 tok/s |
| Writing code | 3/3 |
| Merge intervals | Passed77.5 tok/s |
| An LRU cache | Passed77.1 tok/s |
| Evaluate arithmetic | Passed76.7 tok/s |
| Fixing code | 2/2 |
| Fix the bookings module | Passed76.2 tok/s |
| Fix the CSV reader | Passed76.1 tok/s |
| Planning and data | 3/3 |
| A query over hidden data | Passed76.3 tok/s |
| Schedule five meetings | Passed75.5 tok/s |
| A replacement in ten calls or fewer | Passed76 tok/s |
Scrolls sideways to show every run.
A check marks the best of each row. tok/s is tokens a second: how fast the model writes. How the score works.