Compare runs
Pick two or more runs to compare. nvidia/nemotron-3-ultra-550b-a55b:free on OpenRouter is the first; add another below.
No other run of nvidia/nemotron-3-ultra-550b-a55b:free to add yet.
Scrolls sideways to show every run.
| RunA check marks the best of each row. | nvidia/nemotron-3-ultra-550b-a55b:freeOpenRouter · OpenCode 2.2.7Remove nvidia/nemotron-3-ultra-550b-a55b:free |
|---|---|
| Score | 3,453Gold |
| Tasks passed | 42 of 50 |
| Points | 64 of 82 |
| Speed | 44.2 tok/s |
| Tokens | 111,352 |
| Summarizing | 4/5 |
| One-sentence summary | Passed49.4 tok/s |
| Meeting notes in three bullets | Failed58.5 tok/s |
| Review sentiment and complaint | Passed51.9 tok/s |
| Faithful summary of a study | Passed55.9 tok/s |
| Action items from an email thread | Passed23.3 tok/s |
| Extracting | 5/5 |
| Fields from an email as JSON | Passed39.7 tok/s |
| Every email address, once | Passed43.6 tok/s |
| A list as CSV | Passed61.2 tok/s |
| The real deadline | Passed19.3 tok/s |
| Warnings and errors from a log | Passed61.2 tok/s |
| Following instructions | 5/5 |
| Exactly one word | Passed15.1 tok/s |
| Three lowercase lines | Passed35 tok/s |
| Exact JSON shape | Passed47.7 tok/s |
| Sort a list | Passed20.5 tok/s |
| A name with three rules | Passed41.3 tok/s |
| Reasoning | 5/5 |
| Unit price | Passed56.8 tok/s |
| Day and date | Passed39.8 tok/s |
| Who owns each pet | Passed39.7 tok/s |
| Arrival time | Passed42.5 tok/s |
| Filling a tank | Passed64.2 tok/s |
| Reading code | 4/4 |
| What does it print | Passed51.1 tok/s |
| Trace a loop | Passed39.9 tok/s |
| Find the bug | Passed39.6 tok/s |
| Run a query in your head | Passed30.2 tok/s |
| Using tools | 4/5 |
| Call one tool | Passed37 tok/s |
| Don't call a tool when none is needed | Passed36.4 tok/s |
| Two calls for two answers | Failed49.8 tok/s |
| Chain two tools | Passed36.5 tok/s |
| Handle a failed call honestly | Passed28 tok/s |
| Building pages | 4/5 |
| A small website | Passed34.3 tok/s |
| A pricing table with a toggle | Failed3.4 tok/s |
| An accessible sign-up form | Passed78.1 tok/s |
| A to-do app that remembers | Passed48.5 tok/s |
| A bar chart in SVG | Passed72.4 tok/s |
| Building games | 1/4 |
| Build 2048 | Failed57.4 tok/s |
| Build Snake | Failed57.8 tok/s |
| Box-pushing puzzle | Passed36.5 tok/s |
| Minesweeper | Failed51.1 tok/s |
| Building apps | 2/4 |
| Step sequencer | Failed44.5 tok/s |
| Grow a branching plant | Failed3.9 tok/s |
| Falling sand | Passed60.7 tok/s |
| Focus timer | Passed46.5 tok/s |
| Writing code | 3/3 |
| Merge intervals | Passed67.3 tok/s |
| An LRU cache | Passed35.9 tok/s |
| Evaluate arithmetic | Passed45.9 tok/s |
| Fixing code | 2/2 |
| Fix the bookings module | Passed48.5 tok/s |
| Fix the CSV reader | Passed21.8 tok/s |
| Planning and data | 3/3 |
| A query over hidden data | Passed33 tok/s |
| Schedule five meetings | Passed42.8 tok/s |
| A replacement in ten calls or fewer | Passed38.1 tok/s |