Task pass rates
Passed out of the runs that answered.
| Task | Category | Points | Passed |
|---|---|---|---|
| One-sentence summary | Summarizing | 1 | |
| Meeting notes in three bullets | Summarizing | 1 | |
| Review sentiment and complaint | Summarizing | 1 | |
| Faithful summary of a study | Summarizing | 1 | |
| Action items from an email thread | Summarizing | 1 | |
| Fields from an email as JSON | Extracting | 1 | |
| Every email address, once | Extracting | 1 | |
| A list as CSV | Extracting | 1 | |
| The real deadline | Extracting | 1 | |
| Warnings and errors from a log | Extracting | 1 | |
| Exactly one word | Following instructions | 1 | |
| Three lowercase lines | Following instructions | 1 | |
| Exact JSON shape | Following instructions | 1 | |
| Sort a list | Following instructions | 1 | |
| A name with three rules | Following instructions | 1 | |
| Unit price | Reasoning | 1 | |
| Day and date | Reasoning | 1 | |
| Who owns each pet | Reasoning | 1 | |
| Arrival time | Reasoning | 1 | |
| Filling a tank | Reasoning | 1 | |
| What does it print | Reading code | 1 | |
| Trace a loop | Reading code | 1 | |
| Find the bug | Reading code | 1 | |
| Run a query in your head | Reading code | 1 | |
| Call one tool | Using tools | 1 | |
| Don't call a tool when none is needed | Using tools | 1 | |
| Two calls for two answers | Using tools | 1 | |
| Chain two tools | Using tools | 1 | |
| Handle a failed call honestly | Using tools | 1 | |
| A small website | Building pages | 1 | |
| A pricing table with a toggle | Building pages | 1 | |
| An accessible sign-up form | Building pages | 1 | |
| A to-do app that remembers | Building pages | 1 | |
| A bar chart in SVG | Building pages | 1 | |
| Build 2048 | Building games | 3 | |
| Build Snake | Building games | 3 | |
| Merge intervals | Writing code | 3 | |
| An LRU cache | Writing code | 3 | |
| Evaluate arithmetic | Writing code | 3 | |
| Fix the bookings module | Fixing code | 3 | |
| Fix the CSV reader | Fixing code | 3 | |
| A query over hidden data | Planning and data | 3 | |
| Schedule five meetings | Planning and data | 3 | |
| A replacement in ten calls or fewer | Planning and data | 3 | |
| Step sequencer | Building apps | 3 | |
| Box-pushing puzzle | Building games | 3 | |
| Minesweeper | Building games | 3 | |
| Grow a branching plant | Building apps | 3 | |
| Falling sand | Building apps | 3 | |
| Focus timer | Building apps | 3 |
Scrolls sideways to show every column.