deepseek/deepseek-v4.1-flash-1017 run

OpenRouter · OpenRouter · every run of this model · uwu · 2026-11-12

Race this run Get the model from OpenRouter: deepseek/deepseek-v4.1-flash-1017

Run deepseek/deepseek-v4.1-flash-1017 on your computer to see the two side by side.

A fast run: 24 tasks, 24 points

Score
5,298 Gold Speed times the share of tasks, times 100. Platinum starts at 6,000: 60.0 tok/s with these answers. How scores work53 tok/s × 100% of tasks
  1. Bronze0
  2. Silver1,500
  3. Gold3,000
  4. Platinum6,000
  5. Diamond10,000

Not on the leaderboard: it ran through a hosted service, so it is not on a computer board. Leaderboard

Tasks passed
24/24
Tokens
8,7033,032 read, 5,671 written.
Speed
53 tok/sTokens a second, as the runner measured it. The site checks only that the machine could reach it. How speeds are checked

deepseek/deepseek-v4.1-flash-1017 through OpenRouter passed 24 of 24 tasks in 8.7k tokens at 53 tok/s, a Gold score of 5,298, in the resyn benchmark. https://resyn.cloud/suite/9e18a506e5bf115ff533b0ba3a99d889Compare another runComment

Run details
Model file
Not a listed file
Where it ran
OpenRouter
How
Run through the model's API, by OpenCode (resyn-bench 2)
Time
1 min 47 s
Settings
seed=42, temperature=0, top_p=1
Suite
resyn-tasks@6
Flag this run

Hides the run from public pages until an admin checks it.

Scored tasks

Summarizing 5 of 5
  • One-sentence summaryPassed

    315 tokens: 121 read, 194 written · 4 s · 48.7 tok/s

    Summarize this in one sentence of at most 30 words.
    
    Starting October 8, the Alderton Public Library will open at 6:45 a.m. instead of 10 a.m. on weekdays. The change follows a survey in which 69% of respondents asked for earlier hours. Weekend hours stay the same. The library will hire two part-time staff to cover the extra time, paid for by a grant from the city council.
    Starting October 8, Alderton Public Library will open weekdays at 6:45 a.m. instead of 10 a.m., funded by a city grant, while weekend hours remain unchanged.
  • Meeting notes in three bulletsPassed

    564 tokens: 193 read, 371 written · 6 s · 63.4 tok/s

    Summarize these meeting notes as exactly three bullet points, each at most 20 words. Keep only the decisions and ownership changes that matter. Output only the bullet points.
    
    Weekly sync, design team. Present: Oscar, Hugo, Lucas, Ivy.
    - Lucas reported that the payment provider fixed the export bug; no action needed.
    - The launch date moves from August 18 to August 23 because the supplier delivery slipped.
    - Ivy showed the new onboarding screens. Everyone liked them. Small copy changes only.
    - The marketing budget of $75,000 was approved by finance on Friday.
    - Oscar will own end-to-end testing from now on; Hugo hands over the test plan by Wednesday.
    - Next sync is moved to Monday at 14:30.
    - Coffee machine on floor 4 is broken again.
    - Launch date moved from August 18 to August 23 due to supplier delivery slip.
    - Finance approved $75,000 marketing budget on Friday.
    - Oscar now owns end-to-end testing; Hugo will hand over test plan by Wednesday.
  • Review sentiment and complaintPassed

    229 tokens: 138 read, 91 written · 3 s · 31.7 tok/s

    Read this product review and answer in exactly this format:
    Sentiment: <positive, negative or mixed>
    Complaint: <the main complaint in a few words>
    
    I've used this kettle every day for a month. Honestly, it is light enough to carry to the sink and it has never once tripped the fuse. But the seal that came in the box cracked after two weeks, and support took 12 days to reply. I bought a replacement seal myself. Would I buy it again? Probably, but I'm annoyed.
    Sentiment: mixed
    Complaint: seal cracked and slow support
  • Faithful summary of a studyPassed

    524 tokens: 147 read, 377 written · 3 s · 115 tok/s

    Summarize this in at most 50 words. Keep the key numbers. Do not add anything the text does not say.
    
    In a randomized trial, 230 adults with chronic migraine took either Peloxa or a placebo for 6 weeks. Those on Peloxa had 2.0 fewer headache days per month on average, compared with 1.2 fewer days for placebo. Fatigue was the most common side effect, reported by 11% of the drug group. The authors note the trial lasted only 6 weeks and call for longer studies before any recommendation is made.
    In a 6-week randomized trial of 230 adults with chronic migraine, Peloxa reduced headache days by 2.0 per month versus 1.2 with placebo. Fatigue was the most common side effect (11% on Peloxa). Authors call for longer studies before recommending it.
  • Action items from an email threadPassed

    404 tokens: 229 read, 175 written · 3 s · 67.2 tok/s

    List every action item in this email thread that someone has committed to do, as lines of the form "- <owner>: <action>". Leave out offers that were declined and things that turned out not to be needed. Output only the list.
    
    From: Eli
    Hi all, quick recap of what's still open for the autumn summit. I'll send the revised contract to the hotel by Sunday.
    
    From: Sam
    I can book the venue for the dinner if that helps?
    
    From: Laura
    Thanks Sam, but I'll book the venue myself since I already spoke to them. Also, no need to change the logo on the badges, it's fine as is.
    
    From: Bea
    I'll update the budget sheet with the new hotel price tonight.
    
    From: Eli
    Great. Oh, and I'll email the caterer about the vegetarian options. Sam, could you just double-check the date on the invitations? Actually never mind, I checked them this morning, they're correct.
    
    - Eli: send the revised contract to the hotel by Sunday
    - Laura: book the venue for the dinner
    - Bea: update the budget sheet with the new hotel price tonight
    - Eli: email the caterer about the vegetarian options
Extracting 5 of 5
  • Fields from an email as JSONPassed

    225 tokens: 141 read, 84 written · 2 s · 42 tok/s

    Extract these fields from the email as a JSON object with exactly these keys: "name" (the sender's full name), "company", "meeting_date" (YYYY-MM-DD) and "attendees" (a number). Output only the JSON.
    
    Hello! This is Hana Ibarra from Northwind Traders. We'd love to visit your workshop. Could we meet on the 14th of July 2025, any time after lunch? We'll be eight people in total, including me. Best, Hana
    {"name":"Hana Ibarra","company":"Northwind Traders","meeting_date":"2025-07-14","attendees":8}
  • Every email address, oncePassed

    348 tokens: 170 read, 178 written · 3 s · 64.5 tok/s

    List every email address written out in full in this text (like name@example.com), one per line, in the order they first appear, without duplicates. Leave out any inbox the text says is closed. Output only the addresses.
    
    Contacts for the conference: write to info@northfield-expo.org for general questions, or to speakers@northfield-expo.org if you are presenting. Our designer (oscar.s@studio-nine.io) made the poster. Billing questions: finance@northfield-expo.org. Again, presenters use speakers@northfield-expo.org. Please don't write to jo at northfield dot org, that inbox is closed.
    info@northfield-expo.org
    speakers@northfield-expo.org
    oscar.s@studio-nine.io
    finance@northfield-expo.org
  • A list as CSVPassed

    263 tokens: 115 read, 148 written · 4 s · 39.1 tok/s

    Convert this shopping list to CSV with the header row item,qty,price. Write prices as plain numbers without a currency sign. Output only the CSV.
    
    Oats (500 g) - 15 @ $5.70
    Bananas - 14 @ $5.00
    Cheddar (200 g) - 18 @ $4.25
    Rice (1 kg) - 20 @ $2.95
    item,qty,price
    Oats (500 g),15,5.70
    Bananas,14,5.00
    Cheddar (200 g),18,4.25
    Rice (1 kg),20,2.95
  • The real deadlinePassed

    161 tokens: 112 read, 49 written · 1 s · 36.8 tok/s

    What is the final submission deadline? Answer with the date only, in YYYY-MM-DD format.
    
    The call for papers opened on 4 January 2025. Drafts were originally due March 23, but the committee extended the final submission deadline to 27 March 2025. Reviews are due by 8 April, and results will be announced on May 2, 2025.
    2025-03-27
  • Warnings and errors from a logPassed

    431 tokens: 239 read, 192 written · 4 s · 45.7 tok/s

    From this log, return a JSON array with one object per WARN or ERROR line, in order, each with the keys "time" (HH:MM:SS), "level" and "message". Output only the JSON.
    
    2025-09-21 09:19:48 INFO  server started on port 8443
    2025-09-21 09:22:45 WARN  config key "max body" is deprecated
    2025-09-21 09:24:37 INFO  user hugo logged in
    2025-09-21 09:26:44 ERROR database connection lost
    2025-09-21 09:33:14 INFO  retrying in 10s
    2025-09-21 09:38:00 INFO  database reconnected
    2025-09-21 09:41:56 DEBUG cache hit ratio 0.96
    2025-09-21 09:42:25 ERROR payment webhook returned 503
    [
      {
        "time": "09:22:45",
        "level": "WARN",
        "message": "config key \"max body\" is deprecated"
      },
      {
        "time": "09:26:44",
        "level": "ERROR",
        "message": "database connection lost"
      },
      {
        "time": "09:42:25",
        "level": "ERROR",
        "message": "payment webhook returned 503"
      }
    ]
Following instructions 5 of 5
  • Exactly one wordPassed

    55 tokens: 40 read, 15 written · 2 s · 9.5 tok/s

    Reply with exactly the word Updated and nothing else.
    Updated
  • Three lowercase linesPassed

    418 tokens: 108 read, 310 written · 4 s · 83.3 tok/s

    Write exactly three lines about a lake. Use the word lake in every line. Start every line with the letter e, and do not use any of these words: lighthouse, pond, dune, island, bay, quarry, crater, city, kitchen or glacier. Every line must be entirely lowercase, and the third line must end with a question mark. Output only the three lines.
    evening light softens across the lake
    each ripple on the lake carries a quiet hush
    every shore around the lake holds a secret?
  • Exact JSON shapePassed

    232 tokens: 82 read, 150 written · 3 s · 44.9 tok/s

    Return a JSON object with exactly two keys: "words", a list of exactly 3 different lowercase words that each start with the letter x and use only the plain letters a to z, and "count", the number 3. Output only the JSON.
    {"words":["xylophone","xylem","xenon"],"count":3}
  • Sort a listPassed

    234 tokens: 63 read, 171 written · 3 s · 60.6 tok/s

    Sort these words alphabetically, ignoring case. Output only the sorted words, on one line separated by commas: Potato, Papaya, lemon, plum, pear.
    lemon, Papaya, pear, plum, Potato
  • A name with three rulesPassed

    320 tokens: 90 read, 230 written · 6 s · 37.3 tok/s

    Suggest a product name for a solar-powered charger. Rules: exactly two words, both capitalized, using only the plain letters A to Z, the first word starts with the letter W, the second word starts with the letter U, and the letter x must not appear anywhere. Output only the name.
    Watt Up
Reasoning 5 of 5
  • Unit pricePassed

    174 tokens: 70 read, 104 written · 4 s · 28.4 tok/s

    A shop sells pencils at 5 for $1.50. How much do 12 pencils cost, in dollars? Work it out, then end with a line "ANSWER: <number>".
    5 pencils cost $1.50, so each pencil costs $1.50 ÷ 5 = $0.30.
    
    12 pencils cost 12 × $0.30 = $3.60.
    
    ANSWER: 3.60
  • Day and datePassed

    526 tokens: 84 read, 442 written · 4 s · 98.5 tok/s

    Today is Wednesday, 16 September 2026. What day of the week, and what date, is it 184 days from today? Work it out, then end with a line "ANSWER: <day of the week>, <YYYY-MM-DD>".
    184 days after Wednesday, 16 September 2026 is Friday, 19 March 2027.
    
    ANSWER: Friday, 2027-03-19
  • Who owns each petPassed

    1,857 tokens: 219 read, 1,638 written · 15 s · 107 tok/s

    Five people, Fay, Cal, Hal, Ana and Lea, each own exactly one of these pets: a cat, a dog, a fish, a bird and a rabbit. Each pet has one owner. Clues:
    - Ana does not own the dog.
    - Lea does not own the bird.
    - Cal does not own the dog.
    - Hal does not own the cat.
    - Ana does not own the cat.
    - Hal owns the dog or the rabbit.
    - Cal does not own the rabbit.
    - Lea owns the bird or the rabbit.
    - Cal owns the cat or the bird.
    - Fay owns the dog or the fish.
    Who owns each pet? Work it out, then end with a line "ANSWER: <owner of the cat>, <owner of the dog>, <owner of the fish>, <owner of the bird>, <owner of the rabbit>", with the five names in that order, separated by commas.
    Lea must own the rabbit because she does not own the bird but owns either the bird or the rabbit.  
    Then Hal must own the dog, since the rabbit is taken.  
    Fay must own the fish, since she owns either the dog or the fish and the dog is taken.  
    Ana cannot own the cat, so she owns the bird.  
    Cal owns the remaining pet, the cat.
    
    ANSWER: Cal, Hal, Fay, Ana, Lea
  • Arrival timePassed

    165 tokens: 79 read, 86 written · 3 s · 30.1 tok/s

    A train leaves at 10:50 and the trip takes 3 hours 25 minutes. At what time does it arrive? Work it out, then end with a line "ANSWER: <HH:MM>" in 24-hour time.
    10:50 + 3 hours = 13:50  
    13:50 + 25 minutes = 14:15
    
    ANSWER: 14:15
  • Filling a tankPassed

    197 tokens: 101 read, 96 written · 3 s · 33.2 tok/s

    A tank holds 650 liters and starts empty. Pipe A adds 21 liters an hour, pipe B adds 23 liters an hour, and a drain takes 19 liters an hour out of it. With all three open, how many hours until the tank is full? Work it out, then end with a line "ANSWER: <number>".
    Net rate = 21 + 23 - 19 = 25 liters per hour.  
    Time to fill 650 liters = 650 ÷ 25 = 26 hours.
    
    ANSWER: 26
Reading code 4 of 4
  • What does it printPassed

    243 tokens: 98 read, 145 written · 4 s · 36.6 tok/s

    What numbers does this Python program print, in order? Work it out, then end with a line "ANSWER: <numbers, separated by commas>".
    
    def f(xs):
        return sorted(xs)[::-1][:2]
    
    print(f([14, 11, 23, 21, 10, 36]))
    ANSWER: 36, 23
  • Trace a loopPassed

    333 tokens: 108 read, 225 written · 18 s · 12.6 tok/s

    What does this Python program print? Work it out, then end with a line "ANSWER: <output>".
    
    def g(n):
        total = 0
        for i in range(1, n + 1):
            if i % 6 == 0 or i % 3 == 0:
                total += i
        return total
    
    print(g(105))
    The condition `i % 6 == 0 or i % 3 == 0` is equivalent to `i % 3 == 0`, since every multiple of 6 is already a multiple of 3.
    
    Multiples of 3 from 1 to 105 are \(3, 6, 9, \dots, 105\), which is \(3 \times (1 + 2 + \cdots + 35)\).
    
    \[
    3 \times \frac{35 \times 36}{2} = 3 \times 630 = 1890
    \]
    
    ANSWER: 1890
  • Find the bugPassed

    242 tokens: 130 read, 112 written · 3 s · 32.2 tok/s

    The function list_mean should return the mean of a non-empty list. The code below has one bug. Find the line with the bug, and write that line corrected, exactly as it should read in the code. Work it out, then end with a line "ANSWER: <corrected line>".
    
    def list_mean(readings):
        total = 0
        for x in readings:
            total += x
        count = len(readings) - 1
        return total / count
    The bug is subtracting 1 from the list length, which gives the wrong count for the mean.
    
    ANSWER: count = len(readings)
  • Run a query in your headPassed

    243 tokens: 155 read, 88 written · 2 s · 38.3 tok/s

    What rows does this SQL query return? Output only the rows, one per line, as customer,total in the query's order.
    
    Table orders:
    id | customer | amount
    1  | ben      | 50
    2  | ana      | 20
    3  | cal      | 15
    4  | cal      | 30
    5  | ben      | 125
    6  | ana      | 145
    
    Query:
    SELECT customer, SUM(amount) AS total
    FROM orders
    GROUP BY customer
    HAVING SUM(amount) > 100
    ORDER BY total DESC;
    ben,175
    ana,165

Comments

Sign in or create an account to comment.