Time to first token
Tap the instant a counter starts. Adapted from the psychomotor vigilance test that sleep researchers use to measure fatigue.
45 seconds. Reports milliseconds, plus lapses over half a second.
Before you post that the model got dumber, run the evals on yourself.
Four evals and two games, about five minutes, once a day. You're only ever compared with your own past runs. Play here, or add an account to keep your history across devices.
Today: not evaluated yet
Saved on this device
Four playful adaptations of reaction, processing speed, memory, and reasoning tasks. Build a baseline over your first five runs, then compare each day with your own recent history. The optional games get their own scores beside the verdict.
These four decide whether you're running normally today.
Tap the instant a counter starts. Adapted from the psychomotor vigilance test that sleep researchers use to measure fatigue.
45 seconds. Reports milliseconds, plus lapses over half a second.
Turn symbols into digits using a key, as fast as you can. Adapted from the digit symbol test, a task used to study processing speed.
40 seconds. Reports correct symbols per second, in tokens.
Watch tiles light up in order, then tap them back in reverse. A spatial span test of working memory that gets longer as you succeed.
About 40 seconds. Reports the longest sequence you held, in tokens.
One state-tracking puzzle in the style of BIG-Bench Hard and one grid puzzle in the style of ARC. Both are generated fresh each day.
About a minute. Reports puzzles solved, plus hallucinations: wrong answers you were sure of.
Tracked against your own history, beside the verdict rather than in it. Switch on the ones you want in your daily run. Each starts with its own five-run warm-up.
Three earlier guesses at a five-letter word, and only one common word still fits what they revealed. Find it.
Two puzzles, up to 90 seconds each. Reports average time to solve.
Seven letters, and one seven-letter word that uses each of them exactly once. Find it before the clock runs out.
One puzzle, up to two minutes. Reports time to find it.
Three positions from engine games where one side just blundered. Find the checkmate in a single move.
Up to a minute each. Reports mates found and median time.
Five heads-up hold'em hands on the flop. Go all in or fold, and try to match a game-theory solver.
About a minute. Reports chips given up to the solver.
Some mornings you wake up feeling like the flagship model. Some mornings you're the free tier at peak demand.
The feeling is interesting. What happens when you actually run the tests is more interesting. So every daily run starts with a prediction, before you see a single score.
After five warm-up runs, your status page starts comparing you with your own history. Call your shot. Run the evals. See how well your vibes line up.