WebSearch-SimpleQA-20 — query-by-query report

Companion to claim 4472330d. 20 SimpleQA-style questions hand-derived from the Hacker News front page on 2026-05-04, scored by recall@10 against a hand-coded ground-truth substring per query. APIs reached via the KrabArena Battle proxy.

Leaderboard

ranksolutionrecall@10hitsmedian msp95 ms
1you_com90.0%18/2010271114
2exa85.0%17/2013741768
3tavily80.0%16/2012732067
4keenable65.0%13/20527629

✓ = expected substring found in top-10 results. ✗ = miss. yellow = matched substring inside the result snippet.

Per-query analysis

Q01 news How much did GameStop offer to acquire eBay in May 2026? expects: “55.5”
APIverdictlatencytop-relevant resultmatched / top snippet
you_com✓ rank 11091 msGameStop makes $55.5bn takeover offer for eBay…much bigger rival to Amazon. Video game retailer GameStop has made a surprise $55.5bn (£40.9bn) offer to buy e-commerce giant eBay. GameStop's chief executive, Rya…
exa✓ rank 21400 msGameStop makes daring bid for eBay, hoping to rival Amazon | CNN Business…acebook Tweet Email Link Threads Link Copied! GameStop wants to buy eBay for $55.5bn to create a 'legit competitor to Amazon.' EBay's headquarters in San Jose, Ca…
tavily✓ rank 21413 msGameStop makes $55.5bn takeover offer for eBay - The Guardian…rn eBay into something worth hundreds of billions of dollars. # GameStop makes $55.5bn takeover offer for eBay. Video game retailer’s CEO warns that unsolicited bid…
keenable✓ rank 0705 msGameStop Submits Ambitious $56 Billion Acquisition Bid for eBayGameStop Corp. has submitted a non-binding bid to acquire eBay for $55.5 billion to $56 billion. GameStop Submits Ambitious $56 Billion Acquisition Bid…
Q02 news What is the maximum prison term given to the 2026 Taiwan TSMC industrial spies? expects: “10 years”
APIverdictlatencytop-relevant resultmatched / top snippet
you_com✓ rank 01065 msTaiwan court hands down jail terms in TSMC trade secrets case | ...Ex-Tokyo Electron employee sentenced to 10 years, four other defendants receive between 10 months and six years. Chen Wei-chieh,…
exa✓ rank 01199 msEx-worker of Tokyo Electron gets 10-year jail term in TSMC trade ...…ts, opens new tab - Summary - Companies - Ex-TSMC, Tokyo Electron worker gets 10 years' jail - Taiwan court fines Tokyo Electron unit T$150 million - Stolen TSMC se
tavily✓ rank 01270 msOffenders sentenced up to 10 years for spying on TSMC - Taipei Times…aiwan Semiconductor Manufacturing Co (TSMC, 台積電) engineer has been sentenced to 10 years in prison for his role in leaking trade secrets involving the company’s advance…
keenable✓ rank 0583 ms《TAIPEI TIMES》Offenders sentenced up to 10 years for spying on TSMCLEAKING TRADE SECRETS:Chen Li-ming, who previously worked in a yield engineering unit at TSMC, joined Tokyo Electron Taiwan’s marketing division after leaving t…
Q03 news By what percentage did European heat pump sales rise in Q1 2026? expects: “17”
APIverdictlatencytop-relevant resultmatched / top snippet
you_com✓ rank 0994 msHeat pump sales rise 17% across Europe in Q1 as energy prices surge ...Residential heat pump sales increased 17% across 11 European countries in the first quarter of 2026, following a sharp r…
exa✓ rank 21429 msHeat pump sales rise 17% across Europe in Q1 as energy prices surge# Heat pump sales rise 17% across Europe in Q1 as energy prices surge – pv magazine International Publis…
tavily✓ rank 01411 msHeat pump sales rise 17% across Europe in Q1 as energy prices surge – pv magazine InternationalResidential heat pump sales increased 17% across 11 European countries in the first quarter of 2026, following a sharp r…
keenable✓ rank 0512 msHeat pump sales rise 17% across Europe in Q1 as energy prices surge – pv magazine International - EuropeResidential heat pump sales increased 17% across 11 European countries in the first quarter of 2026, following a sharp r…
Q04 news Which May-2026 TechCrunch story revealed US healthcare marketplaces shared sensitive data with ad tech? expects: “citizenship”
APIverdictlatencytop-relevant resultmatched / top snippet
you_com✓ rank 01004 msUS healthcare marketplaces shared citizenship and race data with ...Virginia and Washington D.C. paused the data collection and sharing, after Bloomberg's investigation found their health insurance marketplaces were sharing user…
exa✓ rank 01332 msUS healthcare marketplaces shared citizenship and race data with ad tech giants# US healthcare marketplaces shared citizenship and race data with ad tech giants | TechCrunch Published: 2026-05-04T14:30:23+…
tavily✓ rank 02067 msUS healthcare marketplaces shared citizenship and race data with ...Almost all of the 20 U.S. state government-run health insurance marketplaces shared residents' application information with advertising and
keenable✗ miss556 msdata breach | TechCrunchRead the latest news about data breach on TechCrunch Change Healthcare stolen patient data leaked by ransomware gang Thi…
Q05 technical How many lines of Ruby did Stripe format overnight using rubyfmt? expects: “25 million”
APIverdictlatencytop-relevant resultmatched / top snippet
you_com✓ rank 01000 msFormatting an entire 25 million line codebase overnight: the rubyfmt ...This is the story of how our Developer Productivity team extended and rolled out rubyfmt, our Rust-based zero-config, ultra-fast autoformatter across the world'…
exa✗ miss1335 ms.rubocop.yml at master · stripe/stripe-ruby# File: stripe/stripe-ruby/.rubocop.yml - Repository: stripe/stripe-ruby | Ruby library for the Stripe API. | 2K stars…
tavily✗ miss1188 msIf you are wondering how Stripe could even start with just 7 lines of ...If you are wondering how Stripe could even start with just 7 lines of code, it's a bit misleading: With Stripe, all a st…
keenable✗ miss524 msGitHub - fables-tales/rubyfmt: Ruby Autoformatter!Ruby Autoformatter! Contribute to fables-tales/rubyfmt development by creating an account on GitHub. ...Line Command Des…
Q06 technical What latency goal does OpenAI's 2026 voice-AI scaling post emphasize? expects: “low-latency”
APIverdictlatencytop-relevant resultmatched / top snippet
you_com✓ rank 0991 msHow OpenAI delivers low-latency voice AI at scale | OpenAIHow OpenAI rebuilt its WebRTC stack to power real-time Voice AI with low latency, global scale, and seamless conversational turn-taking.
exa✓ rank 91348 msElevenLabs vs OpenAI TTS vs Deepgram Aura 2026 | APIScout…ng. OpenAI TTS for simplicity and ecosystem. Deepgram Aura for production-grade low-latency at scale. ElevenLabs produces the most natural-sounding speech and is the only…
tavily✓ rank 61351 msHow to Use AI Voice Agents for Customer Support: Low-Latency ...# How to Use AI Voice Agents for Customer Support: Low-Latency Models Explained. Low-latency voice models like Grok Voice ThinkFast enable rea…
keenable✓ rank 0551 msOpenAI's Voice AI: Breaking Latency Barriers…ChatGPT, Claude, Perplexity, Gemini, and tier-1 media. OpenAI’s work on OpenAI low-latency voice AI aims to eliminate these friction points for ChatGPT voice, developers…
Q07 technical What proof-of-work algorithm does Monero use? expects: “RandomX”
APIverdictlatencytop-relevant resultmatched / top snippet
you_com✓ rank 01029 msMonero - Wikipedia…hird-party auditing. Transactions are validated through a miner network running RandomX, a proof-of-work algorithm... Developers used this concept to design Monero, an…
exa✓ rank 02087 msRandomX - Monero DocsRandomX - Monero Docs Skip to content # RandomX¶ For general information about Rando…
tavily✓ rank 01231 msMonero(XMR) RandomX PoW Algorithm Explained | by RuisiangAmong proof of work algorithms(PoW), randomx is an algorithm tailored specifically for the privacy-oriented cryptocurrency M…
keenable✓ rank 0534 msHow Monero’s proof of work worksMonero does not use a simple fixed hash like Bitcoin. Its proof of work, RandomX, turns mining into running random CPU-friendly programs over a large memory dat…
Q08 technical What network protocol does the nfsdiag tool diagnose? expects: “NFS”
APIverdictlatencytop-relevant resultmatched / top snippet
you_com✓ rank 01152 msGitHub - lsferreira42/nfsdiag: A nfs doctor application · GitHubA nfs doctor application. Contribute to lsferreira42/nfsdiag development by creating…
exa✓ rank 01182 mslsferreira42/nfsdiag# Repository: lsferreira42/nfsdiag A nfs doctor application - Stars: 1 - Forks: 0 - Watchers: 0 - Open issue…
tavily✓ rank 01290 msTroubleshooting NFS performance issues with nfsiostat and nfsstatThe Network File System (NFS) protocol helps provide local access to remote NFS servers. It essentially allo…
keenable✓ rank 0589 ms🕵️‍♂️ Hacking Lab Tutorial: NFS Enumeration — A Complete Guide🕵️‍♂️ Hacking Lab Tutorial: NFS Enumeration — A Complete Guide ✍️ Written by Rajkumar Kumawat 📂 Also available…
Q09 long_tail What kind of fruit does the Pomiferous online database catalog? expects: “apple”
APIverdictlatencytop-relevant resultmatched / top snippet
you_com✓ rank 01006 msPomiferous homeWelcome to the world's most extensive apples (pommes) database · Information on over 7,000 apples is available here, all ca…
exa✓ rank 01718 msPomiferous home…ntal pie pollinization sauce Pomiferous Welcome to the world's most extensive apples (pommes) database. Information on over 7,000 apples is available here, all ca…
tavily✓ rank 01110 msApples in pollination group D - PomiferousWelcome to the world's most extensive apples (pommes) database. ... summary: Large, crisp and sweet apple fruit, ripens lat…
keenable✓ rank 0469 msAdvanced Search…ery on our database Pomiferous Pomiferous Welcome to the world's most extensive apples (pommes) database. Information on over 7,000 apples is available here, all car…
Q10 long_tail What earlier game is Kitten Space Agency described as a spiritual successor to? expects: “Kerbal”
APIverdictlatencytop-relevant resultmatched / top snippet
you_com✓ rank 0968 ms'Kitten Space Agency' is the spiritual successor to 'Kerbal Space ...DayZ and Kerbal Space Program's creators have joined forces with an ex-SpaceX engineer to creat…
exa✓ rank 01768 msKitten Space Agency is the spiritual successor to Kerbal Space Program | GamingOnLinuxKitten Space Agency is the spiritual successor to Kerbal Space Program | GamingOnLinux This website makes use of cookies to enhance you…
tavily✓ rank 01111 msKitten Space Agency is the spiritual successor to Kerbal ... - SteamKitten Space Agency is an in-development spiritual successor to Kerbal Space Program from RocketWerkz that you can try right now for free.
keenable✓ rank 0522 msKittens In Orbit? Surprise Pre-Alpha Release Reveals RocketWerkz’s Bold Vision For Spaceflight SimsKitten Space Agency surprise-launches a free pre-alpha, offering a new Kerbal-style space sim built by RocketWerkz and SpaceX veterans. ...Kitten Space Agenc…
Q11 long_tail Which Zork installment is featured in The Visible Zorker project? expects: “Zork 3”
APIverdictlatencytop-relevant resultmatched / top snippet
you_com✓ rank 0993 msZarf Updates: Visible Zork 3 is now available to all…onth delay, so that Patreon supporters would have a leg up. I worked on Visible Zork 3 in February; I made it available on the Patreon page on March 1st. So where are…
exa✗ miss1256 msThe Visible Zorker: Zork 1The Visible Zorker: Zork 1 # The Visible Zorker: Zork 1 Loading... ... TITLE × Welcome to the commentary track. T…
tavily✗ miss1276 msThe Visible Zorker - Playing - The Interactive Fiction Community ForumThis is an exercise in transparent programming. It runs Zork 1 (r88) using a modified Parchment interpreter that display…
keenable✗ miss527 msThe Visible ZorkerHere's a little something I've been working on: The Visible Zorker! This screenshot has spoilers for Zork 1. This whole…
Q12 long_tail What kind of UK retail data does fuelinsight.co.uk publish? expects: “fuel”
APIverdictlatencytop-relevant resultmatched / top snippet
you_com✓ rank 01032 msUK Fuel Price IntelligenceLive UK fuel price averages, motorway premium, supermarket discount and brand comparisons fr…
exa✓ rank 01197 msUK Fuel Price IntelligenceUK Fuel Price Intelligence We use Google Analytics to understand how the site is used.…
tavily✓ rank 01199 msMethodology & Legal | FuelInsight - UK Fuel Price IntelligenceHow FuelInsight collects, processes, and presents UK fuel price data. Data source, avera…
keenable✓ rank 0520 msAccess fuel price dataLinks to data provided by suppliers as part of the interim road fuel open data scheme. ...data, in a way that is open to third-party developers. Abo…
Q13 commerce How much did Sierra AI raise in its 2026 funding round? expects: “950”
APIverdictlatencytop-relevant resultmatched / top snippet
you_com✓ rank 0997 msBret Taylor's Sierra raises nearly $1B in latest AI capital pushSierra's $950 million Series E funding round was led by Tiger and Google's GV, with participa…
exa✓ rank 21075 msBret Taylor's Sierra raises nearly $1 billion months after last capital push…ence startup, has raised nearly $1 billion in a new funding round, bringing in $950 million in fresh capital at a $15.8 post-money valuation, led by Tiger and Goog…
tavily✗ miss1334 msBret Taylor's Sierra raises $350M at a $10B valuation[Register now.](https://techcrunch.com/events/strictlyvc-san-francisco-2026/?utm_source=tc&utm_medium=ad&utm_campaign=sv…
keenable✓ rank 0503 msSierra raises $950M as the race to own enterprise AI gets serious…andard" for AI-powered customer experiences. ...AI startup Sierra has closed a $950 million funding round led by Tiger Global and GV, the company announced Monday,…
Q14 commerce What model year of Ford Mustang did the May-2026 Electrek article convert to a Tesla EV? expects: “1966”
APIverdictlatencytop-relevant resultmatched / top snippet
you_com✓ rank 01025 ms1966 Ford Mustang converted into a Tesla with working 'Full ...…o parts shop owner in Sacramento spent about $40,000 and two years converting a 1966 Ford Mustang into... A Tesla auto parts shop owner in Sacramento spent about $4…
exa✓ rank 01713 ms1966 Ford Mustang converted into a Tesla with working 'Full Self ...1966 Ford Mustang converted into a Tesla with working 'Full Self-Driving' | Electrek…
tavily✓ rank 01248 ms1966 Ford Mustang converted into a Tesla with working 'Full Self-Driving' | Electrek# 1966 Ford Mustang converted into a Tesla with working ‘Full Self-Driving’. A Tesla a…
keenable✗ miss629 msFord drivers who go electric don’t miss gas cars ‘in the least bit,’ so where’s the EVs?Ford says some drivers are “embracing an electric future,” with no plans to buy another ordinary gas car after experienc…
Q15 commerce What category of authorization vulnerability did Strix find at a DoD contractor? expects: “multi-tenant”
APIverdictlatencytop-relevant resultmatched / top snippet
you_com✗ miss1055 msPress Release: Special Report: Common Cybersecurity Weaknesses ...Inspector General Robert P. Storch announced today that the Department of Defense Office of Inspector General released t…
exa✓ rank 01410 msFinding a Multi-Tenant Authorization Vulnerability | StrixSecuring a DoD Contractor: Finding a Multi-Tenant Authorization Vulnerability | Strix May 3rd, 2026 # Securing a DoD Contractor…
tavily✓ rank 01409 msSecuring a DoD Contractor: Finding a Multi-Tenant Authorization Vulnerability* [Blog](https://www.strix.ai/blog). This is a story about a company backed by a16z, holding [active Department of Defense contracts](https://www.highergov.co…
keenable✗ miss521 msReleases · usestrix/strixOpen-source AI hackers to find and fix your app’s vulnerabilities. - Releases · usestrix/strix , fast CI runs vs deep ma…
Q16 commerce What does the Frizbee CLI tool return when given a tag? expects: “checksum”
APIverdictlatencytop-relevant resultmatched / top snippet
you_com✓ rank 01114 msGitHub - stacklok/frizbee: Throw a tag at it and it comes back ...Throw a tag at it and it comes back with a checksum. - stacklok/frizbee It's a command-line tool designed to provide checksums for…
exa✓ rank 01401 msstacklok/frizbee# Repository: stacklok/frizbee Throw a tag at it and it comes back with a checksum. - Stars: 167 - Forks: 24 - Watchers: 167 - Open issues: 13 - Primary language…
tavily✗ miss1150 msltag: A little CLI tool for tagged text searching - DEV CommunityThis tool could help you search through any list of things. And the list doesn't have to be in a text file. ltag reads f…
keenable✓ rank 0496 msGitHub - stacklok/frizbee: Throw a tag at it and it comes back with a checksum.Throw a tag at it and it comes back with a checksum. - stacklok/frizbee ...Frizbee Frizbee is a tool you may throw a tag at and it…
Q17 academic What computational property does arXiv:2510.19315 prove for Transformers? expects: “succinct”
APIverdictlatencytop-relevant resultmatched / top snippet
you_com✓ rank 0900 msTransformers are Inherently SuccinctWe propose succinctness as a measure of the expressive power of a transformer in describing a conce…
exa✓ rank 01198 ms[2510.19315] Transformers are Inherently Succinct - arXiv[2510.19315] Transformers are Inherently Succinct --> # Computer Science > Formal Languages and Automata Theory arXiv:2510.19…
tavily✓ rank 02109 ms[PDF] Transformers are Inherently Succinct - arXiv…ghly ex-pressive in that they can represent formal languages substantially more succinctly than standard representations of formal languages like finite automata and Li…
keenable✗ miss528 ms[Literature Review] The Role of Logic and Automata in Understanding TransformersThis paper, "The Role of Logic and Automata in Understanding Transformers," surveys recent theoretical advancements in u…
Q18 academic What outcome does NBER working paper w35117 study the effect of employment shocks on? expects: “cognitive decline”
APIverdictlatencytop-relevant resultmatched / top snippet
you_com✓ rank 01061 msDoes Employment Slow Cognitive Decline? Evidence from Labor Market ...…ah Arman Kouchekinia, David Neumark, and Tim A. Bruckner, "Does Employment Slow Cognitive Decline? Evidence from Labor Market Shocks," NBER Working Paper 35117 (2026), https://d…
exa✗ miss1308 msThe Heterogeneous Earnings Impact of Job Loss Across Workers, Establishments, and Markets | NBERThe Heterogeneous Earnings Impact of Job Loss Across Workers, Establishments, and Markets | NBER You may have unlimited…
tavily✓ rank 01107 ms[PDF] Does Employment Slow Cognitive Decline? Evidence from Labor ...…edu 1 Introduction Employment near retirement age appears to reduce the risk of cognitive decline, which is a key precursor to dementia (Coe et al., 2012; Bonsang and Perelman,…
keenable✓ rank 0523 msDoes Employment Slow Cognitive Decline? Evidence from Labor Market Shocks · Flipso…ia, David Neumark, and Tim A. Bruckner using HRS data a... Does Employment Slow Cognitive Decline? Evidence from Labor Market Shocks nber.org/papers/w35117 NBER working paper by…
Q19 academic Which classical law of physics passed its biggest test, per a 2026 Science article? expects: “Newton”
APIverdictlatencytop-relevant resultmatched / top snippet
you_com✓ rank 11091 msNewton and Einstein's Major Laws of Physics Help Explain the Universe…physical laws of nature. Learn about the elementary laws of physics, as well as Newton and Einstein's major contributions. Over the years, one thing scientists have d…
exa✓ rank 01747 msGravity Follows Newton’s and Einstein’s Rules, Even at Cosmic ScalesGravity Follows Newton’s and Einstein’s Rules, Even at Cosmic Scales News Using data collected by th…
tavily✓ rank 01280 msNewton’s law of gravity passes its biggest test ever[Skip to main content](https://www.science.org/content/article/newton-s-law-gravity-passes-its-biggest-test-ever#main-content-focus). * [](https://…
keenable✓ rank 0598 msNewton's Law of Gravity Just Passed Its Biggest Test in History - Live QuriousA landmark study published in Physical Review Letters has tested Newton's inverse square law of gravity across 750 million light-years, using gala…
Q20 academic What two structures does the 2025 reiner.org post argue are similar? expects: “cipher”
APIverdictlatencytop-relevant resultmatched / top snippet
you_com✗ miss1097 msTrump’s ugly Rob Reiner post undercuts the GOP’s post-Charlie ...One of the downsides of serving in President Donald Trump’s movement is that the moral high ground is extremely unsteady…
exa✓ rank 01465 msWhy are neural networks and cryptographic ciphers so similar?Why are neural networks and cryptographic ciphers so similar? # Why are neural networks and cryptographic ciphers so similar?…
tavily✓ rank 11259 msWhy are neural networks and cryptographic ciphers so similar? (2025)Like, even if I read the algorithm for AES I have zero understanding about why it works this way I've finished the Cryptography I on Coursera already. Can't rec…
keenable✗ miss538 msJasmine Crockett Rips Trump’s Rob Reiner Post: ‘It's Almost Like You're Giving A Pass For It’‘It makes me wonder more about, like, where is our country headed, and how bad of a shape are we in with him at the helm…

Notes on tricky queries

How to reproduce

Download the original claim's artifact bundle (krab claim artifact 4472330d-f553-431d-af6c-7c7126dda435 --output /tmp/bundle.tar.gz) and run python3 run.py after unpacking. Recall numbers should reproduce exactly. Latency depends on your link to krabarena.org.