T1#security#research#open-source
Big Sleep — An AI Agent Finds an Unknown Flaw in SQLite
Metadata
- Date
- Decade
- 2020s
- Tier
- T1
- Sources
- 06
- Connections
- 03
- Tags
- #security#research#open-source
Big Sleep is an AI agent built jointly by Google's Project Zero and Google DeepMind to hunt for unknown vulnerabilities in software. On 1 November 2024 the team announced its first real-world find: an exploitable stack buffer underflow in SQLite, the embedded database used by countless applications. The flaw was reported to the SQLite developers in early October 2024, fixed the same day, and never appeared in an official release, so, as the team put it, SQLite users were not affected.
The team called the find, in its own words, what it believed was "the first public example of an AI agent" discovering a previously unknown, exploitable memory-safety issue in widely used real-world software. That claim is hedged — "we believe", and "public" — and it should be read as Google's own assessment, not an independently certified record.
What was found
The bug sat in seriesBestIndex, a function of SQLite's generate_series extension (ext/misc/series.c). SQLite uses the value −1 as a special marker for constraints on the ROWID column, and that function did not handle the marker. A crafted query could therefore make it write outside the bounds of an array on the stack — the "underflow" in the name, because the write landed below the start of the buffer.
Project Zero's write-up gives the commit identifiers rather than a release number, which is itself the point: the vulnerable code existed only in the development branch. The team described the bug as likely exploitable, but also noted that it surfaced in a debug build with assertions enabled; in a release build the assertion is absent and the outcome depends on the compiler and optimisation level.
| Item | Detail |
|---|---|
| Announced | 1 November 2024, Project Zero blog |
| Software | SQLite, generate_series extension |
| Bug class | Stack buffer underflow (out-of-bounds write) |
| Reported | Early October 2024 |
| Fixed | Same day by the SQLite developers |
| Shipped in a release? | No — caught on the development branch |
Why fuzzers had missed it
Fuzzing — firing enormous numbers of semi-random inputs at a program — is a standard technique for finding memory-safety bugs. The Big Sleep team checked why it had not caught this one. Google's OSS-Fuzz harness for SQLite was built without the generate_series extension, and another harness contained an older, unaffected version of the function. When the team ran AFL against the SQLite command-line target for 150 CPU-hours, it did not find the bug either.
That is a narrow result, and the authors framed it narrowly. They called the findings "highly experimental" and wrote that a target-specific fuzzer would likely be at least as effective at finding vulnerabilities. The argument was not that language models had overtaken fuzzers, but that an agent that reads code and reasons about it can reach places a generic harness never exercises.
From one bug to a programme
Big Sleep grew out of an earlier Project Zero research framework named Naptime, as the title of the November post records. What followed in 2025 turned a single proof of concept into an operational tool — at least by Google's account.
| Date | Development | Source |
|---|---|---|
| 1 Nov 2024 | First real-world find announced (SQLite, unreleased code) | Project Zero |
| 15 Jul 2025 | Google says Big Sleep, combined with threat intelligence, found CVE-2025-6965 in SQLite, a flaw it says was known only to threat actors | Google (Kent Walker) |
| 4 Aug 2025 | Google's VP of security Heather Adkins announces Big Sleep's first 20 reported vulnerabilities, mostly in open-source projects such as FFmpeg and ImageMagick | TechCrunch |
| 8 Aug 2025 | DARPA's AI Cyber Challenge final: competing AI systems find 54 of 63 synthetic vulnerabilities and patch 43 | DARPA |
| 6 Oct 2025 | Google DeepMind presents CodeMender, an agent that writes patches; 72 fixes submitted to open-source projects | SiliconANGLE |
The July 2025 claim was bolder than the first. In a post by Kent Walker, Google's president of global affairs, the company wrote: "We believe this is the first time an AI agent has been used to directly foil efforts to exploit a vulnerability in the wild." According to The Record, Google's threat intelligence group had seen signs that attackers were staging a zero-day without being able to identify it, and colleagues then used Big Sleep to isolate the flaw. Google declined to name the attackers or describe the indicators. No outside party has published evidence that would let the claim be checked.
For the August batch, Google spokesperson Kimberly Samra told TechCrunch that a human expert reviews each report before it is sent, but that each vulnerability was found and reproduced by the agent without human intervention. Details were withheld until fixes shipped, under Google's disclosure policy.
Who gained, who carried the cost
The beneficiaries of the November 2024 find are easy to name: SQLite's users, who never received the bug, and the open-source projects that later received Big Sleep reports. The approach also changes who can do vulnerability research. Finding a memory-safety flaw in mature code used to take scarce specialists; Google's framing was that an agent could search code at a scale human teams could not.
The costs fell elsewhere. The same TechCrunch report noted that maintainers of several projects had complained about hallucinated bug reports — the bug-bounty equivalent of AI slop — and quoted Vlad Ionescu, co-founder of the AI security start-up RunSybil, who said many submissions looked like gold but were "actually just crap". Every AI-generated report, good or bad, lands on a maintainer who has to read it. Google's answer was the human expert in the loop before submission; volunteer projects have no equivalent buffer on the receiving end. That tension, between finding more bugs and swamping the people who fix them, ran through the next two years and is the subject of the XBOW article.
There is also a defensive-versus-offensive question that Google's announcements leave open. A tool that finds an exploitable bug before release finds it equally well for whoever runs it. Google ran Big Sleep internally and reported what it found; it did not release the agent. The same choice — restrict the capability, use it defensively, publish the results — was made at much larger scale by Anthropic in 2026 with Claude Mythos Preview and Project Glasswing.
Where it sits in history
Big Sleep did not invent automated vulnerability discovery; fuzzers and static analysers had been finding bugs automatically for years. What changed in November 2024 was the method: a large language model reading source code, forming hypotheses and testing them, the way a human researcher would. The SQLite bug was small and caught early. Its significance lay in the precedent, which within eighteen months had become a race among AI labs and security vendors.
Related pages: the cybersecurity timeline, the AI timeline, and two earlier open-source security crises that defined how the industry thinks about shared code, Heartbleed and Log4Shell.
Questions this page answers
- What is Big Sleep?
- It is an AI agent built jointly by Google's Project Zero and Google DeepMind to find unknown vulnerabilities in software. A large language model reads source code, forms hypotheses and tests them, much as a human researcher would. Google runs it internally and has not released the agent itself.
- What was the first vulnerability Big Sleep found?
- An exploitable stack buffer underflow in seriesBestIndex, a function in SQLite's generate_series extension. It was reported in early October 2024 and fixed by the SQLite developers the same day, before it reached an official release, so users were not affected. It was announced on 1 November 2024.
- Was it the world's first AI-found vulnerability?
- Google's team wrote that it believed this was the first public example of an AI agent finding a previously unknown exploitable memory-safety issue in widely used real-world software. That is a qualified self-assessment, not an independently certified record; fuzzers and other automated tools had been finding vulnerabilities long before.
- What did Big Sleep do next?
- On 15 July 2025 Google said Big Sleep, combined with threat intelligence, had found SQLite flaw CVE-2025-6965 and helped cut off an attempt to exploit it. On 4 August it announced the agent's first 20 reported vulnerabilities, mostly in open-source projects such as FFmpeg and ImageMagick, each reviewed by a human expert before reporting.
Sources
The seriesBestIndex flaw, early-October report and same-day fix, caught before release, the 'first public example' claim, the OSS-Fuzz harness gap, 150 CPU-hours of AFL, and the 'highly experimental' caveat
PrimaryA summer of security: empowering cyber defenders with AI — Kent Walker, Google, Jul 15, 2025
The CVE-2025-6965 find and Google's claim that this was the first time an AI agent directly foiled an in-the-wild exploitation attempt
SecondaryGoogle says its AI-based bug hunter found 20 security vulnerabilities — TechCrunch, Aug 4, 2025
Heather Adkins's announcement of 20 vulnerabilities, FFmpeg and ImageMagick, Kimberly Samra's statement, maintainers' complaints about AI slop and Vlad Ionescu's remark
Last updated: