Home
Internet
Internet News
Cloudflare Explains How Configuration Change Took Down 20 Percent of the Internet

Cloudflare Explains How Configuration Change Took Down 20 Percent of the Internet

Cloudflare Co-Founder and CEO Matthew Prince clarified that the outage was caused due to an internal system issue.

Written by Akash Dutta, Edited by Ketan Pratap | Updated: 19 November 2025 15:20 IST

Cloudflare Explains How Configuration Change Took Down 20 Percent of the Internet

Photo Credit: Reuters

Cloudflare called it the company’s worst outage since 2019

Click Here to Add Gadgets360 As A Trusted Source

Highlights

Cloudflare ruled out cyberattack as the reason behind the outage
Bad data was generated by a query running on ClickHouse database cluster
Cloudflare CEO apologised to its customers and Internet users

Cloudflare, on Tuesday, suffered a system crash, triggering a massive outage that impacted major websites such as X (formerly known as Twitter), ChatGPT, Canva, and others. The outage lasted nearly five hours, and visitors were only seeing an HTTP 500 error code, informing them about the internal server error. Now, Matthew Prince, the Co-Founder and CEO of the company, has shared a detailed breakdown of what caused this outage. Notably, the issue was not caused by a cyberattack or any external malicious activity, and instead was triggered by an internal system flaw.

Cloudflare CEO Reveals the Reason Behind the Outage

In a blog post, Prince called the incident “Cloudflare's worst outage since 2019.” Apologising ”for the pain we caused the Internet today”, the CEO also detailed what triggered this outage.

The root cause was a permissions change in one of the company's database systems. This change led to the generation of a “feature file” used by its Bot Management system that doubled in size beyond the software's expected limits. The oversized file was distributed across the network and triggered failures in the proxy software reading it.

Chinese Hackers Use Claude to Execute a World’s First AI Cyberattack

The faulty feature file originated from a query running on a ClickHouse database cluster. Every five minutes, the file was regenerated, and because some cluster nodes had been updated while others had not, there was intermittent propagation of a “bad” version of the file. This dynamic caused the network to alternate between periods of failure and recovery, complicating the diagnosis.

Initial diagnostics by the Cloudflare team pointed to a potential large-scale Distributed Denial of Service (DDoS) attack due to the pattern of failures. However, once the investigation revealed the configuration-file issue, the team halted propagation of the bad file, rolled back to a known good version, and restarted the core proxy services. Core traffic returned to normal by about 14:30 UTC (8:00pm IST), and full recovery was reported at 17:06 UTC (10:36pm IST).

Several Cloudflare services were impacted as part of this event. The core content delivery network (CDN) and security services produced elevated HTTP 5xx errors. The Turnstile bot-challenge service failed to load. The Workers KV key-value store experienced high error levels due to front-end gateway failures. The Dashboard was mostly operational, but many users were unable to log in because Turnstile was unavailable. Email security features experienced degraded spam-detection accuracy due to a temporary loss of access to an IP-reputation source.

“An outage like today is unacceptable. We've architected our systems to be highly resilient to failure to ensure traffic will always continue to flow. When we've had outages in the past, it's always led to us building new, more resilient systems,” said Prince.

Comments

Get your daily dose of tech news, reviews, and insights, in under 80 characters on Gadgets 360 Turbo. Connect with fellow tech lovers on our Forum. Follow us on X, Facebook, WhatsApp, Threads and Google News for instant updates. Catch all the action on our YouTube channel.

Further reading: Cloudflare, Outage

Akash Dutta Email Akash Dutta

Akash Dutta is a Chief Sub Editor at Gadgets 360. He is particularly interested in the social impact of technological developments and loves reading about emerging fields such as AI, metaverse, and fediverse. In his free time, he can be seen supporting his favourite football club - Chelsea, watching movies and anime, and sharing passionate opinions on food. More