PIPEFAIL: How a missing shell option slowed Cloudflare down
April 05, 2022 1:57PM
This post tells the story of how a missing shell option called “pipefail” slowed Cloudflare down....
Cloudflare’s investigation of the January 2022 Okta compromise
March 22, 2022 4:57PM
Okta Security Post MortemToday at 03:30 UTC we learnt of a compromise of Okta. We use Okta internally for employee identity as part of our authentication stack. We have investigated this compromise carefully and do not believe we have been compromised as a result...
Incorrect proxying of 24 hostnames on January 24, 2022
January 26, 2022 6:34PM
Post MortemOn January 24, 2022, as a result of an internal product migration, 24 hostnames (including www.cloudflare.com) that were actively proxied through the Cloudflare global network were mistakenly redirected to the wrong origin...
A Byzantine failure in the real world
November 27, 2020 12:00PM
Post Mortem API Postgres Outage EngineeringWhen we review design documents at Cloudflare, we are always on the lookout for Single Points of Failure (SPOFs). In this post, we present a timeline of a real-world incident, and how an interesting failure mode known as a Byzantine fault played a role in a cascading series of events....
August 30th 2020: Analysis of CenturyLink/Level(3) Outage
August 30, 2020 9:55PM
Outage Post MortemToday CenturyLink/Level(3), a major ISP and Internet bandwidth provider, experienced a significant outage that impacted some of Cloudflare’s customers as well as a significant number of other services and providers across the Internet....
More Posts