How we saved 100 terabytes of memory by optimizing 1.1.1.1’s DNS cache
- Big Pineapple, the platform behind 1.1.1.1, Gateway DNS, DNS Firewall, AS112, and several other Cloudflare DNS services, stores over 250 billion DNS cache entries at any given time.
- At that scale, wasting a single byte per entry costs more than 250 gigabytes of memory across our fleet.
- Five successive changes to how cache entries are stored in memory cut the per-entry footprint by over 50%.
Unverified
- Big Pineapple, the platform behind 1.1.1.1, Gateway DNS, DNS Firewall, AS112, and several other Cloudflare DNS services, stores over 250 billion DNS cache entries at any given time.
- At that scale, wasting a single byte per entry costs more than 250 gigabytes of memory across our fleet.
- Five successive changes to how cache entries are stored in memory cut the per-entry footprint by over 50%.
Sources: Cloudflare