Reliability & operations¶
113 talks across 31 events, oldest first: 18 case studies where an organization reports its own experience, plus concept talks and tutorials.
Keywords: reliability, sre, incident, outage, postmortem, chaos engineering, litmus, chaos mesh, upgrade, day 2, disaster recovery, high availability (edit under categories: in wiki.yaml).
Over time¶
| Year | Talks | Case studies |
|---|---|---|
| 2016 | 1 | 1 |
| 2017 | 6 | 0 |
| 2018 | 9 | 0 |
| 2019 | 8 | 2 |
| 2020 | 6 | 3 |
| 2021 | 6 | 0 |
| 2022 | 16 | 5 |
| 2023 | 13 | 1 |
| 2024 | 19 | 4 |
| 2025 | 22 | 1 |
| 2026 | 7 | 1 |
Organizations with case studies¶
Pusher, Zalando, Alibaba, Ant Financial, Airbnb, Lunar, Google, Eddie Zaneski, 小红书 (Xiaohongshu), Grafana, Intuit
Talks by event¶
2016 · KubeCon + CloudNativeCon North America 2016 (Seattle)¶
- case study · The Good, the Bad, and the Ugly of Managing Production Systems with Kubernetes. A practitioner account of the good, bad and ugly of running production systems on Kubernetes.
2017 · KubeCon + CloudNativeCon Europe 2017 (Berlin)¶
- concept · Kubernetes Day 2: Cluster Operations [I] - Brandon Philips, CoreOS
- concept · High Availability Kubernetes on Bare Metal [A] - Muhammad Kamran Azeem & Henrik Høegh, Praqma
- concept · Alertmanager on Its Way to High Availability [A] - Frederic Branczyk, CoreOS
2017 · KubeCon + CloudNativeCon North America 2017 (Austin)¶
- concept · Testing Distributed Software on Kubernetes with PowerfulSeal [I] - Mikolaj Pawlikowski, Bloomberg. Demonstrates using PowerfulSeal to test distributed software on Kubernetes.
- concept · Disaster Recovery for your Kubernetes Clusters [I] - Andy Goldstein & Steve Kriss, Heptio
- concept · What Happens When Something Goes Wrong? On Kubernetes Reliability - Marek Grabowski & Tina Zhang. Explains what happens in Kubernetes when components fail and how reliability is maintained.
2018 · KubeCon + CloudNativeCon China 2018 (Shanghai)¶
- concept · Production Cluster Monitoring and Remediation for High Reliability - Shijun Qian & YingKe Liu
2018 · KubeCon + CloudNativeCon Europe 2018 (Copenhagen)¶
- concept · Managing Kubernetes: What You Need to Know About Day 2 - Craig Tracey, Heptio. Covers what to know about managing Kubernetes in day 2 operations.
- concept · Clusters as Cattle: How to Seamlessly Migrate Apps Across Kubernetes Clusters - Andy Goldstein. Shows how to treat clusters as disposable and migrate applications between Kubernetes clusters.
- concept · Chaos Engineering WG Deep Dive – Sylvain Hellegouarch, ChaosIQ (Intermediate Skill Level)
- concept · Lightning Talk: Chaos Engineering In Practice - Paul Jones, Capgemini UK (Intermediate Skill Level)
- concept · Chaos Engineering WG Intro – Sylvain Hellegouarch, ChaosIQ (Any Skill Level)
2018 · KubeCon + CloudNativeCon North America 2018 (Seattle)¶
- concept · Day 2 with Stateful Applications - Implementing a Data Protection... - Deepika Dixit & Vaibhav Kamra. Covers designing a data protection strategy for stateful applications on Kubernetes.
- concept · Intro: Chaos Engineering BoF - Sylvain Hellegouarch, ChaosIQ
- concept · Deep Dive: Chaos Engineering BoF - Sylvain Hellegouarch, ChaosIQ & Julien Bisconti, 56k.cloud
2019 · KubeCon + CloudNativeCon China 2019 (Shanghai)¶
- concept · Exploring High Availability in Kubernetes with Vitess - Jiten Vaidya, PlanetScale
- concept · Upgrade Images by Digging Out and Automatically Fixing the Vulnerabilities - Lin Ru & Yan Wang
2019 · KubeCon + CloudNativeCon Europe 2019 (Barcelona)¶
- case study · Lightning Talk: Oh Sh*t! The Config Changed! - Joel Speed, Pusher — Pusher. Pusher shares lessons from handling unexpected configuration changes.
- case study · Kubernetes Failure Stories and How to Crash Your Clusters - Henning Jacobs, Zalando SE — Zalando. Zalando shares real Kubernetes production failures and what it learned from them.
- concept · Lightning Talk: Reliability Engineering for Humans - Hannah Foxwell, Pivotal
- concept · BoF Deep Dive: Chaos Engineering - Sylvain Hellegouarch, ChaosIQ
- concept · Databases on Kubernetes Using a Custom Operator: Day 1, Day 2, and Beyond - Johannes Unterstein
2019 · KubeCon + CloudNativeCon North America 2019 (San Diego)¶
- concept · Day 2 Operations with Windows Containers - Michael Michael, VMware & Patrick Lang, Microsoft
2020 · KubeCon + CloudNativeCon Europe 2020 - Virtual¶
- case study · Help! Please Rescue Not-ready Nodes Immediately - Xiaoyu Zhang, Alibaba & Di Xu, Ant Financial — Alibaba, Ant Financial. Alibaba and Ant Financial share how they detect and rescue not-ready nodes in their clusters.
- concept · In-place Upgrade Noway! Blue/Green Your Way to a New Kubernetes Version - Ricardo Aravena, Rakuten
2020 · KubeCon + CloudNativeCon North America 2020 - Virtual¶
- case study · 10 More Weird Ways to Blow Up Your Kubernetes - Jian Cheung & Joseph Kim, Airbnb — Airbnb. Airbnb shares weird failure modes and outages it hit running Kubernetes in production and the lessons learned.
- case study · An SLO-Driven Approach to Enhance Kubernetes Cluster Reliability - Qian Ding & Cong Chen. Speakers describe an SLO-driven approach to improving the reliability of their Kubernetes clusters.
- concept · Scaling to Millions of ML Models to Solve the Problems of SRE and Security - Sandeep Pombra. Describes scaling to millions of ML models to address SRE and security problems.
- concept · Evolution of Metric Monitoring and Alerting: Upgrade Your Prometheus Today - Bartlomiej Płotka
2021 · KubeCon + CloudNativeCon + Open Source Summit China 2021¶
- concept · Improve FUSE Filesystem Performance and Reliability - Tao Peng, Ant Group
- concept · Chaos Mesh 2.0: Make Chaos Engineering Easy - Cwen Yin, PingCAP
2021 · KubeCon + CloudNativeCon Europe 2021¶
- concept · Power Level 9000! Improving Application Performance with Chaos Engineering - S. Pathak & K. Gaekwad
- concept · CSI Volume Attacks – The SRE Strikes Back - Hendrik Land, NetApp. Examines attacks via CSI volumes and how SREs can defend against them.
- concept · OLM: A Declarative Way to Install, Manage, and Upgrade Operators - Dan Sover & Alex Greene, Red Hat. Explains how OLM declaratively installs, manages and upgrades Kubernetes operators.
2021 · KubeCon + CloudNativeCon North America 2021¶
- concept · Disaster Recovery of Stateful Applications in a Multi-Cl... Orit Wasserman & Shyamsundar Ranganathan. Shows how to design disaster recovery for stateful apps across multiple clusters.
2022 · KubeCon + CloudNativeCon Europe 2022¶
- case study · Making Sense of Chaos: Implementing Chaos Engineering in a Fintech... Iqbal Farabi & Giovanni Sakti. Speakers describe implementing chaos engineering at a fintech company and what they learned.
- case study · From Student to SRE That Loves CNCF in No Time - Jacob Valdemar Andreasen, Lunar — Lunar. A Lunar engineer describes going from student to an SRE using CNCF tooling.
- case study · Case Study: Bringing Chaos Engineering to the Cloud Native Develo... Uma Mukkara & Ramiro Berrelleza
- concept · Make Cloud Native Chaos Engineering Easier - Deep Dive into Chaos Mesh - Cwen Yin, PingCAP
- concept · Komrade: an Open-Source Security Chaos Engineering (SCE) Tool for... Aaron Rinehart & Matas Kulkovas. Introduces Komrade, an open-source security chaos engineering tool.
- concept · Building for the (Inevitable) Next Cloud Outage - Pavel Nikolov, Section. Discusses how to design systems to survive the next cloud provider outage.
- concept · Better Reliability Through Observability and Experimentation - Julie Gunderson & Kerim Satirli
- concept · Cloud Native Chaos Engineering with Lit... Karthik S, Umasankar Mukkara & Udit Gaurav, Saiyam Pathak
- concept · Effective Disaster Recovery: The Day We Deleted Production - Rick Spencer & Wojciech Kocjan
2022 · KubeCon + CloudNativeCon North America 2022¶
- case study · Migrating From Single-Node Kubernetes Control Plane To HA In Product... Cong Yue & David Oppenheimer — Google. Describes migrating a single-node Kubernetes control plane to HA in production.
- case study · Multi-Cluster Stateful Set Migration: A Solution To Upgrade Pain - Peter Schuurman & Matt Schallert
- concept · Cloudy With a Chance Of Chaos: Verifying the Resiliency Of Cloud-Native Applications - Bella Wiseman. Explains approaches to verifying the resiliency of cloud-native applications using chaos engineering.
- concept · One VTOrc To Rule Them All – High Availability In a Distributed Database System - Deepthi & Manan
- concept · What’s New In Chaos Mesh And Deep Dive Into Multi Clusters Support - Ed Huang & Chao Zheng, PingCAP
- concept · Chaos Engineering For Hybrid Targets With LitmusChaos - Uma Mukkara, Karthik S & Prithvi Raj
- concept · Chaos Engineering Applied To the FinTech Domain - Rajeshwar Vadheraju, FIS & Neelanjan Manna
2023 · KubeCon + CloudNativeCon + Open Source Summit China 2023¶
- concept · Chaos Mesh: Overview, Practice and Future - Zhou Zhiqiang, Cwen Yin, PingCAP; Xianglin Gao. Overview of Chaos Mesh, its practical use and future direction.
2023 · KubeCon + CloudNativeCon Europe 2023¶
- concept · Kubernetes Prow Jobs - Day 2 Aspects and How to Navigate, Read &...- Priyanka Saggu & Mario Braganza
- concept · CNCF Code of Conduct Working Group: Presenting a new structure for incident resolution
- concept · Chaos Engineering 2023 with Chaos Mesh - Saiyam Pathak, Civo
- concept · Automated Cloud-Native Incident Response with Kubernetes and Service Mesh - M Turner & F Beltramini
- concept · Disaster Recovery: Bringing Back Production from Scratch in Under 1 Hour Using... - Marcelo-Tanner
- concept · Unlocking Argo CD’s Hidden Tools for Chaos Engineering - Featuring... - D Garfield & B Phillips
- concept · Surviving Day 2 - How to Troubleshoot Kubernetes Networking - Thomas Graf, Isovalent. Covers approaches to troubleshooting Kubernetes networking in day 2 operations.
- concept · Improving the Reliability of Kubernetes Load Balancers - Alexander Constantinescu, Confluent
2023 · KubeCon + CloudNativeCon NA 2023¶
- case study · The Cluster Killer Bug: Learning API Priority and Fairness the Hard Way - Eddie Zaneski, Independent — Eddie Zaneski. Describes an incident in which a Kubernetes cluster was brought down and what was learned about API Priority and Fairness.
- concept · Disaster Recovery with Very Large Postgres Databases - Gabriele Bartolini, EDB & Michelle Au, Google
- concept · Chaos Mesh: Overview, Practice and Future - Zhou Zhiqiang, Individual & Saiyam Pathak, Civo. Overview of Chaos Mesh, how it's used in practice, and its future direction.
- concept · Forging a Stronger Bond Between Etcd and Kubernetes - Marek Siarkowicz, Wenjia Zhang & James Blair. Maintainers describe work to tighten the integration between etcd and Kubernetes.
2024 · KubeCon + CloudNativeCon + Open Source Summit + AI_dev China 2024¶
- case study · Leveraging Multi-Cluster Architecture for Resilient and Elastic H... - Feng Xiong, 小红书 & Hongcai Ren — 小红书 (Xiaohongshu). Xiaohongshu describes how it uses a multi-cluster architecture to make its workloads resilient and elastic.
- concept · The Challenges of Kubernetes Data Protection - Real Examples and Solutions... Wenkai Yin & Bruce Zou. Presents challenges of Kubernetes data protection with real examples and solutions, based on Velero.
- concept · What if Your System Experiences an Outage? Let's Build a Resilient Systems with Chao...- NamKyu Park. Explains how to build resilient systems using chaos engineering to prepare for outages.
2024 · KubeCon + CloudNativeCon Europe 2024¶
- concept · Enhancing Reliability Through Multi-Cluster Deployment: Leveraging the Power of Karmada
- concept · Fire in the Cloud: Bringing Managed Services Under the Ambit of Cloud-Native Chaos Engineering
- concept · Kubernetes Data Protection WG Deep Dive - Dave Smith-Uchida, Veeam. Deep dive into the Kubernetes Data Protection Working Group's goals and progress.
- concept · Zonal Outage Operational Stories - Jyoti Ranjan Mahapatra & Shyam Jeedigunta, Amazon Web Services
- concept · AI-Assisted Runbooks - Instigating Precision and Efficiency in Kubernetes Operations. Shows how AI-assisted runbooks can make Kubernetes operations more precise and efficient.
2024 · KubeCon + CloudNativeCon India 2024¶
- case study · Stay Ahead of Disruptions : Experience Robust DNS Failover for API Ga... G. Yadav & V. K. M. Vadrevu. Speakers describe building robust DNS failover for API gateways to stay available through disruptions.
- concept · LitmusChaos Evolution: The Latest Innovations and Security Enhancements To Chaos Engineering
- concept · Ensuring Reliability of Production Ready Kubernetes Operators Using... - Aniruddha Basak & Rayan Das. Covers approaches to ensure production-ready Kubernetes operators are reliable.
- concept · Safeguarding SLAs and Building Resilient Systems: A Sneak Peek to Chaos Engineering Probes - Panel
2024 · KubeCon + CloudNativeCon NA 2024 - Salt Lake City¶
- case study · Watching the Watchers: How We Do Continuous Reliability at Grafana Labs - Nicole van der Hoeven — Grafana
- case study · Towards Zero Change Incidents: Intuit's Strategy for Implementing AI... A. Basu, S. Balasubramanian — Intuit. Intuit describes its strategy for using AI to move toward zero change-caused incidents.
- concept · Setting New Standards for Reliability in Cloud Native Multi-Region Applications - Trey Caliva
- concept · Building Resilience: Effective Backup and Disaster Recovery for Vec... P. Navarathna, S. Subramanian
- concept · Can Your Kubernetes Network Handle the Heat? Building Resilience wit... L. Lieberman, S. Seetharaman. Explores how to build resilience into Kubernetes networking so it can withstand failures and stress.
- concept · Upgrade Safely: Avoid the Pitfalls of Kubernetes Versioning - Rob Scott, Google
- other · Day 2 - KubeCon + CloudNativeCon North America Highlights. Short highlight reel of attendee impressions from day 2 of KubeCon NA 2024.
2025 · KubeCon + CloudNativeCon China 2025 (Hong Kong)¶
- concept · Building Ultra-Large-Scale Cloud Native Edge Systems Using Chaos Engineering - Yue Bao & Yue Li
- concept · Guardians of the Gateway: Keeping Chaos Out of Your Cloud Highway - Sayan Mondal & Jintao Zhang. Shows how to apply chaos engineering to gateways to test the resilience of cloud traffic paths.
- concept · Lightning Talk: Disaster Recovery - How IaCaC and Kubernetes Enables Cost Efficiency... Sandy Wang
- concept · Destroy Your System To Make It More Reliable: An Easy Way To Start Chaos Engineering... Sayan Mondal
2025 · KubeCon + CloudNativeCon Europe 2025 - London¶
- concept · Day 2 - KubeCon + CloudNativeCon 2025 Europe Highlights from London
- concept · Chaos Engineering Practice Under Ultra-large-scale Cloud Native Edge Computing - Yue Bao & yue li
- concept · Was Leslie Lamport Right? - Sarah Christoff, Edera & Nic Jackson, Hashicorp. Examines distributed systems principles through the lens of Leslie Lamport's ideas.
- concept · Driving Chaos Engineering Forward: What’s New and Next With LitmusCha... Sarthak Jain & Saranya Jena. Project update on what's new and next for LitmusChaos.
- concept · Lightning Talk: High Availability With '503: Unavailable' - Robert-Jan Huijsman, Reboot. A lightning talk on approaches to high availability and handling 503 Unavailable responses.
- concept · Resilient Multi-Cloud Strategies: Harnessing Kubernetes, Cluster API, and... T. Rahman & J. Mosquera. Describes multi-cloud resilience strategies built on Kubernetes and Cluster API.
2025 · KubeCon + CloudNativeCon India 2025¶
- concept · Unlocking the Power of Kuma Service Mesh: Enhancing Reliability and D... Deepak Verma & Arpit Mishra
- concept · Lightning Talk: Mission: Impossible - Building Self-Healing Disaster Recovery With... Prerit Munjal
- concept · Enhancing DNS Reliability in Kubernetes With Node Local DN... Sanjay Kumar K K R & Priyanshi Agrawal
- concept · ArgoCD CLI Gets an Upgrade: Plugins, Flexibility, and More - Nitish Kumar, Akuity
2025 · KubeCon + CloudNativeCon Japan 2025 (Tokyo)¶
- concept · Lightning Talk: Enhanced Service Redirection: eBPF Ensures the High Availability of N... Weizhou Lan
- concept · Platform Engineering Day 2: Why Service Iterations Are the Crux of Developer Platfor... Puja Abbassi
2025 · KubeCon + CloudNativeCon North America 2025¶
- case study · Prepare for Disruptions: How We Upgrade the Whole ML Training Fleet Bi-week... Cong Gu & Ankit Goyal
- concept · Day 2 Highlight: KubeCon + CloudNativeCon Atlanta 2025
- concept · Under the Hood of Vitess: Database Engineered for Scale and Resilien... Matt Lord & Florent Poinsard. Deep dive into Vitess architecture and how it provides a scalable, resilient database layer on MySQL.
- concept · But What About Reliability? - The Multi-Million Dollar Kubernetes Cost Op... Zain Malik & Nibir Bora
- concept · Maximizing the Launch Reliability: Ensuring Stable Application Lift-off and Orbi... Hiroshi Hayakawa
- concept · Upgrade Nightmare To Uptime Dream: The Cloud Provider's Playbook for... Yuchen Zhou & Uttam Kumar
2026 · KubeCon + CloudNativeCon Europe 2026¶
- concept · Day 2 - KubeCon + CloudNativeCon 2026 highlights from Amsterdam
- concept · Ping SRE? I Am the SRE! Awesome Fun I Had Drawing a Zine for Troubleshooting Kubern... René Dudfield
- concept · Banking on Reliability: Cloud Native SRE Practices in Financial Services - Clément Nussbaumer
2026 · KubeCon + CloudNativeCon India 2026¶
2026 · KubeCon + CloudNativeCon Japan 2026¶
- case study · Don't Start With 500 Clusters: Patterns in Scaling Multi-Cluster Kubernetes… N. Bora & M. Morrison. Speakers share patterns and lessons from scaling multi-cluster Kubernetes with Cluster API, arguing against starting with hundreds of clusters.
- concept · Is Your Kubernetes Disaster Recovery Actually Ready? - Saiyam Pathak & Saloni Narang. Discusses how to verify whether a Kubernetes disaster recovery setup is truly ready.
- concept · Maximizing Launch Reliability: Controlled Lift-off for Reliable Application Startup on… H. Hayakawa. Presents techniques for controlled, reliable application startup on Kubernetes to maximize launch reliability.