A one-line Kubernetes fix that saved 600 hours a year
Investigating a 30-minute restart delay in Atlantis revealed a Kubernetes volume permissions bottleneck, resolved by adjusting fsGroupChangePolicy, reducing restart times to 30 seconds.
MAIN POINTS
- Atlantis instance experienced a 30-minute restart delay.
- Kubernetes volume permissions were identified as the bottleneck.
- Adjusting fsGroupChangePolicy resolved the issue.
- Restart times improved significantly to 30 seconds.
TAKEAWAYS
- Investigating performance issues can uncover unexpected bottlenecks.
- Kubernetes configuration adjustments can lead to significant performance improvements.
- fsGroupChangePolicy plays a crucial role in volume permission handling.
- Optimizing system settings can drastically reduce operational downtime.