summaryrefslogtreecommitdiff
path: root/Network outage on single hypervisor causes Freenet to shutdown EVERYTHING.md
blob: 640d35fffaddb1450720aa2b25e0f4aff704c579 (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
---
tags:
  - work
  - freenet
  - outage
---
[[Freenet CPU steal graph]]
[[Random notes on Freenet deployment]]
[[I'm worried that Freenet will completely go DOWN due to OVN upgrade]]

Recently we had added some hypervisors but one of them had invalid MTU set on the bond. Due to... me testing there, so rutger didn't reboot it.
During maintenance we started migrating workload onto it and their network started failing.
As a response to this Freenet ***automatically*** hit the **PANIC** switch and systemctl stopped about everything in ALL AVAILABILITY ZONES.