Sadly the wall mounted rack is a bit too shallow for the new switches so I ordered a 9U open frame rack to put in my homeoffice where the new switches and the ms-01 cluster will be.
I will also most likely not go with ceph and just set up the Proxmox cluster from scratch with separate interfaces.
1x 10GbE VLAN 2 for VM Traffic 10.10.2.10x
1x 10GbE VLAN 3 for Backup Migration 10.10.3.10x
1x 1GbE VLAN 1 for Management 10.10.0.10x
1x 1GbE VLAN 4 for Corosync 10.10.4.10x
# network interface settings; autogenerated
# Please do NOT modify this file directly, unless you know what
# you're doing.
#
# If you want to manage parts of the network configuration manually,
# please utilize the 'source' or 'source-directory' directives to do
# so.
# PVE will preserve these directives, but will NOT read its network
# configuration from sourced files, so do not attempt to move any of
# the PVE managed interfaces into external files!
auto lo
iface lo inet loopback
auto nic0
iface nic0 inet manual
auto nic1
iface nic1 inet static
address 10.10.4.101/24
#Corosync
auto nic2
iface nic2 inet manual
auto nic3
iface nic3 inet manual
auto vmbr0
iface vmbr0 inet static
address 10.10.0.101/24
gateway 10.10.0.1
bridge-ports nic0
bridge-stp off
bridge-fd 0
bridge-vlan-aware yes
bridge-vids 2-4094
vlan-aware yes
#Management
auto vmbr1
iface vmbr1 inet manual
bridge-ports nic2
bridge-stp off
bridge-fd 0
bridge-vlan-aware yes
bridge-vids 2-4094
vlan-aware yes
#VM Traffic
auto vmbr2
iface vmbr2 inet static
address 10.10.3.101/24
bridge-ports nic3
bridge-stp off
bridge-fd 0
vlan-aware yes
#Backup/Migration
source /etc/network/interfaces.d/*
