Hi,
We r running
######
/home/ # NetworkManager -V
1.34.0
/home/ # ovs-vsctl -V
ovs-vsctl (Open vSwitch) 2.14.2
DB Schema 8.2.0
/home/ # uname -a
Linux 5.3.18-150300.59.87-default SMP Thu Jul 21 14:31:28 UTC 2022 (cc90276) x86_64 x86_64 x86_64 GNU/Linux
this is SLES15 sp3 machine.
pool1-bm25c5:~> nmstatectl --version
1.2.0
pool1-bm25c5:~>
######
when we reboot node or restart NetworkManager(systemctl restart NetworkManager) we are loosing some of the ovs interfaces (randomly, not on all restarts).
logs are here:
Missing interfaces:
https://gist.github.com/nmathew/d7d472b938f389c4efbadd01ef78d466#file-missing-interfaces
NetworkManager trace log for restart duration
https://gist.github.com/nmathew/d7d472b938f389c4efbadd01ef78d466#file-networkmanager-logs-with-trace
/etc/NetworkManager/system-connections
https://gist.github.com/nmathew/d7d472b938f389c4efbadd01ef78d466#file-connection-conf
ovsdb-client-dump for non working case(or when interfaces are missing)
ovsdb-client-dump for working case(or when all interfaces are present)
https://gist.github.com/nmathew/d7d472b938f389c4efbadd01ef78d466#file-on-working-ovsdb-client-dump
ovs-vsctl-show when interfaces are missing
https://gist.github.com/nmathew/d7d472b938f389c4efbadd01ef78d466#file-ovs-vsctl-show
ovs-vswitchd-log for the restart duration
https://gist.github.com/nmathew/d7d472b938f389c4efbadd01ef78d466#file-ovs-vswitchd-log
ovsdb-tool-show-log for the restart duration
In this particular instance of run, we lost two interfaces.
we have a script which sets "autoconnect-slaves" to 0, which was introduced for an older version of NM.
grep -lF -e type=ovs-bridge -e type=ovs-interface -e type=ovs-port /etc/NetworkManager/system-connections/*|xargs -I % nmcli connection modify filename % connection.autoconnect-slaves 0 this scripts also runs
currently, that why all "autoconnect-slaves" set to zero.
when we are losing interfaces that port additions are not coming to ovsdb:
2022-08-26T22:38:26.176Z|00179|bridge|INFO|bridge data_bridge: added interface traffic5_iface on port 1
2022-08-26T22:38:26.348Z|00182|bridge|INFO|bridge data_bridge: added interface traffic1_iface on port 2
2022-08-26T22:38:26.376Z|00183|bridge|INFO|bridge data_bridge: added interface bm25c_ext_iface on port 3
2022-08-26T22:38:26.376Z|00184|bridge|INFO|bridge data_bridge: added interface bond0 on port 4
Only 4 interfaces are getting added back, two are missing, "ovsdb-tool -mmmmmm show-log " shows the same.
Any pointers where it is going wrong?
-Nobin