We are having an issue in both IDM servers since 28th, no evidences before this date.
Authentication performance is affected, it goes slowly.
We are trying to figure out where is the issue.
We found this messages when server was starting to consume high memory:
Jan 28 20:16:45 icidmpdc1 sssd: Child [10800]
('ipa.unicc.org':'%BE_ipa.unicc.org') was terminated by own WATCHDOG.
Consult corresponding logs to figure out the reason.
Jan 28 20:16:45 icidmpdc1 be[ipa.unicc.org]: Starting up
We added more memory to one of them and still using more than 95% of memory and it's
still using between 20 to 60% of swap.
And, obviously there are majflt/s:
01:13:02 PM pgpgin/s pgpgout/s fault/s majflt/s pgfree/s pgscank/s pgscand/s
pgsteal/s %vmeff
01:14:01 PM 25.46 710.90 8456.75 0.49 7525.51 630.59 0.00
627.25 99.47
01:15:01 PM 207.28 813.30 7768.93 0.68 7458.57 773.50 0.00
581.38 75.16
01:16:01 PM 1110.16 1076.56 7726.09 2.68 7628.36 1041.29 24.97
840.16 78.79
01:17:01 PM 803.00 750.42 7827.29 1.93 7410.60 1144.91 0.00
765.54 66.86
01:18:01 PM 16282.35 6026.31 37911.53 55.44 17653.13 13243.27 52.22
5828.67 43.84
01:19:01 PM 5636.41 5428.07 17209.47 210.48 8604.65 5133.68 11.86
2333.18 45.34
01:20:02 PM 3108.13 4065.21 10127.76 229.49 6610.96 3183.18 8.94
1441.82 45.17
01:21:01 PM 15298.65 4763.03 13467.79 226.12 39224.22 6995.40 27.79
4130.50 58.81
01:22:01 PM 605.23 4454.37 28790.32 12.51 13404.36 0.00 0.00
0.00 0.00
Average: 1212.61 1222.89 18638.83 24.66 8143.57 730.57 2.68
445.85 60.80
In our monitorization, each 5min memory usage goes up to more than 95%, and after it goes
down to less than 20%
We made a test with node2 stopped and issue persist. I.e. when both nodes are active (also
replication) the issue is accentuated.