Hi,
Just following up with this issue again. I did more testing and found that if I add ldap_use_tokengroups=False, this long pause is significantly reduced. From the last email, it seems it is taking awfully long during sysdb_set_entry_attr during large group update. So I have following questions
1. Why is adding this flag causing it to speed up that much ?
2. Is there any index, which could be used to speed up sysdb_set_entry_attr call ?
3. If I use ldap_use_tokengroups=False, I see during initgroups it is not fetching a few groups (e.g. domain_users/users), which seems to have a tokenGroups attribute. What can we do to work around this?
(2020-12-28 14:06:20:075623): [be[mydomain]] [sysdb_ldb_msg_difference] (0x2000): Replaced/extended attr [member] of entry [name=group1188@mydomain,cn=groups,cn=mydomain,cn=sysdb]
(2020-12-28 14:06:20:121118): [be[mydomain]] [sysdb_set_entry_attr] (0x0200): Entry [name=group1188@mydomain,cn=groups,cn=mydomain,cn=sysdb] has set [cache, ts_cache] attrs.
(2020-12-28 14:06:20:121317): [be[mydomain]] [sdap_save_groups] (0x4000): Group 4 members processed!
--
(2020-12-28 14:21:27:074044): [be[mydomain]] [sysdb_ldb_msg_difference] (0x2000): Replaced/extended attr [member] of entry [name=group1188@mydomain,cn=groups,cn=mydomain,cn=sysdb]
(2020-12-28 14:21:27:132745): [be[mydomain]] [sysdb_set_entry_attr] (0x0200): Entry [name=group1188@mydomain,cn=groups,cn=mydomain,cn=sysdb] has set [cache, ts_cache] attrs.
(2020-12-28 14:21:27:132947): [be[mydomain]] [sdap_save_groups] (0x4000): Group 0 members processed!
--
(2020-12-28 14:42:38:786851): [be[mydomain]] [sysdb_ldb_msg_difference] (0x2000): Replaced/extended attr [member] of entry [name=group1188@mydomain,cn=groups,cn=mydomain,cn=sysdb]
(2020-12-28 14:42:38:846446): [be[mydomain]] [sysdb_set_entry_attr] (0x0200): Entry [name=group1188@mydomain,cn=groups,cn=mydomain,cn=sysdb] has set [cache, ts_cache] attrs.
(2020-12-28 14:42:38:846693): [be[mydomain]] [sdap_save_groups] (0x4000): Group 0 members processed!
--
(2020-12-28 15:03:15:421853): [be[mydomain]] [sysdb_ldb_msg_difference] (0x2000): Replaced/extended attr [member] of entry [name=group1188@mydomain,cn=groups,cn=mydomain,cn=sysdb]
(2020-12-28 15:03:15:483935): [be[mydomain]] [sysdb_set_entry_attr] (0x0200): Entry [name=group1188@mydomain,cn=groups,cn=mydomain,cn=sysdb] has set [cache, ts_cache] attrs.
(2020-12-28 15:03:15:484154): [be[mydomain]] [sdap_save_groups] (0x4000): Group 0 members processed!
--
(2020-12-28 15:11:14:331469): [be[mydomain]] [sysdb_ldb_msg_difference] (0x2000): Replaced/extended attr [member] of entry [name=group1188@mydomain,cn=groups,cn=mydomain,cn=sysdb]
(2020-12-28 15:11:14:382334): [be[mydomain]] [sysdb_set_entry_attr] (0x0200): Entry [name=group1188@mydomain,cn=groups,cn=mydomain,cn=sysdb] has set [cache, ts_cache] attrs.
(2020-12-28 15:11:14:382496): [be[mydomain]] [sdap_save_groups] (0x4000): Group 4 members processed!
--
(2020-12-28 15:33:48:861686): [be[mydomain]] [sysdb_ldb_msg_difference] (0x2000): Replaced/extended attr [member] of entry [name=group1188@mydomain,cn=groups,cn=mydomain,cn=sysdb]
(2020-12-28 15:33:48:921684): [be[mydomain]] [sysdb_set_entry_attr] (0x0200): Entry [name=group1188@mydomain,cn=groups,cn=mydomain,cn=sysdb] has set [cache, ts_cache] attrs.
(2020-12-28 15:33:48:921889): [be[mydomain]] [sdap_save_groups] (0x4000): Group 0 members processed!
--
(2020-12-28 15:53:47:268799): [be[mydomain]] [sysdb_ldb_msg_difference] (0x2000): Replaced/extended attr [member] of entry [name=group1188@mydomain,cn=groups,cn=mydomain,cn=sysdb]
(2020-12-28 15:53:47:325466): [be[mydomain]] [sysdb_set_entry_attr] (0x0200): Entry [name=group1188@mydomain,cn=groups,cn=mydomain,cn=sysdb] has set [cache, ts_cache] attrs.
(2020-12-28 15:53:47:325696): [be[mydomain]] [sdap_save_groups] (0x4000): Group 0 members processed!
--
(2020-12-28 16:13:14:107362): [be[mydomain]] [sysdb_ldb_msg_difference] (0x2000): Replaced/extended attr [member] of entry [name=group1188@mydomain,cn=groups,cn=mydomain,cn=sysdb]
(2020-12-28 16:13:14:166806): [be[mydomain]] [sysdb_set_entry_attr] (0x0200): Entry [name=group1188@mydomain,cn=groups,cn=mydomain,cn=sysdb] has set [cache, ts_cache] attrs.
(2020-12-28 16:13:14:167047): [be[mydomain]] [sdap_save_groups] (0x4000): Group 0 members processed!
--
(2020-12-28 16:16:14:032217): [be[mydomain]] [sysdb_ldb_msg_difference] (0x2000): Replaced/extended attr [member] of entry [name=group1188@mydomain,cn=groups,cn=mydomain,cn=sysdb]
(2020-12-28 16:16:14:080719): [be[mydomain]] [sysdb_set_entry_attr] (0x0200): Entry [name=group1188@mydomain,cn=groups,cn=mydomain,cn=sysdb] has set [cache, ts_cache] attrs.
(2020-12-28 16:16:14:080890): [be[mydomain]] [sdap_save_groups] (0x4000): Group 4 members processed!
--
(2020-12-28 16:32:42:368442): [be[mydomain]] [sysdb_ldb_msg_difference] (0x2000): Replaced/extended attr [member] of entry [name=group1188@mydomain,cn=groups,cn=mydomain,cn=sysdb]
(2020-12-28 16:32:42:428655): [be[mydomain]] [sysdb_set_entry_attr] (0x0200): Entry [name=group1188@mydomain,cn=groups,cn=mydomain,cn=sysdb] has set [cache, ts_cache] attrs.
(2020-12-28 16:32:42:428890): [be[mydomain]] [sdap_save_groups] (0x4000): Group 0 members processed!
--
(2020-12-28 16:49:12:657265): [be[mydomain]] [sysdb_ldb_msg_difference] (0x2000): Replaced/extended attr [member] of entry [name=group1188@mydomain,cn=groups,cn=mydomain,cn=sysdb]
(2020-12-28 16:49:12:715830): [be[mydomain]] [sysdb_set_entry_attr] (0x0200): Entry [name=group1188@mydomain,cn=groups,cn=mydomain,cn=sysdb] has set [cache, ts_cache] attrs.
(2020-12-28 16:49:12:716071): [be[mydomain]] [sdap_save_groups] (0x4000): Group 0 members processed!
--
(2020-12-28 17:05:17:976739): [be[mydomain]] [sysdb_ldb_msg_difference] (0x2000): Replaced/extended attr [member] of entry [name=group1188@mydomain,cn=groups,cn=mydomain,cn=sysdb]
(2020-12-28 17:05:18:035818): [be[mydomain]] [sysdb_set_entry_attr] (0x0200): Entry [name=group1188@mydomain,cn=groups,cn=mydomain,cn=sysdb] has set [cache, ts_cache] attrs.
(2020-12-28 17:05:18:036043): [be[mydomain]] [sdap_save_groups] (0x4000): Group 0 members processed!
--
(2020-12-28 17:21:14:090058): [be[mydomain]] [sysdb_ldb_msg_difference] (0x2000): Replaced/extended attr [member] of entry [name=group1188@mydomain,cn=groups,cn=mydomain,cn=sysdb]
(2020-12-28 17:21:14:147189): [be[mydomain]] [sysdb_set_entry_attr] (0x0200): Entry [name=group1188@mydomain,cn=groups,cn=mydomain,cn=sysdb] has set [cache, ts_cache] attrs.
(2020-12-28 17:21:14:147382): [be[mydomain]] [sdap_save_groups] (0x4000): Group 4 members processed!
--
(2020-12-28 17:43:12:423857): [be[mydomain]] [sysdb_ldb_msg_difference] (0x2000): Replaced/extended attr [member] of entry [name=group1188@mydomain,cn=groups,cn=mydomain,cn=sysdb]
(2020-12-28 17:43:12:483306): [be[mydomain]] [sysdb_set_entry_attr] (0x0200): Entry [name=group1188@mydomain,cn=groups,cn=mydomain,cn=sysdb] has set [cache, ts_cache] attrs.
(2020-12-28 17:43:12:483531): [be[mydomain]] [sdap_save_groups] (0x4000): Group 0 members processed!
--
(2020-12-28 18:03:49:458768): [be[mydomain]] [sysdb_ldb_msg_difference] (0x2000): Replaced/extended attr [member] of entry [name=group1188@mydomain,cn=groups,cn=mydomain,cn=sysdb]
(2020-12-28 18:03:49:517741): [be[mydomain]] [sysdb_set_entry_attr] (0x0200): Entry [name=group1188@mydomain,cn=groups,cn=mydomain,cn=sysdb] has set [cache, ts_cache] attrs.
(2020-12-28 18:03:49:517932): [be[mydomain]] [sdap_save_groups] (0x4000): Group 0 members processed!
--
(2020-12-28 18:19:40:572151): [be[mydomain]] [sysdb_ldb_msg_difference] (0x2000): Replaced/extended attr [member] of entry [name=group1188@mydomain,cn=groups,cn=mydomain,cn=sysdb]
(2020-12-28 18:19:40:630836): [be[mydomain]] [sysdb_set_entry_attr] (0x0200): Entry [name=group1188@mydomain,cn=groups,cn=mydomain,cn=sysdb] has set [cache, ts_cache] attrs.
(2020-12-28 18:19:40:631037): [be[mydomain]] [sdap_save_groups] (0x4000): Group 0 members processed!
--
(2020-12-28 18:26:14:880640): [be[mydomain]] [sysdb_ldb_msg_difference] (0x2000): Replaced/extended attr [member] of entry [name=group1188@mydomain,cn=groups,cn=mydomain,cn=sysdb]
(2020-12-28 18:26:14:933184): [be[mydomain]] [sysdb_set_entry_attr] (0x0200): Entry [name=group1188@mydomain,cn=groups,cn=mydomain,cn=sysdb] has set [cache, ts_cache] attrs.
(2020-12-28 18:26:14:933429): [be[mydomain]] [sdap_save_groups] (0x4000): Group 4 members processed!