Hello, I am trying to install 3 replicas agains the same master. Two out of 3 installs succeed, while the other one fails with
On replica: Connection from replica to master is OK. Start listening on required ports for remote master check Get credentials to log in to remote master Check RPC connection to remote master Execute check on remote master ERROR: Remote master check failed with following error message(s): an internal error has occurred
2024-03-28T09:09:28Z DEBUG Starting external process 2024-03-28T09:09:28Z DEBUG args=['/usr/sbin/ipa-client-install', '--unattended', '--uninstall'] 2024-03-28T09:09:31Z DEBUG Process finished, return code=0 2024-03-28T09:09:31Z DEBUG File "/usr/lib/python3.6/site-packages/ipapython/admintool.py", line 180, in execute return_value = self.run() File "/usr/lib/python3.6/site-packages/ipapython/install/cli.py", line 344, in run return cfgr.run() File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 358, in run self.validate() File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 368, in validate for _nothing in self._validator(): File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 431, in __runner exc_handler(exc_info) File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 455, in _handle_validate_exception self._handle_exception(exc_info) File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 450, in _handle_exception six.reraise(*exc_info) File "/usr/lib/python3.6/site-packages/six.py", line 693, in reraise raise value File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 421, in __runner step() File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 418, in <lambda> step = lambda: next(self.__gen) File "/usr/lib/python3.6/site-packages/ipapython/install/util.py", line 81, in run_generator_with_yield_from six.reraise(*exc_info) File "/usr/lib/python3.6/site-packages/six.py", line 693, in reraise raise value File "/usr/lib/python3.6/site-packages/ipapython/install/util.py", line 59, in run_generator_with_yield_from value = gen.send(prev_value) File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 633, in _configure next(validator) File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 431, in __runner exc_handler(exc_info) File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 455, in _handle_validate_exception self._handle_exception(exc_info) File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 518, in _handle_exception self.__parent._handle_exception(exc_info) File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 450, in _handle_exception six.reraise(*exc_info) File "/usr/lib/python3.6/site-packages/six.py", line 693, in reraise raise value File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 515, in _handle_exception super(ComponentBase, self)._handle_exception(exc_info) File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 450, in _handle_exception six.reraise(*exc_info) File "/usr/lib/python3.6/site-packages/six.py", line 693, in reraise raise value File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 421, in __runner step() File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 418, in <lambda> step = lambda: next(self.__gen) File "/usr/lib/python3.6/site-packages/ipapython/install/util.py", line 81, in run_generator_with_yield_from six.reraise(*exc_info) File "/usr/lib/python3.6/site-packages/six.py", line 693, in reraise raise value File "/usr/lib/python3.6/site-packages/ipapython/install/util.py", line 59, in run_generator_with_yield_from value = gen.send(prev_value) File "/usr/lib/python3.6/site-packages/ipapython/install/common.py", line 65, in _install for unused in self._installer(self.parent): File "/usr/lib/python3.6/site-packages/ipaserver/install/server/__init__.py", line 597, in main replica_promote_check(self) File "/usr/lib/python3.6/site-packages/ipaserver/install/server/replicainstall.py", line 401, in decorated func(installer) File "/usr/lib/python3.6/site-packages/ipaserver/install/server/replicainstall.py", line 423, in decorated func(installer) File "/usr/lib/python3.6/site-packages/ipaserver/install/server/replicainstall.py", line 1196, in promote_check ca_cert_file=cafile) File "/usr/lib/python3.6/site-packages/ipaserver/install/replication.py", line 129, in replica_conn_check "Connection check failed!"
2024-03-28T09:09:31Z DEBUG The ipa-replica-install command failed, exception: ScriptError: Connection check failed! See /var/log/ipareplica-conncheck.log for more information. If the check results are not valid it can be skipped with --skip-conncheck parameter. 2024-03-28T09:09:31Z ERROR Connection check failed! See /var/log/ipareplica-conncheck.log for more information. If the check results are not valid it can be skipped with --skip-conncheck parameter. 2024-03-28T09:09:31Z ERROR The ipa-replica-install command failed. See /var/log/ipareplica-install.log for more information
On master: [Thu Mar 28 09:09:27.891561 2024] [:error] [pid 22098] ipa: ERROR: non-public: DBusException: org.freedesktop.DBus.Error.NoReply: Did not receive a reply. Possible causes include: the remote application did not send a reply, the message bus security policy blocked the reply, the reply timeout expired, or the network connection was broken. [Thu Mar 28 09:09:27.891666 2024] [:error] [pid 22098] Traceback (most recent call last): [Thu Mar 28 09:09:27.891683 2024] [:error] [pid 22098] File "/usr/lib/python2.7/site-packages/ipaserver/rpcserver.py", line 369, in wsgi_execute [Thu Mar 28 09:09:27.891694 2024] [:error] [pid 22098] result = command(*args, **options) [Thu Mar 28 09:09:27.891705 2024] [:error] [pid 22098] File "/usr/lib/python2.7/site-packages/ipalib/frontend.py", line 450, in __call__ [Thu Mar 28 09:09:27.891717 2024] [:error] [pid 22098] return self.__do_call(*args, **options) [Thu Mar 28 09:09:27.891727 2024] [:error] [pid 22098] File "/usr/lib/python2.7/site-packages/ipalib/frontend.py", line 478, in __do_call [Thu Mar 28 09:09:27.891737 2024] [:error] [pid 22098] ret = self.run(*args, **options) [Thu Mar 28 09:09:27.891748 2024] [:error] [pid 22098] File "/usr/lib/python2.7/site-packages/ipalib/frontend.py", line 800, in run [Thu Mar 28 09:09:27.891928 2024] [:error] [pid 22098] return self.execute(*args, **options) [Thu Mar 28 09:09:27.891951 2024] [:error] [pid 22098] File "/usr/lib/python2.7/site-packages/ipaserver/plugins/server.py", line 933, in execute [Thu Mar 28 09:09:27.891962 2024] [:error] [pid 22098] ret, stdout, _stderr = server.conncheck(keys[-1]) [Thu Mar 28 09:09:27.891973 2024] [:error] [pid 22098] File "/usr/lib64/python2.7/site-packages/dbus/proxies.py", line 70, in __call__ [Thu Mar 28 09:09:27.891983 2024] [:error] [pid 22098] return self._proxy_method(*args, **keywords) [Thu Mar 28 09:09:27.891994 2024] [:error] [pid 22098] File "/usr/lib64/python2.7/site-packages/dbus/proxies.py", line 145, in __call__ [Thu Mar 28 09:09:27.892005 2024] [:error] [pid 22098] **keywords) [Thu Mar 28 09:09:27.892016 2024] [:error] [pid 22098] File "/usr/lib64/python2.7/site-packages/dbus/connection.py", line 651, in call_blocking [Thu Mar 28 09:09:27.892026 2024] [:error] [pid 22098] message, timeout) [Thu Mar 28 09:09:27.892037 2024] [:error] [pid 22098] DBusException: org.freedesktop.DBus.Error.NoReply: Did not receive a reply. Possible causes include: the remote application did not send a reply, the message bus security policy blocked the reply, the reply timeout expired, or the network connection was broken. [Thu Mar 28 09:09:27.892955 2024] [:error] [pid 22098] ipa: INFO: [jsonserver_kerb] local_admin@EXAMPLE.COM: server_conncheck(u'ipamaster01.example.com', u'ipa-replica03.example.com', version=u'2.162'): InternalError [Thu Mar 28 09:09:30.121019 2024] [:error] [pid 20997] ipa: INFO: [jsonserver_kerb] host/ipa-replica03.example.com@EXAMPLE.COM: host_disable(u'ipa-replica03.example.com'): SUCCESS
Any ideas on where to look next?
On Fri, Mar 29, 2024 at 4:58 AM D S via FreeIPA-users freeipa-users@lists.fedorahosted.org wrote:
Any ideas on where to look next?
Replica-to-be log says connection check failed. Master seems to say its replies are being ignored. Could the replica-to-be's firewall be blocking things?
D S via FreeIPA-users wrote:
Any ideas on where to look next?
I believe you posed the same question on the freeipa-container package.
It might have helped if you'd posted here that you were using containers, what underlying OS's were being used and the version of IPA.
Did you try pointing the 3rd replica to one of the other two?
Did you try with --skip-conncheck? The connection checking isn't always perfect which is why the option exists.
rob
Did you resolve that issue? I'm seeing the same. I'm like 100% sure no FW between hosts or network problem. so what to look here?
чт, 28 мар. 2024 г. в 18:48, D S via FreeIPA-users freeipa-users@lists.fedorahosted.org:
Hello, I am trying to install 3 replicas agains the same master. Two out of 3 installs succeed, while the other one fails with
On replica: Connection from replica to master is OK. Start listening on required ports for remote master check Get credentials to log in to remote master Check RPC connection to remote master Execute check on remote master ERROR: Remote master check failed with following error message(s): an internal error has occurred
2024-03-28T09:09:28Z DEBUG Starting external process 2024-03-28T09:09:28Z DEBUG args=['/usr/sbin/ipa-client-install', '--unattended', '--uninstall'] 2024-03-28T09:09:31Z DEBUG Process finished, return code=0 2024-03-28T09:09:31Z DEBUG File "/usr/lib/python3.6/site-packages/ipapython/admintool.py", line 180, in execute return_value = self.run() File "/usr/lib/python3.6/site-packages/ipapython/install/cli.py", line 344, in run return cfgr.run() File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 358, in run self.validate() File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 368, in validate for _nothing in self._validator(): File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 431, in __runner exc_handler(exc_info) File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 455, in _handle_validate_exception self._handle_exception(exc_info) File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 450, in _handle_exception six.reraise(*exc_info) File "/usr/lib/python3.6/site-packages/six.py", line 693, in reraise raise value File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 421, in __runner step() File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 418, in <lambda> step = lambda: next(self.__gen) File "/usr/lib/python3.6/site-packages/ipapython/install/util.py", line 81, in run_generator_with_yield_from six.reraise(*exc_info) File "/usr/lib/python3.6/site-packages/six.py", line 693, in reraise raise value File "/usr/lib/python3.6/site-packages/ipapython/install/util.py", line 59, in run_generator_with_yield_from value = gen.send(prev_value) File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 633, in _configure next(validator) File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 431, in __runner exc_handler(exc_info) File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 455, in _handle_validate_exception self._handle_exception(exc_info) File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 518, in _handle_exception self.__parent._handle_exception(exc_info) File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 450, in _handle_exception six.reraise(*exc_info) File "/usr/lib/python3.6/site-packages/six.py", line 693, in reraise raise value File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 515, in _handle_exception super(ComponentBase, self)._handle_exception(exc_info) File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 450, in _handle_exception six.reraise(*exc_info) File "/usr/lib/python3.6/site-packages/six.py", line 693, in reraise raise value File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 421, in __runner step() File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 418, in <lambda> step = lambda: next(self.__gen) File "/usr/lib/python3.6/site-packages/ipapython/install/util.py", line 81, in run_generator_with_yield_from six.reraise(*exc_info) File "/usr/lib/python3.6/site-packages/six.py", line 693, in reraise raise value File "/usr/lib/python3.6/site-packages/ipapython/install/util.py", line 59, in run_generator_with_yield_from value = gen.send(prev_value) File "/usr/lib/python3.6/site-packages/ipapython/install/common.py", line 65, in _install for unused in self._installer(self.parent): File "/usr/lib/python3.6/site-packages/ipaserver/install/server/__init__.py", line 597, in main replica_promote_check(self) File "/usr/lib/python3.6/site-packages/ipaserver/install/server/replicainstall.py", line 401, in decorated func(installer) File "/usr/lib/python3.6/site-packages/ipaserver/install/server/replicainstall.py", line 423, in decorated func(installer) File "/usr/lib/python3.6/site-packages/ipaserver/install/server/replicainstall.py", line 1196, in promote_check ca_cert_file=cafile) File "/usr/lib/python3.6/site-packages/ipaserver/install/replication.py", line 129, in replica_conn_check "Connection check failed!"
2024-03-28T09:09:31Z DEBUG The ipa-replica-install command failed, exception: ScriptError: Connection check failed! See /var/log/ipareplica-conncheck.log for more information. If the check results are not valid it can be skipped with --skip-conncheck parameter. 2024-03-28T09:09:31Z ERROR Connection check failed! See /var/log/ipareplica-conncheck.log for more information. If the check results are not valid it can be skipped with --skip-conncheck parameter. 2024-03-28T09:09:31Z ERROR The ipa-replica-install command failed. See /var/log/ipareplica-install.log for more information
On master: [Thu Mar 28 09:09:27.891561 2024] [:error] [pid 22098] ipa: ERROR: non-public: DBusException: org.freedesktop.DBus.Error.NoReply: Did not receive a reply. Possible causes include: the remote application did not send a reply, the message bus security policy blocked the reply, the reply timeout expired, or the network connection was broken. [Thu Mar 28 09:09:27.891666 2024] [:error] [pid 22098] Traceback (most recent call last): [Thu Mar 28 09:09:27.891683 2024] [:error] [pid 22098] File "/usr/lib/python2.7/site-packages/ipaserver/rpcserver.py", line 369, in wsgi_execute [Thu Mar 28 09:09:27.891694 2024] [:error] [pid 22098] result = command(*args, **options) [Thu Mar 28 09:09:27.891705 2024] [:error] [pid 22098] File "/usr/lib/python2.7/site-packages/ipalib/frontend.py", line 450, in __call__ [Thu Mar 28 09:09:27.891717 2024] [:error] [pid 22098] return self.__do_call(*args, **options) [Thu Mar 28 09:09:27.891727 2024] [:error] [pid 22098] File "/usr/lib/python2.7/site-packages/ipalib/frontend.py", line 478, in __do_call [Thu Mar 28 09:09:27.891737 2024] [:error] [pid 22098] ret = self.run(*args, **options) [Thu Mar 28 09:09:27.891748 2024] [:error] [pid 22098] File "/usr/lib/python2.7/site-packages/ipalib/frontend.py", line 800, in run [Thu Mar 28 09:09:27.891928 2024] [:error] [pid 22098] return self.execute(*args, **options) [Thu Mar 28 09:09:27.891951 2024] [:error] [pid 22098] File "/usr/lib/python2.7/site-packages/ipaserver/plugins/server.py", line 933, in execute [Thu Mar 28 09:09:27.891962 2024] [:error] [pid 22098] ret, stdout, _stderr = server.conncheck(keys[-1]) [Thu Mar 28 09:09:27.891973 2024] [:error] [pid 22098] File "/usr/lib64/python2.7/site-packages/dbus/proxies.py", line 70, in __call__ [Thu Mar 28 09:09:27.891983 2024] [:error] [pid 22098] return self._proxy_method(*args, **keywords) [Thu Mar 28 09:09:27.891994 2024] [:error] [pid 22098] File "/usr/lib64/python2.7/site-packages/dbus/proxies.py", line 145, in __call__ [Thu Mar 28 09:09:27.892005 2024] [:error] [pid 22098] **keywords) [Thu Mar 28 09:09:27.892016 2024] [:error] [pid 22098] File "/usr/lib64/python2.7/site-packages/dbus/connection.py", line 651, in call_blocking [Thu Mar 28 09:09:27.892026 2024] [:error] [pid 22098] message, timeout) [Thu Mar 28 09:09:27.892037 2024] [:error] [pid 22098] DBusException: org.freedesktop.DBus.Error.NoReply: Did not receive a reply. Possible causes include: the remote application did not send a reply, the message bus security policy blocked the reply, the reply timeout expired, or the network connection was broken. [Thu Mar 28 09:09:27.892955 2024] [:error] [pid 22098] ipa: INFO: [jsonserver_kerb] local_admin@EXAMPLE.COM: server_conncheck(u'ipamaster01.example.com', u'ipa-replica03.example.com', version=u'2.162'): InternalError [Thu Mar 28 09:09:30.121019 2024] [:error] [pid 20997] ipa: INFO: [jsonserver_kerb] host/ipa-replica03.example.com@EXAMPLE.COM: host_disable(u'ipa-replica03.example.com'): SUCCESS -- _______________________________________________ FreeIPA-users mailing list -- freeipa-users@lists.fedorahosted.org To unsubscribe send an email to freeipa-users-leave@lists.fedorahosted.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedorahosted.org/archives/list/freeipa-users@lists.fedorahoste... Do not reply to spam, report it: https://pagure.io/fedora-infrastructure/new_issue
Hi,
On Mon, Oct 14, 2024 at 5:02 PM alexey safonov via FreeIPA-users < freeipa-users@lists.fedorahosted.org> wrote:
Did you resolve that issue? I'm seeing the same. I'm like 100% sure no FW between hosts or network problem. so what to look here?
If the replica installation is failing during the connection check step, have a look at /var/log/ipareplica-conncheck.log. You will be able to find which server is contacted and what's the issue. You can also check /var/log/httpd/error_log on the server and find if the call actually reached the server. Look for a line with server_conncheck, similar to this one:
[Mon Oct 14 15:58:52.918445 2024] [wsgi:error] [pid 12510:tid 12935] [remote 192.168.121.202:57128] ipa: INFO: [jsonserver_kerb] admin@IPA.TEST: server_conncheck('master.ipa.test', 'replica0.ipa.test', version='2.162'): SUCCESS
Can you provide more information? IPA version, exact command used for replica installation, command output etc... flo
чт, 28 мар. 2024 г. в 18:48, D S via FreeIPA-users freeipa-users@lists.fedorahosted.org:
Hello, I am trying to install 3 replicas agains the same master. Two out of 3
installs succeed, while the other one fails with
On replica: Connection from replica to master is OK. Start listening on required ports for remote master check Get credentials to log in to remote master Check RPC connection to remote master Execute check on remote master ERROR: Remote master check failed with following error message(s): an internal error has occurred
2024-03-28T09:09:28Z DEBUG Starting external process 2024-03-28T09:09:28Z DEBUG args=['/usr/sbin/ipa-client-install',
'--unattended', '--uninstall']
2024-03-28T09:09:31Z DEBUG Process finished, return code=0 2024-03-28T09:09:31Z DEBUG File
"/usr/lib/python3.6/site-packages/ipapython/admintool.py", line 180, in execute
return_value = self.run()
File "/usr/lib/python3.6/site-packages/ipapython/install/cli.py", line
344, in run
return cfgr.run()
File "/usr/lib/python3.6/site-packages/ipapython/install/core.py",
line 358, in run
self.validate()
File "/usr/lib/python3.6/site-packages/ipapython/install/core.py",
line 368, in validate
for _nothing in self._validator():
File "/usr/lib/python3.6/site-packages/ipapython/install/core.py",
line 431, in __runner
exc_handler(exc_info)
File "/usr/lib/python3.6/site-packages/ipapython/install/core.py",
line 455, in _handle_validate_exception
self._handle_exception(exc_info)
File "/usr/lib/python3.6/site-packages/ipapython/install/core.py",
line 450, in _handle_exception
six.reraise(*exc_info)
File "/usr/lib/python3.6/site-packages/six.py", line 693, in reraise raise value File "/usr/lib/python3.6/site-packages/ipapython/install/core.py",
line 421, in __runner
step()
File "/usr/lib/python3.6/site-packages/ipapython/install/core.py",
line 418, in <lambda>
step = lambda: next(self.__gen)
File "/usr/lib/python3.6/site-packages/ipapython/install/util.py",
line 81, in run_generator_with_yield_from
six.reraise(*exc_info)
File "/usr/lib/python3.6/site-packages/six.py", line 693, in reraise raise value File "/usr/lib/python3.6/site-packages/ipapython/install/util.py",
line 59, in run_generator_with_yield_from
value = gen.send(prev_value)
File "/usr/lib/python3.6/site-packages/ipapython/install/core.py",
line 633, in _configure
next(validator)
File "/usr/lib/python3.6/site-packages/ipapython/install/core.py",
line 431, in __runner
exc_handler(exc_info)
File "/usr/lib/python3.6/site-packages/ipapython/install/core.py",
line 455, in _handle_validate_exception
self._handle_exception(exc_info)
File "/usr/lib/python3.6/site-packages/ipapython/install/core.py",
line 518, in _handle_exception
self.__parent._handle_exception(exc_info)
File "/usr/lib/python3.6/site-packages/ipapython/install/core.py",
line 450, in _handle_exception
six.reraise(*exc_info)
File "/usr/lib/python3.6/site-packages/six.py", line 693, in reraise raise value File "/usr/lib/python3.6/site-packages/ipapython/install/core.py",
line 515, in _handle_exception
super(ComponentBase, self)._handle_exception(exc_info)
File "/usr/lib/python3.6/site-packages/ipapython/install/core.py",
line 450, in _handle_exception
six.reraise(*exc_info)
File "/usr/lib/python3.6/site-packages/six.py", line 693, in reraise raise value File "/usr/lib/python3.6/site-packages/ipapython/install/core.py",
line 421, in __runner
step()
File "/usr/lib/python3.6/site-packages/ipapython/install/core.py",
line 418, in <lambda>
step = lambda: next(self.__gen)
File "/usr/lib/python3.6/site-packages/ipapython/install/util.py",
line 81, in run_generator_with_yield_from
six.reraise(*exc_info)
File "/usr/lib/python3.6/site-packages/six.py", line 693, in reraise raise value File "/usr/lib/python3.6/site-packages/ipapython/install/util.py",
line 59, in run_generator_with_yield_from
value = gen.send(prev_value)
File "/usr/lib/python3.6/site-packages/ipapython/install/common.py",
line 65, in _install
for unused in self._installer(self.parent):
File
"/usr/lib/python3.6/site-packages/ipaserver/install/server/__init__.py", line 597, in main
replica_promote_check(self)
File
"/usr/lib/python3.6/site-packages/ipaserver/install/server/replicainstall.py", line 401, in decorated
func(installer)
File
"/usr/lib/python3.6/site-packages/ipaserver/install/server/replicainstall.py", line 423, in decorated
func(installer)
File
"/usr/lib/python3.6/site-packages/ipaserver/install/server/replicainstall.py", line 1196, in promote_check
ca_cert_file=cafile)
File
"/usr/lib/python3.6/site-packages/ipaserver/install/replication.py", line 129, in replica_conn_check
"Connection check failed!"
2024-03-28T09:09:31Z DEBUG The ipa-replica-install command failed,
exception: ScriptError: Connection check failed!
See /var/log/ipareplica-conncheck.log for more information. If the check results are not valid it can be skipped with
--skip-conncheck parameter.
2024-03-28T09:09:31Z ERROR Connection check failed! See /var/log/ipareplica-conncheck.log for more information. If the check results are not valid it can be skipped with
--skip-conncheck parameter.
2024-03-28T09:09:31Z ERROR The ipa-replica-install command failed. See
/var/log/ipareplica-install.log for more information
On master: [Thu Mar 28 09:09:27.891561 2024] [:error] [pid 22098] ipa: ERROR:
non-public: DBusException: org.freedesktop.DBus.Error.NoReply: Did not receive a reply. Possible causes include: the remote application did not send a reply, the message bus security policy blocked the reply, the reply timeout expired, or the network connection was broken.
[Thu Mar 28 09:09:27.891666 2024] [:error] [pid 22098] Traceback (most
recent call last):
[Thu Mar 28 09:09:27.891683 2024] [:error] [pid 22098] File
"/usr/lib/python2.7/site-packages/ipaserver/rpcserver.py", line 369, in wsgi_execute
[Thu Mar 28 09:09:27.891694 2024] [:error] [pid 22098] result =
command(*args, **options)
[Thu Mar 28 09:09:27.891705 2024] [:error] [pid 22098] File
"/usr/lib/python2.7/site-packages/ipalib/frontend.py", line 450, in __call__
[Thu Mar 28 09:09:27.891717 2024] [:error] [pid 22098] return
self.__do_call(*args, **options)
[Thu Mar 28 09:09:27.891727 2024] [:error] [pid 22098] File
"/usr/lib/python2.7/site-packages/ipalib/frontend.py", line 478, in __do_call
[Thu Mar 28 09:09:27.891737 2024] [:error] [pid 22098] ret =
self.run(*args, **options)
[Thu Mar 28 09:09:27.891748 2024] [:error] [pid 22098] File
"/usr/lib/python2.7/site-packages/ipalib/frontend.py", line 800, in run
[Thu Mar 28 09:09:27.891928 2024] [:error] [pid 22098] return
self.execute(*args, **options)
[Thu Mar 28 09:09:27.891951 2024] [:error] [pid 22098] File
"/usr/lib/python2.7/site-packages/ipaserver/plugins/server.py", line 933, in execute
[Thu Mar 28 09:09:27.891962 2024] [:error] [pid 22098] ret, stdout,
_stderr = server.conncheck(keys[-1])
[Thu Mar 28 09:09:27.891973 2024] [:error] [pid 22098] File
"/usr/lib64/python2.7/site-packages/dbus/proxies.py", line 70, in __call__
[Thu Mar 28 09:09:27.891983 2024] [:error] [pid 22098] return
self._proxy_method(*args, **keywords)
[Thu Mar 28 09:09:27.891994 2024] [:error] [pid 22098] File
"/usr/lib64/python2.7/site-packages/dbus/proxies.py", line 145, in __call__
[Thu Mar 28 09:09:27.892005 2024] [:error] [pid 22098] **keywords) [Thu Mar 28 09:09:27.892016 2024] [:error] [pid 22098] File
"/usr/lib64/python2.7/site-packages/dbus/connection.py", line 651, in call_blocking
[Thu Mar 28 09:09:27.892026 2024] [:error] [pid 22098] message,
timeout)
[Thu Mar 28 09:09:27.892037 2024] [:error] [pid 22098] DBusException:
org.freedesktop.DBus.Error.NoReply: Did not receive a reply. Possible causes include: the remote application did not send a reply, the message bus security policy blocked the reply, the reply timeout expired, or the network connection was broken.
[Thu Mar 28 09:09:27.892955 2024] [:error] [pid 22098] ipa: INFO:
[jsonserver_kerb] local_admin@EXAMPLE.COM: server_conncheck(u' ipamaster01.example.com', u'ipa-replica03.example.com', version=u'2.162'): InternalError
[Thu Mar 28 09:09:30.121019 2024] [:error] [pid 20997] ipa: INFO:
[jsonserver_kerb] host/ipa-replica03.example.com@EXAMPLE.COM: host_disable(u'ipa-replica03.example.com'): SUCCESS
-- _______________________________________________ FreeIPA-users mailing list -- freeipa-users@lists.fedorahosted.org To unsubscribe send an email to
freeipa-users-leave@lists.fedorahosted.org
Fedora Code of Conduct:
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives:
https://lists.fedorahosted.org/archives/list/freeipa-users@lists.fedorahoste...
Do not reply to spam, report it:
https://pagure.io/fedora-infrastructure/new_issue
FreeIPA-users mailing list -- freeipa-users@lists.fedorahosted.org To unsubscribe send an email to freeipa-users-leave@lists.fedorahosted.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedorahosted.org/archives/list/freeipa-users@lists.fedorahoste... Do not reply to spam, report it: https://pagure.io/fedora-infrastructure/new_issue
Hi, thank you for your reply,
but it's exactly what the original post is about. replica > master all good, but master to replica is saying "internal error"
on replica Connection from replica to master is OK. Start listening on required ports for remote master check Get credentials to log in to remote master Check RPC connection to remote master Execute check on remote master ERROR: Remote master check failed with following error message(s): an internal error has occurred [root@gcp-nas-vm01 asafonov]#
on master: [Wed Oct 16 13:43:00.892514 2024] [wsgi:error] [pid 273866:tid 274098] [remote 10.128.0.52:52208] ipa: ERROR: non-public: DBusException: org.freedesktop.DBus.Error.NoReply: Did not receive a reply. Possible causes include: the remote application did not send a reply, the message bus security policy blocked the reply, the reply timeout expired, or the network connection was broken. [Wed Oct 16 13:43:00.892606 2024] [wsgi:error] [pid 273866:tid 274098] [remote 10.128.0.52:52208] Traceback (most recent call last): [Wed Oct 16 13:43:00.892621 2024] [wsgi:error] [pid 273866:tid 274098] [remote 10.128.0.52:52208] File "/usr/lib/python3.9/site-packages/ipaserver/rpcserver.py", line 417, in wsgi_execute [Wed Oct 16 13:43:00.892635 2024] [wsgi:error] [pid 273866:tid 274098] [remote 10.128.0.52:52208] result = command(*args, **options) [Wed Oct 16 13:43:00.892675 2024] [wsgi:error] [pid 273866:tid 274098] [remote 10.128.0.52:52208] File "/usr/lib/python3.9/site-packages/ipalib/frontend.py", line 471, in __call__ [Wed Oct 16 13:43:00.892690 2024] [wsgi:error] [pid 273866:tid 274098] [remote 10.128.0.52:52208] return self.__do_call(*args, **options) [Wed Oct 16 13:43:00.892703 2024] [wsgi:error] [pid 273866:tid 274098] [remote 10.128.0.52:52208] File "/usr/lib/python3.9/site-packages/ipalib/frontend.py", line 499, in __do_call [Wed Oct 16 13:43:00.892716 2024] [wsgi:error] [pid 273866:tid 274098] [remote 10.128.0.52:52208] ret = self.run(*args, **options) [Wed Oct 16 13:43:00.892728 2024] [wsgi:error] [pid 273866:tid 274098] [remote 10.128.0.52:52208] File "/usr/lib/python3.9/site-packages/ipalib/frontend.py", line 816, in run [Wed Oct 16 13:43:00.892741 2024] [wsgi:error] [pid 273866:tid 274098] [remote 10.128.0.52:52208] return self.execute(*args, **options) [Wed Oct 16 13:43:00.892754 2024] [wsgi:error] [pid 273866:tid 274098] [remote 10.128.0.52:52208] File "/usr/lib/python3.9/site-packages/ipaserver/plugins/server.py", line 948, in execute [Wed Oct 16 13:43:00.892767 2024] [wsgi:error] [pid 273866:tid 274098] [remote 10.128.0.52:52208] ret, stdout, _stderr = server.conncheck(keys[-1]) [Wed Oct 16 13:43:00.892779 2024] [wsgi:error] [pid 273866:tid 274098] [remote 10.128.0.52:52208] File "/usr/lib64/python3.9/site-packages/dbus/proxies.py", line 72, in __call__ [Wed Oct 16 13:43:00.892792 2024] [wsgi:error] [pid 273866:tid 274098] [remote 10.128.0.52:52208] return self._proxy_method(*args, **keywords) [Wed Oct 16 13:43:00.892805 2024] [wsgi:error] [pid 273866:tid 274098] [remote 10.128.0.52:52208] File "/usr/lib64/python3.9/site-packages/dbus/proxies.py", line 141, in __call__ [Wed Oct 16 13:43:00.892818 2024] [wsgi:error] [pid 273866:tid 274098] [remote 10.128.0.52:52208] return self._connection.call_blocking(self._named_service, [Wed Oct 16 13:43:00.892830 2024] [wsgi:error] [pid 273866:tid 274098] [remote 10.128.0.52:52208] File "/usr/lib64/python3.9/site-packages/dbus/connection.py", line 652, in call_blocking [Wed Oct 16 13:43:00.892843 2024] [wsgi:error] [pid 273866:tid 274098] [remote 10.128.0.52:52208] reply_message = self.send_message_with_reply_and_block( [Wed Oct 16 13:43:00.892856 2024] [wsgi:error] [pid 273866:tid 274098] [remote 10.128.0.52:52208] dbus.exceptions.DBusException: org.freedesktop.DBus.Error.NoReply: Did not receive a reply. Possible causes include: the remote application did not send a reply, the message bus security policy blocked the reply, the reply timeout expired, or the network connection was broken. [Wed Oct 16 13:43:00.893568 2024] [wsgi:error] [pid 273866:tid 274098] [remote 10.128.0.52:52208] ipa: INFO: [jsonserver_session] asafonov@INT.QUANTBOX.IN: server_conncheck('qb-mum-vm02.int.quantbox.in', 'gcp-nas-vm01.int.quantbox.in', version='2.162'): InternalError ~
IPA version is 4.11.0.15
The only difference is that I'm setting this IPA replica in google cloud. it might be somehow related to dbus per-user OS is rocky 9.4
вт, 15 окт. 2024 г. в 17:27, Florence Blanc-Renaud flo@redhat.com:
Hi,
On Mon, Oct 14, 2024 at 5:02 PM alexey safonov via FreeIPA-users freeipa-users@lists.fedorahosted.org wrote:
Did you resolve that issue? I'm seeing the same. I'm like 100% sure no FW between hosts or network problem. so what to look here?
If the replica installation is failing during the connection check step, have a look at /var/log/ipareplica-conncheck.log. You will be able to find which server is contacted and what's the issue. You can also check /var/log/httpd/error_log on the server and find if the call actually reached the server. Look for a line with server_conncheck, similar to this one:
[Mon Oct 14 15:58:52.918445 2024] [wsgi:error] [pid 12510:tid 12935] [remote 192.168.121.202:57128] ipa: INFO: [jsonserver_kerb] admin@IPA.TEST: server_conncheck('master.ipa.test', 'replica0.ipa.test', version='2.162'): SUCCESS
Can you provide more information? IPA version, exact command used for replica installation, command output etc... flo
чт, 28 мар. 2024 г. в 18:48, D S via FreeIPA-users freeipa-users@lists.fedorahosted.org:
Hello, I am trying to install 3 replicas agains the same master. Two out of 3 installs succeed, while the other one fails with
On replica: Connection from replica to master is OK. Start listening on required ports for remote master check Get credentials to log in to remote master Check RPC connection to remote master Execute check on remote master ERROR: Remote master check failed with following error message(s): an internal error has occurred
2024-03-28T09:09:28Z DEBUG Starting external process 2024-03-28T09:09:28Z DEBUG args=['/usr/sbin/ipa-client-install', '--unattended', '--uninstall'] 2024-03-28T09:09:31Z DEBUG Process finished, return code=0 2024-03-28T09:09:31Z DEBUG File "/usr/lib/python3.6/site-packages/ipapython/admintool.py", line 180, in execute return_value = self.run() File "/usr/lib/python3.6/site-packages/ipapython/install/cli.py", line 344, in run return cfgr.run() File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 358, in run self.validate() File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 368, in validate for _nothing in self._validator(): File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 431, in __runner exc_handler(exc_info) File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 455, in _handle_validate_exception self._handle_exception(exc_info) File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 450, in _handle_exception six.reraise(*exc_info) File "/usr/lib/python3.6/site-packages/six.py", line 693, in reraise raise value File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 421, in __runner step() File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 418, in <lambda> step = lambda: next(self.__gen) File "/usr/lib/python3.6/site-packages/ipapython/install/util.py", line 81, in run_generator_with_yield_from six.reraise(*exc_info) File "/usr/lib/python3.6/site-packages/six.py", line 693, in reraise raise value File "/usr/lib/python3.6/site-packages/ipapython/install/util.py", line 59, in run_generator_with_yield_from value = gen.send(prev_value) File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 633, in _configure next(validator) File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 431, in __runner exc_handler(exc_info) File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 455, in _handle_validate_exception self._handle_exception(exc_info) File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 518, in _handle_exception self.__parent._handle_exception(exc_info) File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 450, in _handle_exception six.reraise(*exc_info) File "/usr/lib/python3.6/site-packages/six.py", line 693, in reraise raise value File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 515, in _handle_exception super(ComponentBase, self)._handle_exception(exc_info) File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 450, in _handle_exception six.reraise(*exc_info) File "/usr/lib/python3.6/site-packages/six.py", line 693, in reraise raise value File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 421, in __runner step() File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 418, in <lambda> step = lambda: next(self.__gen) File "/usr/lib/python3.6/site-packages/ipapython/install/util.py", line 81, in run_generator_with_yield_from six.reraise(*exc_info) File "/usr/lib/python3.6/site-packages/six.py", line 693, in reraise raise value File "/usr/lib/python3.6/site-packages/ipapython/install/util.py", line 59, in run_generator_with_yield_from value = gen.send(prev_value) File "/usr/lib/python3.6/site-packages/ipapython/install/common.py", line 65, in _install for unused in self._installer(self.parent): File "/usr/lib/python3.6/site-packages/ipaserver/install/server/__init__.py", line 597, in main replica_promote_check(self) File "/usr/lib/python3.6/site-packages/ipaserver/install/server/replicainstall.py", line 401, in decorated func(installer) File "/usr/lib/python3.6/site-packages/ipaserver/install/server/replicainstall.py", line 423, in decorated func(installer) File "/usr/lib/python3.6/site-packages/ipaserver/install/server/replicainstall.py", line 1196, in promote_check ca_cert_file=cafile) File "/usr/lib/python3.6/site-packages/ipaserver/install/replication.py", line 129, in replica_conn_check "Connection check failed!"
2024-03-28T09:09:31Z DEBUG The ipa-replica-install command failed, exception: ScriptError: Connection check failed! See /var/log/ipareplica-conncheck.log for more information. If the check results are not valid it can be skipped with --skip-conncheck parameter. 2024-03-28T09:09:31Z ERROR Connection check failed! See /var/log/ipareplica-conncheck.log for more information. If the check results are not valid it can be skipped with --skip-conncheck parameter. 2024-03-28T09:09:31Z ERROR The ipa-replica-install command failed. See /var/log/ipareplica-install.log for more information
On master: [Thu Mar 28 09:09:27.891561 2024] [:error] [pid 22098] ipa: ERROR: non-public: DBusException: org.freedesktop.DBus.Error.NoReply: Did not receive a reply. Possible causes include: the remote application did not send a reply, the message bus security policy blocked the reply, the reply timeout expired, or the network connection was broken. [Thu Mar 28 09:09:27.891666 2024] [:error] [pid 22098] Traceback (most recent call last): [Thu Mar 28 09:09:27.891683 2024] [:error] [pid 22098] File "/usr/lib/python2.7/site-packages/ipaserver/rpcserver.py", line 369, in wsgi_execute [Thu Mar 28 09:09:27.891694 2024] [:error] [pid 22098] result = command(*args, **options) [Thu Mar 28 09:09:27.891705 2024] [:error] [pid 22098] File "/usr/lib/python2.7/site-packages/ipalib/frontend.py", line 450, in __call__ [Thu Mar 28 09:09:27.891717 2024] [:error] [pid 22098] return self.__do_call(*args, **options) [Thu Mar 28 09:09:27.891727 2024] [:error] [pid 22098] File "/usr/lib/python2.7/site-packages/ipalib/frontend.py", line 478, in __do_call [Thu Mar 28 09:09:27.891737 2024] [:error] [pid 22098] ret = self.run(*args, **options) [Thu Mar 28 09:09:27.891748 2024] [:error] [pid 22098] File "/usr/lib/python2.7/site-packages/ipalib/frontend.py", line 800, in run [Thu Mar 28 09:09:27.891928 2024] [:error] [pid 22098] return self.execute(*args, **options) [Thu Mar 28 09:09:27.891951 2024] [:error] [pid 22098] File "/usr/lib/python2.7/site-packages/ipaserver/plugins/server.py", line 933, in execute [Thu Mar 28 09:09:27.891962 2024] [:error] [pid 22098] ret, stdout, _stderr = server.conncheck(keys[-1]) [Thu Mar 28 09:09:27.891973 2024] [:error] [pid 22098] File "/usr/lib64/python2.7/site-packages/dbus/proxies.py", line 70, in __call__ [Thu Mar 28 09:09:27.891983 2024] [:error] [pid 22098] return self._proxy_method(*args, **keywords) [Thu Mar 28 09:09:27.891994 2024] [:error] [pid 22098] File "/usr/lib64/python2.7/site-packages/dbus/proxies.py", line 145, in __call__ [Thu Mar 28 09:09:27.892005 2024] [:error] [pid 22098] **keywords) [Thu Mar 28 09:09:27.892016 2024] [:error] [pid 22098] File "/usr/lib64/python2.7/site-packages/dbus/connection.py", line 651, in call_blocking [Thu Mar 28 09:09:27.892026 2024] [:error] [pid 22098] message, timeout) [Thu Mar 28 09:09:27.892037 2024] [:error] [pid 22098] DBusException: org.freedesktop.DBus.Error.NoReply: Did not receive a reply. Possible causes include: the remote application did not send a reply, the message bus security policy blocked the reply, the reply timeout expired, or the network connection was broken. [Thu Mar 28 09:09:27.892955 2024] [:error] [pid 22098] ipa: INFO: [jsonserver_kerb] local_admin@EXAMPLE.COM: server_conncheck(u'ipamaster01.example.com', u'ipa-replica03.example.com', version=u'2.162'): InternalError [Thu Mar 28 09:09:30.121019 2024] [:error] [pid 20997] ipa: INFO: [jsonserver_kerb] host/ipa-replica03.example.com@EXAMPLE.COM: host_disable(u'ipa-replica03.example.com'): SUCCESS -- _______________________________________________ FreeIPA-users mailing list -- freeipa-users@lists.fedorahosted.org To unsubscribe send an email to freeipa-users-leave@lists.fedorahosted.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedorahosted.org/archives/list/freeipa-users@lists.fedorahoste... Do not reply to spam, report it: https://pagure.io/fedora-infrastructure/new_issue
-- _______________________________________________ FreeIPA-users mailing list -- freeipa-users@lists.fedorahosted.org To unsubscribe send an email to freeipa-users-leave@lists.fedorahosted.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedorahosted.org/archives/list/freeipa-users@lists.fedorahoste... Do not reply to spam, report it: https://pagure.io/fedora-infrastructure/new_issue
full reply
[Wed Oct 16 13:47:52.122054 2024] [auth_gssapi:error] [pid 89217:tid 89254] [client 10.128.0.52:56296] Failed to unseal session data!, referer: https://vm01.int/ipa/xml [Wed Oct 16 13:47:53.612307 2024] [wsgi:error] [pid 82186:tid 82436] [remote 10.128.0.52:56296] ipa: INFO: [jsonserver_session] asafonov@INT: ping(): SUCCESS [Wed Oct 16 13:47:53.863208 2024] [auth_gssapi:error] [pid 89217:tid 89255] [client 10.128.0.52:56296] Failed to unseal session data!, referer: https://vm01.int/ipa/xml [Wed Oct 16 13:47:54.307399 2024] [wsgi:error] [pid 82184:tid 82430] [remote 10.128.0.52:56296] ipa: INFO: [jsonserver_session] asafonov@INT: schema(known_fingerprints=('a0b2d00a',), version='2.170'): SchemaUpToDate [Wed Oct 16 13:47:56.426332 2024] [:warn] [pid 89217:tid 89261] [client 10.128.0.52:58550] failed to set perms (3140) on file (/run/ipa/ccaches/asafonov@INT-dyYION)!, referer: https://vm01.int/ipa/xml [Wed Oct 16 13:47:56.440782 2024] [wsgi:error] [pid 82185:tid 82433] [remote 10.128.0.52:58550] ipa: INFO: [jsonserver_session] asafonov@INT: ping(): SUCCESS [Wed Oct 16 13:47:56.678749 2024] [:warn] [pid 89217:tid 89250] [client 10.128.0.52:58550] failed to set perms (3140) on file (/run/ipa/ccaches/asafonov@INT-dyYION)!, referer: https://vm01.int/ipa/xml [Wed Oct 16 13:47:56.692636 2024] [wsgi:error] [pid 82187:tid 82427] [remote 10.128.0.52:58550] ipa: INFO: [jsonserver_session] asafonov@INT: ping/1(version='2.253'): SUCCESS [Wed Oct 16 13:47:56.932151 2024] [:warn] [pid 89217:tid 89269] [client 10.128.0.52:58550] failed to set perms (3140) on file (/run/ipa/ccaches/asafonov@INT-dyYION)!, referer: https://vm01.int/ipa/xml [Wed Oct 16 13:48:22.219141 2024] [wsgi:error] [pid 82186:tid 82436] [remote 10.128.0.52:58550] ipa: ERROR: non-public: DBusException: org.freedesktop.DBus.Error.NoReply: Did not receive a reply. Possible causes include: the remote application did not send a reply, the message bus security policy blocked the reply, the reply timeout expired, or the network connection was broken. [Wed Oct 16 13:48:22.219175 2024] [wsgi:error] [pid 82186:tid 82436] [remote 10.128.0.52:58550] Traceback (most recent call last): [Wed Oct 16 13:48:22.219185 2024] [wsgi:error] [pid 82186:tid 82436] [remote 10.128.0.52:58550] File "/usr/lib/python3.9/site-packages/ipaserver/rpcserver.py", line 417, in wsgi_execute [Wed Oct 16 13:48:22.219196 2024] [wsgi:error] [pid 82186:tid 82436] [remote 10.128.0.52:58550] result = command(*args, **options) [Wed Oct 16 13:48:22.219206 2024] [wsgi:error] [pid 82186:tid 82436] [remote 10.128.0.52:58550] File "/usr/lib/python3.9/site-packages/ipalib/frontend.py", line 471, in __call__ [Wed Oct 16 13:48:22.219215 2024] [wsgi:error] [pid 82186:tid 82436] [remote 10.128.0.52:58550] return self.__do_call(*args, **options) [Wed Oct 16 13:48:22.219228 2024] [wsgi:error] [pid 82186:tid 82436] [remote 10.128.0.52:58550] File "/usr/lib/python3.9/site-packages/ipalib/frontend.py", line 499, in __do_call [Wed Oct 16 13:48:22.219254 2024] [wsgi:error] [pid 82186:tid 82436] [remote 10.128.0.52:58550] ret = self.run(*args, **options) [Wed Oct 16 13:48:22.219265 2024] [wsgi:error] [pid 82186:tid 82436] [remote 10.128.0.52:58550] File "/usr/lib/python3.9/site-packages/ipalib/frontend.py", line 816, in run [Wed Oct 16 13:48:22.219275 2024] [wsgi:error] [pid 82186:tid 82436] [remote 10.128.0.52:58550] return self.execute(*args, **options) [Wed Oct 16 13:48:22.219284 2024] [wsgi:error] [pid 82186:tid 82436] [remote 10.128.0.52:58550] File "/usr/lib/python3.9/site-packages/ipaserver/plugins/server.py", line 948, in execute [Wed Oct 16 13:48:22.219293 2024] [wsgi:error] [pid 82186:tid 82436] [remote 10.128.0.52:58550] ret, stdout, _stderr = server.conncheck(keys[-1]) [Wed Oct 16 13:48:22.219305 2024] [wsgi:error] [pid 82186:tid 82436] [remote 10.128.0.52:58550] File "/usr/lib64/python3.9/site-packages/dbus/proxies.py", line 72, in __call__ [Wed Oct 16 13:48:22.219315 2024] [wsgi:error] [pid 82186:tid 82436] [remote 10.128.0.52:58550] return self._proxy_method(*args, **keywords) [Wed Oct 16 13:48:22.219324 2024] [wsgi:error] [pid 82186:tid 82436] [remote 10.128.0.52:58550] File "/usr/lib64/python3.9/site-packages/dbus/proxies.py", line 141, in __call__ [Wed Oct 16 13:48:22.219333 2024] [wsgi:error] [pid 82186:tid 82436] [remote 10.128.0.52:58550] return self._connection.call_blocking(self._named_service, [Wed Oct 16 13:48:22.219345 2024] [wsgi:error] [pid 82186:tid 82436] [remote 10.128.0.52:58550] File "/usr/lib64/python3.9/site-packages/dbus/connection.py", line 652, in call_blocking [Wed Oct 16 13:48:22.219356 2024] [wsgi:error] [pid 82186:tid 82436] [remote 10.128.0.52:58550] reply_message = self.send_message_with_reply_and_block( [Wed Oct 16 13:48:22.219365 2024] [wsgi:error] [pid 82186:tid 82436] [remote 10.128.0.52:58550] dbus.exceptions.DBusException: org.freedesktop.DBus.Error.NoReply: Did not receive a reply. Possible causes include: the remote application did not send a reply, the message bus security policy blocked the reply, the reply timeout expired, or the network connection was broken. [Wed Oct 16 13:48:22.219684 2024] [wsgi:error] [pid 82186:tid 82436] [remote 10.128.0.52:58550] ipa: INFO: [jsonserver_session] asafonov@INT: server_conncheck('vm01.int', 'gcp-nas-vm01.int', version='2.162'): InternalError
ср, 16 окт. 2024 г. в 16:15, alexey safonov alexeysaff@gmail.com:
Hi, thank you for your reply,
but it's exactly what the original post is about. replica > master all good, but master to replica is saying "internal error"
on replica Connection from replica to master is OK. Start listening on required ports for remote master check Get credentials to log in to remote master Check RPC connection to remote master Execute check on remote master ERROR: Remote master check failed with following error message(s): an internal error has occurred [root@gcp-nas-vm01 asafonov]#
on master: [Wed Oct 16 13:43:00.892514 2024] [wsgi:error] [pid 273866:tid 274098] [remote 10.128.0.52:52208] ipa: ERROR: non-public: DBusException: org.freedesktop.DBus.Error.NoReply: Did not receive a reply. Possible causes include: the remote application did not send a reply, the message bus security policy blocked the reply, the reply timeout expired, or the network connection was broken. [Wed Oct 16 13:43:00.892606 2024] [wsgi:error] [pid 273866:tid 274098] [remote 10.128.0.52:52208] Traceback (most recent call last): [Wed Oct 16 13:43:00.892621 2024] [wsgi:error] [pid 273866:tid 274098] [remote 10.128.0.52:52208] File "/usr/lib/python3.9/site-packages/ipaserver/rpcserver.py", line 417, in wsgi_execute [Wed Oct 16 13:43:00.892635 2024] [wsgi:error] [pid 273866:tid 274098] [remote 10.128.0.52:52208] result = command(*args, **options) [Wed Oct 16 13:43:00.892675 2024] [wsgi:error] [pid 273866:tid 274098] [remote 10.128.0.52:52208] File "/usr/lib/python3.9/site-packages/ipalib/frontend.py", line 471, in __call__ [Wed Oct 16 13:43:00.892690 2024] [wsgi:error] [pid 273866:tid 274098] [remote 10.128.0.52:52208] return self.__do_call(*args, **options) [Wed Oct 16 13:43:00.892703 2024] [wsgi:error] [pid 273866:tid 274098] [remote 10.128.0.52:52208] File "/usr/lib/python3.9/site-packages/ipalib/frontend.py", line 499, in __do_call [Wed Oct 16 13:43:00.892716 2024] [wsgi:error] [pid 273866:tid 274098] [remote 10.128.0.52:52208] ret = self.run(*args, **options) [Wed Oct 16 13:43:00.892728 2024] [wsgi:error] [pid 273866:tid 274098] [remote 10.128.0.52:52208] File "/usr/lib/python3.9/site-packages/ipalib/frontend.py", line 816, in run [Wed Oct 16 13:43:00.892741 2024] [wsgi:error] [pid 273866:tid 274098] [remote 10.128.0.52:52208] return self.execute(*args, **options) [Wed Oct 16 13:43:00.892754 2024] [wsgi:error] [pid 273866:tid 274098] [remote 10.128.0.52:52208] File "/usr/lib/python3.9/site-packages/ipaserver/plugins/server.py", line 948, in execute [Wed Oct 16 13:43:00.892767 2024] [wsgi:error] [pid 273866:tid 274098] [remote 10.128.0.52:52208] ret, stdout, _stderr = server.conncheck(keys[-1]) [Wed Oct 16 13:43:00.892779 2024] [wsgi:error] [pid 273866:tid 274098] [remote 10.128.0.52:52208] File "/usr/lib64/python3.9/site-packages/dbus/proxies.py", line 72, in __call__ [Wed Oct 16 13:43:00.892792 2024] [wsgi:error] [pid 273866:tid 274098] [remote 10.128.0.52:52208] return self._proxy_method(*args, **keywords) [Wed Oct 16 13:43:00.892805 2024] [wsgi:error] [pid 273866:tid 274098] [remote 10.128.0.52:52208] File "/usr/lib64/python3.9/site-packages/dbus/proxies.py", line 141, in __call__ [Wed Oct 16 13:43:00.892818 2024] [wsgi:error] [pid 273866:tid 274098] [remote 10.128.0.52:52208] return self._connection.call_blocking(self._named_service, [Wed Oct 16 13:43:00.892830 2024] [wsgi:error] [pid 273866:tid 274098] [remote 10.128.0.52:52208] File "/usr/lib64/python3.9/site-packages/dbus/connection.py", line 652, in call_blocking [Wed Oct 16 13:43:00.892843 2024] [wsgi:error] [pid 273866:tid 274098] [remote 10.128.0.52:52208] reply_message = self.send_message_with_reply_and_block( [Wed Oct 16 13:43:00.892856 2024] [wsgi:error] [pid 273866:tid 274098] [remote 10.128.0.52:52208] dbus.exceptions.DBusException: org.freedesktop.DBus.Error.NoReply: Did not receive a reply. Possible causes include: the remote application did not send a reply, the message bus security policy blocked the reply, the reply timeout expired, or the network connection was broken. [Wed Oct 16 13:43:00.893568 2024] [wsgi:error] [pid 273866:tid 274098] [remote 10.128.0.52:52208] ipa: INFO: [jsonserver_session] asafonov@INT.QUANTBOX.IN: server_conncheck('qb-mum-vm02.int.quantbox.in', 'gcp-nas-vm01.int.quantbox.in', version='2.162'): InternalError ~
IPA version is 4.11.0.15
The only difference is that I'm setting this IPA replica in google cloud. it might be somehow related to dbus per-user OS is rocky 9.4
вт, 15 окт. 2024 г. в 17:27, Florence Blanc-Renaud flo@redhat.com:
Hi,
On Mon, Oct 14, 2024 at 5:02 PM alexey safonov via FreeIPA-users freeipa-users@lists.fedorahosted.org wrote:
Did you resolve that issue? I'm seeing the same. I'm like 100% sure no FW between hosts or network problem. so what to look here?
If the replica installation is failing during the connection check step, have a look at /var/log/ipareplica-conncheck.log. You will be able to find which server is contacted and what's the issue. You can also check /var/log/httpd/error_log on the server and find if the call actually reached the server. Look for a line with server_conncheck, similar to this one:
[Mon Oct 14 15:58:52.918445 2024] [wsgi:error] [pid 12510:tid 12935] [remote 192.168.121.202:57128] ipa: INFO: [jsonserver_kerb] admin@IPA.TEST: server_conncheck('master.ipa.test', 'replica0.ipa.test', version='2.162'): SUCCESS
Can you provide more information? IPA version, exact command used for replica installation, command output etc... flo
чт, 28 мар. 2024 г. в 18:48, D S via FreeIPA-users freeipa-users@lists.fedorahosted.org:
Hello, I am trying to install 3 replicas agains the same master. Two out of 3 installs succeed, while the other one fails with
On replica: Connection from replica to master is OK. Start listening on required ports for remote master check Get credentials to log in to remote master Check RPC connection to remote master Execute check on remote master ERROR: Remote master check failed with following error message(s): an internal error has occurred
2024-03-28T09:09:28Z DEBUG Starting external process 2024-03-28T09:09:28Z DEBUG args=['/usr/sbin/ipa-client-install', '--unattended', '--uninstall'] 2024-03-28T09:09:31Z DEBUG Process finished, return code=0 2024-03-28T09:09:31Z DEBUG File "/usr/lib/python3.6/site-packages/ipapython/admintool.py", line 180, in execute return_value = self.run() File "/usr/lib/python3.6/site-packages/ipapython/install/cli.py", line 344, in run return cfgr.run() File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 358, in run self.validate() File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 368, in validate for _nothing in self._validator(): File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 431, in __runner exc_handler(exc_info) File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 455, in _handle_validate_exception self._handle_exception(exc_info) File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 450, in _handle_exception six.reraise(*exc_info) File "/usr/lib/python3.6/site-packages/six.py", line 693, in reraise raise value File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 421, in __runner step() File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 418, in <lambda> step = lambda: next(self.__gen) File "/usr/lib/python3.6/site-packages/ipapython/install/util.py", line 81, in run_generator_with_yield_from six.reraise(*exc_info) File "/usr/lib/python3.6/site-packages/six.py", line 693, in reraise raise value File "/usr/lib/python3.6/site-packages/ipapython/install/util.py", line 59, in run_generator_with_yield_from value = gen.send(prev_value) File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 633, in _configure next(validator) File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 431, in __runner exc_handler(exc_info) File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 455, in _handle_validate_exception self._handle_exception(exc_info) File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 518, in _handle_exception self.__parent._handle_exception(exc_info) File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 450, in _handle_exception six.reraise(*exc_info) File "/usr/lib/python3.6/site-packages/six.py", line 693, in reraise raise value File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 515, in _handle_exception super(ComponentBase, self)._handle_exception(exc_info) File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 450, in _handle_exception six.reraise(*exc_info) File "/usr/lib/python3.6/site-packages/six.py", line 693, in reraise raise value File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 421, in __runner step() File "/usr/lib/python3.6/site-packages/ipapython/install/core.py", line 418, in <lambda> step = lambda: next(self.__gen) File "/usr/lib/python3.6/site-packages/ipapython/install/util.py", line 81, in run_generator_with_yield_from six.reraise(*exc_info) File "/usr/lib/python3.6/site-packages/six.py", line 693, in reraise raise value File "/usr/lib/python3.6/site-packages/ipapython/install/util.py", line 59, in run_generator_with_yield_from value = gen.send(prev_value) File "/usr/lib/python3.6/site-packages/ipapython/install/common.py", line 65, in _install for unused in self._installer(self.parent): File "/usr/lib/python3.6/site-packages/ipaserver/install/server/__init__.py", line 597, in main replica_promote_check(self) File "/usr/lib/python3.6/site-packages/ipaserver/install/server/replicainstall.py", line 401, in decorated func(installer) File "/usr/lib/python3.6/site-packages/ipaserver/install/server/replicainstall.py", line 423, in decorated func(installer) File "/usr/lib/python3.6/site-packages/ipaserver/install/server/replicainstall.py", line 1196, in promote_check ca_cert_file=cafile) File "/usr/lib/python3.6/site-packages/ipaserver/install/replication.py", line 129, in replica_conn_check "Connection check failed!"
2024-03-28T09:09:31Z DEBUG The ipa-replica-install command failed, exception: ScriptError: Connection check failed! See /var/log/ipareplica-conncheck.log for more information. If the check results are not valid it can be skipped with --skip-conncheck parameter. 2024-03-28T09:09:31Z ERROR Connection check failed! See /var/log/ipareplica-conncheck.log for more information. If the check results are not valid it can be skipped with --skip-conncheck parameter. 2024-03-28T09:09:31Z ERROR The ipa-replica-install command failed. See /var/log/ipareplica-install.log for more information
On master: [Thu Mar 28 09:09:27.891561 2024] [:error] [pid 22098] ipa: ERROR: non-public: DBusException: org.freedesktop.DBus.Error.NoReply: Did not receive a reply. Possible causes include: the remote application did not send a reply, the message bus security policy blocked the reply, the reply timeout expired, or the network connection was broken. [Thu Mar 28 09:09:27.891666 2024] [:error] [pid 22098] Traceback (most recent call last): [Thu Mar 28 09:09:27.891683 2024] [:error] [pid 22098] File "/usr/lib/python2.7/site-packages/ipaserver/rpcserver.py", line 369, in wsgi_execute [Thu Mar 28 09:09:27.891694 2024] [:error] [pid 22098] result = command(*args, **options) [Thu Mar 28 09:09:27.891705 2024] [:error] [pid 22098] File "/usr/lib/python2.7/site-packages/ipalib/frontend.py", line 450, in __call__ [Thu Mar 28 09:09:27.891717 2024] [:error] [pid 22098] return self.__do_call(*args, **options) [Thu Mar 28 09:09:27.891727 2024] [:error] [pid 22098] File "/usr/lib/python2.7/site-packages/ipalib/frontend.py", line 478, in __do_call [Thu Mar 28 09:09:27.891737 2024] [:error] [pid 22098] ret = self.run(*args, **options) [Thu Mar 28 09:09:27.891748 2024] [:error] [pid 22098] File "/usr/lib/python2.7/site-packages/ipalib/frontend.py", line 800, in run [Thu Mar 28 09:09:27.891928 2024] [:error] [pid 22098] return self.execute(*args, **options) [Thu Mar 28 09:09:27.891951 2024] [:error] [pid 22098] File "/usr/lib/python2.7/site-packages/ipaserver/plugins/server.py", line 933, in execute [Thu Mar 28 09:09:27.891962 2024] [:error] [pid 22098] ret, stdout, _stderr = server.conncheck(keys[-1]) [Thu Mar 28 09:09:27.891973 2024] [:error] [pid 22098] File "/usr/lib64/python2.7/site-packages/dbus/proxies.py", line 70, in __call__ [Thu Mar 28 09:09:27.891983 2024] [:error] [pid 22098] return self._proxy_method(*args, **keywords) [Thu Mar 28 09:09:27.891994 2024] [:error] [pid 22098] File "/usr/lib64/python2.7/site-packages/dbus/proxies.py", line 145, in __call__ [Thu Mar 28 09:09:27.892005 2024] [:error] [pid 22098] **keywords) [Thu Mar 28 09:09:27.892016 2024] [:error] [pid 22098] File "/usr/lib64/python2.7/site-packages/dbus/connection.py", line 651, in call_blocking [Thu Mar 28 09:09:27.892026 2024] [:error] [pid 22098] message, timeout) [Thu Mar 28 09:09:27.892037 2024] [:error] [pid 22098] DBusException: org.freedesktop.DBus.Error.NoReply: Did not receive a reply. Possible causes include: the remote application did not send a reply, the message bus security policy blocked the reply, the reply timeout expired, or the network connection was broken. [Thu Mar 28 09:09:27.892955 2024] [:error] [pid 22098] ipa: INFO: [jsonserver_kerb] local_admin@EXAMPLE.COM: server_conncheck(u'ipamaster01.example.com', u'ipa-replica03.example.com', version=u'2.162'): InternalError [Thu Mar 28 09:09:30.121019 2024] [:error] [pid 20997] ipa: INFO: [jsonserver_kerb] host/ipa-replica03.example.com@EXAMPLE.COM: host_disable(u'ipa-replica03.example.com'): SUCCESS -- _______________________________________________ FreeIPA-users mailing list -- freeipa-users@lists.fedorahosted.org To unsubscribe send an email to freeipa-users-leave@lists.fedorahosted.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedorahosted.org/archives/list/freeipa-users@lists.fedorahoste... Do not reply to spam, report it: https://pagure.io/fedora-infrastructure/new_issue
-- _______________________________________________ FreeIPA-users mailing list -- freeipa-users@lists.fedorahosted.org To unsubscribe send an email to freeipa-users-leave@lists.fedorahosted.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedorahosted.org/archives/list/freeipa-users@lists.fedorahoste... Do not reply to spam, report it: https://pagure.io/fedora-infrastructure/new_issue
freeipa-users@lists.fedorahosted.org