Hi there,
Today we upgraded to the latest IPA 4.5, log says it upgraded just fine, ipa seems to authenticate allright, but web ui fails with:

Operations Error

Some operations failed.

an internal error has occurred


And the details it shows when I press the OK button are:

Runtime error

Web UI got in unrecoverable state during "profile" phase.

Technical details:

t.metadata is undefined
update_logged_in@https://ipaserver.fisica.cabib/ipa/ui/js/freeipa/app.js?40500:1:18156 choose_profile@https://ipaserver.fisica.cabib/ipa/ui/js/freeipa/app.js?40500:1:16651 register_phases/<@https://ipaserver.fisica.cabib/ipa/ui/js/freeipa/app.js?40500:1:1181 _run_phase/<@https://ipaserver.fisica.cabib/ipa/ui/js/freeipa/app.js?40500:1:3476 forEach@https://ipaserver.fisica.cabib/ipa/ui/js/dojo/dojo.js?v=40500:1:29752 _run_phase@https://ipaserver.fisica.cabib/ipa/ui/js/freeipa/app.js?40500:1:3440 next_phase@https://ipaserver.fisica.cabib/ipa/ui/js/freeipa/app.js?40500:1:3899 _run_phase/<@https://ipaserver.fisica.cabib/ipa/ui/js/freeipa/app.js?40500:1:3626 c@https://ipaserver.fisica.cabib/ipa/ui/js/dojo/dojo.js?v=40500:1:60960 d/t.then@https://ipaserver.fisica.cabib/ipa/ui/js/dojo/dojo.js?v=40500:1:62246 _run_phase@https://ipaserver.fisica.cabib/ipa/ui/js/freeipa/app.js?40500:1:3548 next_phase@https://ipaserver.fisica.cabib/ipa/ui/js/freeipa/app.js?40500:1:3899 _run_phase/<@https://ipaserver.fisica.cabib/ipa/ui/js/freeipa/app.js?40500:1:3626 c@https://ipaserver.fisica.cabib/ipa/ui/js/dojo/dojo.js?v=40500:1:60960 l@https://ipaserver.fisica.cabib/ipa/ui/js/dojo/dojo.js?v=40500:1:60886 d/this.resolve@https://ipaserver.fisica.cabib/ipa/ui/js/dojo/dojo.js?v=40500:1:61873 dojo/promise/all/</</</<@https://ipaserver.fisica.cabib/ipa/ui/js/dojo/dojo.js?v=40500:1:85255 c@https://ipaserver.fisica.cabib/ipa/ui/js/dojo/dojo.js?v=40500:1:60960 l@https://ipaserver.fisica.cabib/ipa/ui/js/dojo/dojo.js?v=40500:1:60886 d/this.resolve@https://ipaserver.fisica.cabib/ipa/ui/js/dojo/dojo.js?v=40500:1:61873 register_phases/</<@https://ipaserver.fisica.cabib/ipa/ui/js/freeipa/app.js?40500:1:1092 on_success@https://ipaserver.fisica.cabib/ipa/ui/js/freeipa/app.js?40500:1:34431 freeipa/rpc/</a.concurrent_command/t.on_success_all@https://ipaserver.fisica.cabib/ipa/ui/js/freeipa/app.js?40500:1:57160 freeipa/rpc/</a.concurrent_command/t.command_completed@https://ipaserver.fisica.cabib/ipa/ui/js/freeipa/app.js?40500:1:56953 freeipa/rpc/</a.concurrent_command/t.success_handler@https://ipaserver.fisica.cabib/ipa/ui/js/freeipa/app.js?40500:1:56790 freeipa/rpc/</a.concurrent_command/t.execute/n.on_success</<@https://ipaserver.fisica.cabib/ipa/ui/js/freeipa/app.js?40500:1:56340 freeipa/rpc/</a.command/l.register_handlers/<@https://ipaserver.fisica.cabib/ipa/ui/js/freeipa/app.js?40500:1:53786 f@https://ipaserver.fisica.cabib/ipa/ui/js/dojo/dojo.js?v=40500:1:49586 dojo/on/</i.emit@https://ipaserver.fisica.cabib/ipa/ui/js/dojo/dojo.js?v=40500:1:45192 dojo/on/</i.emit@https://ipaserver.fisica.cabib/ipa/ui/js/dojo/dojo.js?v=40500:1:45808 emit@https://ipaserver.fisica.cabib/ipa/ui/js/dojo/dojo.js?v=40500:1:48712 c@https://ipaserver.fisica.cabib/ipa/ui/js/freeipa/app.js?40500:1:52429 l@https://ipaserver.fisica.cabib/ipa/ui/js/libs/jquery.js?v=40500:4:24877 fireWith@https://ipaserver.fisica.cabib/ipa/ui/js/libs/jquery.js?v=40500:4:25702 k@https://ipaserver.fisica.cabib/ipa/ui/js/libs/jquery.js?v=40500:6:5346 t/<@https://ipaserver.fisica.cabib/ipa/ui/js/libs/jquery.js?v=40500:6:9152




Apache error logs shows:

[Mon Aug 07 11:04:32.078630 2017] [:warn] [pid 11845] [client ##.##.##.##:45938] failed to set perms (3140) on file (/var/run/ipa/ccaches/tavo@FISICA.CABIB)!, referer: https://ipaserver.fisica.cabib/ipa/ui/
[Mon Aug 07 11:04:32.079589 2017] [:error] [pid 11839] ipa: DEBUG: WSGI wsgi_dispatch.__call__:
[Mon Aug 07 11:04:32.079709 2017] [:error] [pid 11839] ipa: DEBUG: WSGI jsonserver_session.__call__:
[Mon Aug 07 11:04:32.160389 2017] [:error] [pid 11839] ipa: DEBUG: Created connection context.ldap2_94603036533520
[Mon Aug 07 11:04:32.160485 2017] [:error] [pid 11839] ipa: DEBUG: WSGI jsonserver.__call__:
[Mon Aug 07 11:04:32.160577 2017] [:error] [pid 11839] ipa: DEBUG: WSGI WSGIExecutioner.__call__:
[Mon Aug 07 11:04:32.170494 2017] [:error] [pid 11839] ipa: DEBUG: raw: batch(({u'params': ([], {}), u'method': u'i18n_messages'}, {u'params': ([], {}), u'method': u'config_show'}, {u'params': ([], {}), u'method': u'whoami'}, {u'params': ([], {}), u'method': u'env'}, {u'params': ([], {}), u'method': u'dns_is_enabled'}, {u'params': ([], {}), u'method': u'trustconfig_show'}, {u'params': ([], {}), u'method': u'domainlevel_get'}, {u'params': ([], {}), u'method': u'ca_is_enabled'}, {u'params': ([], {}), u'method': u'vaultconfig_show'}), version=u'2.228')
[Mon Aug 07 11:04:32.170764 2017] [:error] [pid 11839] ipa: DEBUG: batch(({u'params': ([], {}), u'method': u'i18n_messages'}, {u'params': ([], {}), u'method': u'config_show'}, {u'params': ([], {}), u'method': u'whoami'}, {u'params': ([], {}), u'method': u'env'}, {u'params': ([], {}), u'method': u'dns_is_enabled'}, {u'params': ([], {}), u'method': u'trustconfig_show'}, {u'params': ([], {}), u'method': u'domainlevel_get'}, {u'params': ([], {}), u'method': u'ca_is_enabled'}, {u'params': ([], {}), u'method': u'vaultconfig_show'}), version=u'2.228')
[Mon Aug 07 11:04:32.171033 2017] [:error] [pid 11839] ipa: DEBUG: raw: i18n_messages(version=u'2.228')
[Mon Aug 07 11:04:32.171215 2017] [:error] [pid 11839] ipa: DEBUG: i18n_messages(version=u'2.228')
[Mon Aug 07 11:04:32.178630 2017] [:error] [pid 11839] ipa: INFO: tavo@FISICA.CABIB: batch: i18n_messages(): SUCCESS
[Mon Aug 07 11:04:32.178857 2017] [:error] [pid 11839] ipa: DEBUG: raw: config_show(version=u'2.228')
[Mon Aug 07 11:04:32.179094 2017] [:error] [pid 11839] ipa: DEBUG: config_show(rights=False, all=False, raw=False, version=u'2.228')
[Mon Aug 07 11:04:32.181775 2017] [:error] [pid 11839] ipa: DEBUG: retrieving schema for SchemaCache url=ldapi://%2fvar%2frun%2fslapd-FISICA-CABIB.socket conn=<ldap.ldapobject.SimpleLDAPObject instance at 0x560a7e36a0e0>
[Mon Aug 07 11:04:32.548227 2017] [:error] [pid 11839] ipa: INFO: tavo@FISICA.CABIB: batch: config_show(): SUCCESS
[Mon Aug 07 11:04:32.548454 2017] [:error] [pid 11839] ipa: DEBUG: raw: whoami(version=u'2.228')
[Mon Aug 07 11:04:32.548625 2017] [:error] [pid 11839] ipa: DEBUG: whoami(version=u'2.228')
[Mon Aug 07 11:04:32.549205 2017] [:error] [pid 11839] ipa: INFO: tavo@FISICA.CABIB: batch: whoami(): PROTOCOL_ERROR
[Mon Aug 07 11:04:32.549456 2017] [:error] [pid 11839] ipa: DEBUG: raw: env(None, version=u'2.228')
[Mon Aug 07 11:04:32.549700 2017] [:error] [pid 11839] ipa: DEBUG: env(None, server=False, all=True, version=u'2.228')
[Mon Aug 07 11:04:32.550139 2017] [:error] [pid 11839] ipa: INFO: tavo@FISICA.CABIB: batch: env(None): SUCCESS
[Mon Aug 07 11:04:32.550350 2017] [:error] [pid 11839] ipa: DEBUG: raw: dns_is_enabled(version=u'2.228')
[Mon Aug 07 11:04:32.550520 2017] [:error] [pid 11839] ipa: DEBUG: dns_is_enabled(version=u'2.228')
[Mon Aug 07 11:04:32.552209 2017] [:error] [pid 11839] ipa: INFO: tavo@FISICA.CABIB: batch: dns_is_enabled(): SUCCESS
[Mon Aug 07 11:04:32.552435 2017] [:error] [pid 11839] ipa: DEBUG: raw: trustconfig_show(version=u'2.228')
[Mon Aug 07 11:04:32.552742 2017] [:error] [pid 11839] ipa: DEBUG: trustconfig_show(rights=False, trust_type=u'ad', all=False, raw=False, version=u'2.228')
[Mon Aug 07 11:04:32.558903 2017] [:error] [pid 11839] ipa: INFO: tavo@FISICA.CABIB: batch: trustconfig_show(): SUCCESS
[Mon Aug 07 11:04:32.559101 2017] [:error] [pid 11839] ipa: DEBUG: raw: domainlevel_get(version=u'2.228')
[Mon Aug 07 11:04:32.559292 2017] [:error] [pid 11839] ipa: DEBUG: domainlevel_get(version=u'2.228')
[Mon Aug 07 11:04:32.560543 2017] [:error] [pid 11839] ipa: INFO: tavo@FISICA.CABIB: batch: domainlevel_get(): SUCCESS
[Mon Aug 07 11:04:32.560753 2017] [:error] [pid 11839] ipa: DEBUG: raw: ca_is_enabled(version=u'2.228')
[Mon Aug 07 11:04:32.560924 2017] [:error] [pid 11839] ipa: DEBUG: ca_is_enabled(version=u'2.228')
[Mon Aug 07 11:04:32.562484 2017] [:error] [pid 11839] ipa: INFO: tavo@FISICA.CABIB: batch: ca_is_enabled(): SUCCESS
[Mon Aug 07 11:04:32.562694 2017] [:error] [pid 11839] ipa: DEBUG: raw: vaultconfig_show(version=u'2.228')
[Mon Aug 07 11:04:32.562880 2017] [:error] [pid 11839] ipa: DEBUG: vaultconfig_show(all=False, raw=False, version=u'2.228')
[Mon Aug 07 11:04:32.563089 2017] [:error] [pid 11839] ipa: DEBUG: raw: kra_is_enabled(version=u'2.228')
[Mon Aug 07 11:04:32.563209 2017] [:error] [pid 11839] ipa: DEBUG: kra_is_enabled(version=u'2.228')
[Mon Aug 07 11:04:32.564192 2017] [:error] [pid 11839] ipa: INFO: tavo@FISICA.CABIB: batch: vaultconfig_show(): InvocationError
[Mon Aug 07 11:04:32.564462 2017] [:error] [pid 11839] ipa: INFO: [jsonserver_session] tavo@FISICA.CABIB: batch(({u'params': ([], {}), u'method': u'i18n_messages'}, {u'params': ([], {}), u'method': u'config_show'}, {u'params': ([], {}), u'method': u'whoami'}, {u'params': ([], {}), u'method': u'env'}, {u'params': ([], {}), u'method': u'dns_is_enabled'}, {u'params': ([], {}), u'method': u'trustconfig_show'}, {u'params': ([], {}), u'method': u'domainlevel_get'}, {u'params': ([], {}), u'method': u'ca_is_enabled'}, {u'params': ([], {}), u'method': u'vaultconfig_show'}), version=u'2.228'): SUCCESS
[Mon Aug 07 11:04:32.567156 2017] [:error] [pid 11839] ipa: DEBUG: Destroyed connection context.ldap2_94603036533520


From the first line of apache log the file it refers to has this attributes:

stat /var/run/ipa/ccaches/tavo@FISICA.CABIB
  File: ‘/var/run/ipa/ccaches/tavo@FISICA.CABIB’
  Size: 4596          Blocks: 16         IO Block: 4096   regular file
Device: 12h/18d    Inode: 37651       Links: 1
Access: (0600/-rw-------)  Uid: (  989/  ipaapi)   Gid: (  985/  ipaapi)
Context: system_u:object_r:ipa_var_run_t:s0
Access: 2017-08-07 11:09:56.260676960 -0300
Modify: 2017-08-07 09:58:09.367597633 -0300
Change: 2017-08-07 09:58:09.367597633 -0300
 Birth: -


This are the ipa packages I have:
rpm -qa | grep ipa
python2-ipaclient-4.5.0-21.el7.noarch
python-iniparse-0.4-9.el7.noarch
sssd-ipa-1.15.2-50.el7.x86_64
ipa-client-4.5.0-21.el7.x86_64
python2-ipaserver-4.5.0-21.el7.noarch
python-libipa_hbac-1.15.2-50.el7.x86_64
ipa-common-4.5.0-21.el7.noarch
ipa-server-4.5.0-21.el7.x86_64
ipa-server-common-4.5.0-21.el7.noarch
ipa-server-dns-4.5.0-21.el7.noarch
python-ipaddress-1.0.16-2.el7.noarch
ipa-python-compat-4.5.0-21.el7.noarch
ipa-client-common-4.5.0-21.el7.noarch
libipa_hbac-1.15.2-50.el7.x86_64
python2-ipalib-4.5.0-21.el7.noarch


Any ideas?


Thanks!




--
Gustavo Berman
Sysadmin - Gerencia de Física - Centro Atómico Bariloche - CNEA