[2012-06-06 11:09:49.354646] I [glusterfsd.c:1493:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.2.6 [2012-06-06 11:09:49.363299] I [client.c:1987:build_client_config] 0-wtf-client-3: remote-port is 24024 [2012-06-06 11:09:49.372985] I [socket.c:3099:socket_init] 0-wtf-client-3: SSL support is ENABLED [2012-06-06 11:09:49.373038] I [socket.c:3114:socket_init] 0-wtf-client-3: using private polling thread [2012-06-06 11:09:49.377105] I [client.c:1987:build_client_config] 0-wtf-client-2: remote-port is 24024 [2012-06-06 11:09:49.378154] I [socket.c:3099:socket_init] 0-wtf-client-2: SSL support is ENABLED [2012-06-06 11:09:49.378177] I [socket.c:3114:socket_init] 0-wtf-client-2: using private polling thread [2012-06-06 11:09:49.378789] I [client.c:1987:build_client_config] 0-wtf-client-1: remote-port is 24024 [2012-06-06 11:09:49.379817] I [socket.c:3099:socket_init] 0-wtf-client-1: SSL support is ENABLED [2012-06-06 11:09:49.379840] I [socket.c:3114:socket_init] 0-wtf-client-1: using private polling thread [2012-06-06 11:09:49.380370] I [client.c:1987:build_client_config] 0-wtf-client-0: remote-port is 24024 [2012-06-06 11:09:49.381418] I [socket.c:3099:socket_init] 0-wtf-client-0: SSL support is ENABLED [2012-06-06 11:09:49.381440] I [socket.c:3114:socket_init] 0-wtf-client-0: using private polling thread [2012-06-06 11:09:49.382012] W [graph.c:120:_log_if_option_is_invalid] 0-wtf-client-3: option 'transport.socket.ssl-private-key' is not recognized [2012-06-06 11:09:49.382031] W [graph.c:120:_log_if_option_is_invalid] 0-wtf-client-3: option 'transport.socket.ssl-ca-list' is not recognized [2012-06-06 11:09:49.382040] W [graph.c:120:_log_if_option_is_invalid] 0-wtf-client-3: option 'remote-port' is not recognized [2012-06-06 11:09:49.382049] W [graph.c:120:_log_if_option_is_invalid] 0-wtf-client-3: option 'transport.socket.ssl-enabled' is not recognized [2012-06-06 11:09:49.382057] W [graph.c:120:_log_if_option_is_invalid] 0-wtf-client-3: option 'transport.socket.ssl-own-cert' is not recognized [2012-06-06 11:09:49.382067] W [graph.c:120:_log_if_option_is_invalid] 0-wtf-client-2: option 'transport.socket.ssl-private-key' is not recognized [2012-06-06 11:09:49.382075] W [graph.c:120:_log_if_option_is_invalid] 0-wtf-client-2: option 'transport.socket.ssl-ca-list' is not recognized [2012-06-06 11:09:49.382084] W [graph.c:120:_log_if_option_is_invalid] 0-wtf-client-2: option 'remote-port' is not recognized [2012-06-06 11:09:49.382092] W [graph.c:120:_log_if_option_is_invalid] 0-wtf-client-2: option 'transport.socket.ssl-enabled' is not recognized [2012-06-06 11:09:49.382100] W [graph.c:120:_log_if_option_is_invalid] 0-wtf-client-2: option 'transport.socket.ssl-own-cert' is not recognized [2012-06-06 11:09:49.382110] W [graph.c:120:_log_if_option_is_invalid] 0-wtf-client-1: option 'transport.socket.ssl-private-key' is not recognized [2012-06-06 11:09:49.382118] W [graph.c:120:_log_if_option_is_invalid] 0-wtf-client-1: option 'transport.socket.ssl-ca-list' is not recognized [2012-06-06 11:09:49.382126] W [graph.c:120:_log_if_option_is_invalid] 0-wtf-client-1: option 'remote-port' is not recognized [2012-06-06 11:09:49.382135] W [graph.c:120:_log_if_option_is_invalid] 0-wtf-client-1: option 'transport.socket.ssl-enabled' is not recognized [2012-06-06 11:09:49.382143] W [graph.c:120:_log_if_option_is_invalid] 0-wtf-client-1: option 'transport.socket.ssl-own-cert' is not recognized [2012-06-06 11:09:49.382153] W [graph.c:120:_log_if_option_is_invalid] 0-wtf-client-0: option 'transport.socket.ssl-private-key' is not recognized [2012-06-06 11:09:49.382161] W [graph.c:120:_log_if_option_is_invalid] 0-wtf-client-0: option 'transport.socket.ssl-ca-list' is not recognized [2012-06-06 11:09:49.382169] W [graph.c:120:_log_if_option_is_invalid] 0-wtf-client-0: option 'remote-port' is not recognized [2012-06-06 11:09:49.382177] W [graph.c:120:_log_if_option_is_invalid] 0-wtf-client-0: option 'transport.socket.ssl-enabled' is not recognized [2012-06-06 11:09:49.382185] W [graph.c:120:_log_if_option_is_invalid] 0-wtf-client-0: option 'transport.socket.ssl-own-cert' is not recognized [2012-06-06 11:09:49.382217] I [client.c:1933:notify] 0-wtf-client-0: parent translators are ready, attempting connect on transport [2012-06-06 11:09:49.435046] I [socket.c:295:ssl_setup_connection] 0-wtf-client-0: peer CN = server2 [2012-06-06 11:09:49.435132] I [client.c:1933:notify] 0-wtf-client-1: parent translators are ready, attempting connect on transport [2012-06-06 11:09:49.441927] I [client-handshake.c:1089:select_server_supported_programs] 0-wtf-client-0: Using Program GlusterFS 0.7, Num (1298437), Version (310) [2012-06-06 11:09:49.442552] I [client-handshake.c:912:client_setvolume_cbk] 0-wtf-client-0: Connected to 192.168.1.196:24024, attached to remote volume 'toto-uidmap'. [2012-06-06 11:09:49.442574] I [afr-common.c:3141:afr_notify] 0-wtf-replicate-0: Subvolume 'wtf-client-0' came back up; going online. [2012-06-06 11:09:49.489321] I [socket.c:295:ssl_setup_connection] 0-wtf-client-1: peer CN = server1 [2012-06-06 11:09:49.489519] I [client.c:1933:notify] 0-wtf-client-2: parent translators are ready, attempting connect on transport [2012-06-06 11:09:49.495021] I [client-handshake.c:1089:select_server_supported_programs] 0-wtf-client-1: Using Program GlusterFS 0.7, Num (1298437), Version (310) [2012-06-06 11:09:49.496265] I [client-handshake.c:912:client_setvolume_cbk] 0-wtf-client-1: Connected to 192.168.1.195:24024, attached to remote volume 'toto-uidmap'. [2012-06-06 11:09:49.550853] I [socket.c:295:ssl_setup_connection] 0-wtf-client-2: peer CN = server3 [2012-06-06 11:09:49.550926] I [client.c:1933:notify] 0-wtf-client-3: parent translators are ready, attempting connect on transport [2012-06-06 11:09:49.554134] I [client-handshake.c:1089:select_server_supported_programs] 0-wtf-client-2: Using Program GlusterFS 0.7, Num (1298437), Version (310) [2012-06-06 11:09:49.557870] I [client-handshake.c:912:client_setvolume_cbk] 0-wtf-client-2: Connected to 192.168.1.197:24024, attached to remote volume 'toto-uidmap'. [2012-06-06 11:09:49.557925] I [afr-common.c:3141:afr_notify] 0-wtf-replicate-1: Subvolume 'wtf-client-2' came back up; going online. [2012-06-06 11:09:49.606535] I [socket.c:295:ssl_setup_connection] 0-wtf-client-3: peer CN = server4 Given volfile: +------------------------------------------------------------------------------+ 1: volume wtf-client-0 2: type protocol/client2 3: option username toto 4: option transport.socket.ssl-own-cert /root/tenant1.pem 5: option transport.socket.ssl-enabled true 6: option remote-port 24024 7: option transport.socket.ssl-ca-list /root/root.pem 8: option transport.socket.ssl-private-key /root/server.key 9: option remote-host glusterfs2 10: option remote-subvolume toto-uidmap 11: option password toto 12: option transport-type ssl 13: end-volume 14: 15: volume wtf-client-1 16: type protocol/client2 17: option username toto 18: option transport.socket.ssl-own-cert /root/tenant1.pem 19: option transport.socket.ssl-enabled true 20: option remote-port 24024 21: option transport.socket.ssl-ca-list /root/root.pem 22: option transport.socket.ssl-private-key /root/server.key 23: option remote-host 192.168.1.195 24: option remote-subvolume toto-uidmap 25: option password toto 26: option transport-type ssl 27: end-volume 28: 29: volume wtf-replicate-0 30: type cluster/replicate 31: subvolumes wtf-client-0 wtf-client-1 32: end-volume 33: 34: volume wtf-client-2 35: type protocol/client2 36: option username toto 37: option transport.socket.ssl-own-cert /root/tenant1.pem 38: option transport.socket.ssl-enabled true 39: option remote-port 24024 40: option transport.socket.ssl-ca-list /root/root.pem 41: option transport.socket.ssl-private-key /root/server.key 42: option remote-host glusterfs3 43: option remote-subvolume toto-uidmap 44: option password toto 45: option transport-type ssl 46: end-volume 47: 48: volume wtf-client-3 49: type protocol/client2 50: option username toto 51: option transport.socket.ssl-own-cert /root/tenant1.pem 52: option transport.socket.ssl-enabled true 53: option remote-port 24024 54: option transport.socket.ssl-ca-list /root/root.pem 55: option transport.socket.ssl-private-key /root/server.key 56: option remote-host glusterfs4 57: option remote-subvolume toto-uidmap 58: option password toto 59: option transport-type ssl 60: end-volume 61: 62: volume wtf-replicate-1 63: type cluster/replicate 64: subvolumes wtf-client-2 wtf-client-3 65: end-volume 66: 67: volume wtf-dht 68: type cluster/distribute 69: subvolumes wtf-replicate-0 wtf-replicate-1 70: end-volume 71: 72: volume wtf 73: type debug/io-stats 74: option latency-measurement off 75: option count-fop-hits off 76: subvolumes wtf-dht 77: end-volume +------------------------------------------------------------------------------+ [2012-06-06 11:09:49.607216] I [client-handshake.c:1089:select_server_supported_programs] 0-wtf-client-3: Using Program GlusterFS 0.7, Num (1298437), Version (310) [2012-06-06 11:09:49.607962] I [client-handshake.c:912:client_setvolume_cbk] 0-wtf-client-3: Connected to 192.168.1.198:24024, attached to remote volume 'toto-uidmap'. [2012-06-06 11:09:49.611211] I [fuse-bridge.c:3339:fuse_graph_setup] 0-fuse: switched to graph 0 [2012-06-06 11:09:49.611580] I [fuse-bridge.c:2927:fuse_init] 0-glusterfs-fuse: FUSE inited with protocol versions: glusterfs 7.13 kernel 7.13 [2012-06-06 11:09:49.612659] I [afr-common.c:1520:afr_set_root_inode_on_first_lookup] 0-wtf-replicate-0: added root inode [2012-06-06 11:09:49.612837] I [afr-common.c:1038:afr_launch_self_heal] 0-wtf-replicate-0: background meta-data self-heal triggered. path: / [2012-06-06 11:09:49.614854] I [afr-self-heal-common.c:2077:afr_self_heal_completion_cbk] 0-wtf-replicate-0: background meta-data self-heal completed on / [2012-06-06 11:09:49.615927] I [afr-common.c:1038:afr_launch_self_heal] 0-wtf-replicate-0: background meta-data self-heal triggered. path: / [2012-06-06 11:09:49.616496] I [afr-common.c:1520:afr_set_root_inode_on_first_lookup] 0-wtf-replicate-1: added root inode [2012-06-06 11:09:49.617113] I [afr-common.c:1038:afr_launch_self_heal] 0-wtf-replicate-1: background meta-data self-heal triggered. path: / [2012-06-06 11:09:49.620172] I [afr-self-heal-common.c:2077:afr_self_heal_completion_cbk] 0-wtf-replicate-1: background meta-data self-heal completed on / [2012-06-06 11:09:49.620053] I [afr-self-heal-common.c:2077:afr_self_heal_completion_cbk] 0-wtf-replicate-0: background meta-data self-heal completed on / [2012-06-06 11:09:53.603564] I [afr-common.c:1038:afr_launch_self_heal] 0-wtf-replicate-0: background meta-data self-heal triggered. path: / [2012-06-06 11:09:53.603788] I [afr-common.c:1038:afr_launch_self_heal] 0-wtf-replicate-1: background meta-data self-heal triggered. path: / [2012-06-06 11:09:53.606657] I [afr-self-heal-common.c:2077:afr_self_heal_completion_cbk] 0-wtf-replicate-1: background meta-data self-heal completed on / [2012-06-06 11:09:53.606851] I [afr-self-heal-common.c:2077:afr_self_heal_completion_cbk] 0-wtf-replicate-0: background meta-data self-heal completed on / [2012-06-06 11:09:53.615895] I [afr-common.c:1038:afr_launch_self_heal] 0-wtf-replicate-1: background meta-data self-heal triggered. path: / [2012-06-06 11:09:53.616250] I [afr-common.c:1038:afr_launch_self_heal] 0-wtf-replicate-0: background meta-data self-heal triggered. path: / [2012-06-06 11:09:53.618781] I [afr-self-heal-common.c:2077:afr_self_heal_completion_cbk] 0-wtf-replicate-1: background meta-data self-heal completed on / [2012-06-06 11:09:53.618962] I [afr-self-heal-common.c:2077:afr_self_heal_completion_cbk] 0-wtf-replicate-0: background meta-data self-heal completed on / [2012-06-06 11:10:05.451815] I [fuse-bridge.c:3241:fuse_thread_proc] 0-fuse: unmounting /gluster/ [2012-06-06 11:10:05.452035] W [glusterfsd.c:727:cleanup_and_exit] (-->/lib64/libc.so.6(clone+0x6d) [0x7f2bd40e3ccd] (-->/lib64/libpthread.so.0(+0x77f1) [0x7f2bd43957f1] (-->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xdd) [0x404edd]))) 0-: received signum (15), shutting down