Hi,

On Thu, Sep 27, 2018, 1:37 PM Jan Tluka <jtluka@redhat.com> wrote:
Thu, Sep 27, 2018 at 09:26:06AM CEST, sandeepkishan108@gmail.com wrote:
>Hi,
>
>On Thu, Sep 27, 2018, 12:11 PM Ondrej Lichtner <olichtne@redhat.com> wrote:
>
>> On Thu, Sep 27, 2018 at 04:30:17AM +0530, Kishan Sandeep wrote:
>> > Hi,
>> >
>> > Thanks for the response.
>> >
>> > I have dedicated interfaces for slaves. In slave machine xml, I have
>> > mentioned params which represents dedicated slave machine IP for the
>> > communication and interface mention Mac address of the testing interface.
>> >
>> > Looks like controller waiting in wait_for_result() method. Below are the
>> > slave & recipe xml file contents
>> >
>> > SLAVE - 1:
>> > sandeep@sandeep:~$ cat ~/.lnst/pool/slave1.xml
>> > <slavemachine>
>> >         <params>
>> >                 <param name="hostname" value="10.0.0.6"/>
>> >         </params>
>> >         <interfaces>
>> >                 <eth label='A' id='1'>
>> >                         <params>
>> >                                 <param name="hwaddr"
>> > value="00:02:4c:70:76:70"/>
>> >                         </params>
>> >                 </eth>
>> >         </interfaces>
>> > </slavemachine>
>> >
>> > SLAVE - 2:
>> > sandeep@sandeep:~$ cat ~/.lnst/pool/slave2.xml
>> > <slavemachine>
>> >         <params>
>> >                 <param name="hostname" value="10.0.0.18"/>
>> >         </params>
>> >         <interfaces>
>> >                 <eth label='A' id='1'>
>> >                         <params>
>> >                                 <param name="hwaddr"
>> > value="00:02:4c:70:76:71"/>
>> >                         </params>
>> >                 </eth>
>> >         </interfaces>
>> > </slavemachine>
>> >
>> >
>> > sandeep@sandeep:~$ cat code/lnst/recipe.xml
>> > <lnstrecipe>
>> >   <network>
>> >     <host id="slave1">
>> >         <params/>
>> >         <interfaces>
>> >             <eth id="testifc1" label="A">
>> >                 <addresses>
>> >                     <address value="192.168.200.2/24"/>
>> >                 </addresses>
>> >             </eth>
>> >         </interfaces>
>> >     </host>
>> >
>> >     <host id="slave2">
>> >         <params/>
>> >         <interfaces>
>> >             <eth id="testifc2" label="A">
>> >                 <addresses>
>> >                     <address value="192.168.200.3/24"/>
>> >                 </addresses>
>> >             </eth>
>> >         </interfaces>
>> >     </host>
>> >   </network>
>> >
>> >   <task>
>> >     <run module="IcmpPing" host="slave1">
>> >       <options>
>> >         <option name="addr" value="{ip(slave2,testifc2)}"/>
>> >         <option name="count" value="10"/>
>> >       </options>
>> >     </run>
>> >   </task>
>> > </lnstrecipe>
>> >
>> > On Thu, Sep 27, 2018, 12:18 AM Jan Tluka <jtluka@redhat.com> wrote:
>> >
>> > > Wed, Sep 26, 2018 at 08:14:01PM CEST, jiri@resnulli.us wrote:
>> > > >ccing mailing list
>> > > >
>> > >
>> > > Just a wild guess.
>> > >
>> > > Hope you have one dedicated test interface on the slaves. That
>> > > means that the interface used for controller-slave connection is not
>> > > the same one as the one defined in slavemachine xml under <interfaces
>> />
>> > >
>> > > See following chapter:
>> > >
>> https://github.com/jpirko/lnst/wiki/Introductory-Guide#4-example-use-case
>> > >
>> > > -Jan
>> > >
>> > > >Wed, Sep 26, 2018 at 01:30:02PM CEST, sandeepkishan108@gmail.com
>> wrote:
>> > > >>Thanks for the response.
>> > > >>
>> > > >>I am trying to test the ping test between two slave machines... I see
>> > > that
>> > > >>test stopped at below state. It looks like waiting for something.  ?
>> > > >>
>> > > >>*Logs from controller side -*
>> > > >>Loading config file '/etc/lnst-ctl.conf'
>> > > >>Loading config file '/home/sandeep/.lnst/lnst-ctl.conf'
>> > > >>2018-09-26 15:25:12       (localhost)        -    INFO:
>> > > >>
>> > >
>> > >
>> >>--------------------------------------------------------------------------------------------------------
>> > > >>    Trying recipe file "recipe.xml" match 1
>> > > >>    Logs for this recipe will be stored in
>> > > >>'/home/sandeep/.lnst/logs/2018-09-26_15:25:12/01_recipe_match_1'
>> > > >>
>> > >
>> > >
>> >>--------------------------------------------------------------------------------------------------------
>> > > >>2018-09-26 15:25:12       (localhost)        -    INFO: No previous
>> > > >>configuration found.
>> > > >>2018-09-26 15:25:12       (localhost)        -    INFO: Checking
>> machine
>> > > >>pool availability.
>> > > >>2018-09-26 15:25:12       (localhost)        -    INFO: Processing
>> pool
>> > > >>'default', directory '/home/sandeep/.lnst/pool'
>> > > >>2018-09-26 15:25:12       (localhost)        -   DEBUG: Querying
>> machine
>> > > >>'slave1': 10.0.0.6:9999
>> > > >>2018-09-26 15:25:12       (localhost)        -   DEBUG: Querying
>> machine
>> > > >>'slave2': 10.0.0.18:9999
>> > > >>2018-09-26 15:25:12       (localhost)        -    INFO: slave1 [UP]
>> > > >>2018-09-26 15:25:12       (localhost)        -    INFO: slave2 [UP]
>> > > >>2018-09-26 15:25:12       (localhost)        -    INFO: Finished
>> loading
>> > > >>pools.
>> > > >>2018-09-26 15:25:12       (localhost)        -   DEBUG: Executing:
>> "cd
>> > > >>"/usr/share/lnst/test_tools" && tar cf "/tmp/tmpdSTJqR" "multicast""
>> > > >>2018-09-26 15:25:12       (localhost)        -   DEBUG: Executing:
>> "cd
>> > > >>"/usr/share/lnst/test_tools" && tar cf "/tmp/tmpV0fb4B" "tcp_conn""
>> > > >>2018-09-26 15:25:12       (localhost)        -    INFO: Matching
>> > > machines,
>> > > >>without virtuals.
>> > > >>2018-09-26 15:25:12       (localhost)        -    INFO: Trying match
>> with
>> > > >>pool: default
>> > > >>2018-09-26 15:25:12       (localhost)        -    INFO: Pool match
>> > > >>description:
>> > > >>2018-09-26 15:25:12       (localhost)        -    INFO:   host
>> > > >>"testmachine1" uses "slave1"
>> > > >>2018-09-26 15:25:12       (localhost)        -    INFO:     interface
>> > > >>"testifc1" matched to "1"
>> > > >>2018-09-26 15:25:12       (localhost)        -    INFO:   host
>> > > >>"testmachine2" uses "slave2"
>> > > >>2018-09-26 15:25:12       (localhost)        -    INFO:     interface
>> > > >>"testifc2" matched to "1"
>> > > >>2018-09-26 15:25:12       (localhost)        -    INFO: Connecting
>> to RPC
>> > > >>on machine testmachine1 (10.0.0.6)
>> > > >>2018-09-26 15:25:12       (localhost)        - WARNING:
>> > > >>===================================
>> > > >>2018-09-26 15:25:12       (localhost)        - WARNING:
>> 10.0.0.6:9999
>> > > >>2018-09-26 15:25:12       (localhost)        - WARNING: NO SECURE
>> CHANNEL
>> > > >>SETUP IS IN PLACE
>> > > >>2018-09-26 15:25:12       (localhost)        - WARNING:  ALL
>> > > COMMUNICATION
>> > > >>IS IN PLAINTEXT
>> > > >>2018-09-26 15:25:12       (localhost)        - WARNING:
>> > > >>===================================
>> > > >>2018-09-26 15:25:13    (testmachine1)        -    INFO: Performing
>> > > machine
>> > > >>cleanup.
>> > > >>2018-09-26 15:25:13    (testmachine1)        -   DEBUG: Cleaning up
>> > > >>leftover processes.
>> > > >>2018-09-26 15:25:13    (testmachine1)        -    INFO: Restoring
>> system
>> > > >>configuration
>> > > >>2018-09-26 15:25:13    (testmachine1)        -    INFO: Recieved a
>> > > >>controller connection.
>> > > >>2018-09-26 15:25:13    (testmachine1)        -   DEBUG: Executing:
>> > > "ethtool
>> > > >>-i sit0"
>> > > >>2018-09-26 15:25:13    (testmachine1)        -   DEBUG: Executing:
>> > > "ethtool
>> > > >>-i ip6tnl0"
>> > > >>2018-09-26 15:25:13    (testmachine1)        -   DEBUG: Executing:
>> > > "ethtool
>> > > >>-i ip6gre0"
>> > > >>2018-09-26 15:25:14    (testmachine1)        -   DEBUG: Executing:
>> "uname
>> > > >>-r"
>> > > >>2018-09-26 15:25:14    (testmachine1)        -   DEBUG: Executing:
>> "cat
>> > > >>/etc/redhat-release"
>> > > >>2018-09-26 15:25:14    (testmachine1)        -   DEBUG: Executing:
>> > > "ethtool
>> > > >>-i sit0"
>> > > >>2018-09-26 15:25:14    (testmachine1)        -   DEBUG: Executing:
>> > > "ethtool
>> > > >>-i ip6tnl0"
>> > > >>2018-09-26 15:25:14    (testmachine1)        -   DEBUG: Executing:
>> > > "ethtool
>> > > >>-i ip6gre0"
>> > > >>*2018-09-26 15:25:14    (testmachine1)        -   DEBUG: Executing:
>> "ip
>> > > >>link set eth0 down" ===>Test stopped after executing this command*
>> > > >>
>> > > >>*Logs from slave side -*
>> > > >>Loading config file '/etc/lnst-slave.conf'
>> > > >>2018-09-26 09:55:08       (localhost)        -    INFO: Started
>> > > >>2018-09-26 09:55:08       (localhost)        -    INFO: Using RPC
>> port
>> > > 9999.
>> > > >>2018-09-26 09:55:08       (localhost)        -   DEBUG: Executing:
>> > > "ethtool
>> > > >>-i eth0"
>> > > >>2018-09-26 09:55:08       (localhost)        -   DEBUG: Executing:
>> > > "ethtool
>> > > >>-i sit0"
>> > > >>2018-09-26 09:55:08       (localhost)        -   DEBUG: Executing:
>> > > "ethtool
>> > > >>-i ip6tnl0"
>> > > >>2018-09-26 09:55:08       (localhost)        -   DEBUG: Executing:
>> > > "ethtool
>> > > >>-i ip6gre0"
>> > > >>2018-09-26 09:55:08       (localhost)        -   DEBUG: Executing:
>> > > "ethtool
>> > > >>-i enx0023563c4966"
>> > > >>2018-09-26 09:55:08       (localhost)        -   DEBUG: Executing:
>> > > "ethtool
>> > > >>-i can0"
>> > > >>2018-09-26 09:55:08       (localhost)        -   DEBUG: Executing:
>> > > "ethtool
>> > > >>-i can1"
>> > > >>2018-09-26 09:55:08       (localhost)        -   DEBUG: Executing:
>> > > "ethtool
>> > > >>-i enp3s0"
>> > > >>2018-09-26 09:55:08       (localhost)        -   DEBUG: Executing:
>> > > "ethtool
>> > > >>-i eth0.200"
>> > > >>2018-09-26 09:55:08       (localhost)        -   DEBUG: Executing:
>> > > "ethtool
>> > > >>-i docker0"
>> > > >>2018-09-26 09:55:08       (localhost)        -   DEBUG: Test cache
>> index
>> > > >>loaded
>> > > >>2018-09-26 09:55:08       (localhost)        -    INFO: Waiting for
>> > > >>connection.
>> > > >>2018-09-26 09:55:12       (localhost)        -    INFO: Recieved
>> > > connection
>> > > >>from 10.0.0.1
>> > > >>2018-09-26 09:55:12       (localhost)        -    INFO: Waiting for
>> > > >>connection.
>> > > >>2018-09-26 09:55:13       (localhost)        -    INFO: Recieved
>> > > connection
>> > > >>from 10.0.0.1
>> > > >>2018-09-26 09:55:13       (localhost)        - WARNING:
>> > > >>===================================
>> > > >>2018-09-26 09:55:13       (localhost)        - WARNING: NO SECURE
>> CHANNEL
>> > > >>SETUP IS IN PLACE
>> > > >>2018-09-26 09:55:13       (localhost)        - WARNING:  ALL
>> > > COMMUNICATION
>> > > >>IS IN PLAINTEXT
>> > > >>2018-09-26 09:55:13       (localhost)        - WARNING:
>> > > >>===================================
>> > > >>2018-09-26 09:55:13       (localhost)        -    INFO: Performing
>> > > machine
>> > > >>cleanup.
>> > > >>2018-09-26 09:55:13       (localhost)        -   DEBUG: Cleaning up
>> > > >>leftover processes.
>> > > >>2018-09-26 09:55:13       (localhost)        -    INFO: Restoring
>> system
>> > > >>configuration
>> > > >>2018-09-26 09:55:13       (localhost)        -    INFO: Recieved a
>> > > >>controller connection.
>> > > >>2018-09-26 09:55:13       (localhost)        -   DEBUG: Executing:
>> > > "ethtool
>> > > >>-i sit0"
>> > > >>2018-09-26 09:55:13       (localhost)        -   DEBUG: Executing:
>> > > "ethtool
>> > > >>-i ip6tnl0"
>> > > >>2018-09-26 09:55:13       (localhost)        -   DEBUG: Executing:
>> > > "ethtool
>> > > >>-i ip6gre0"
>> > > >>2018-09-26 09:55:14       (localhost)        -   DEBUG: Executing:
>> "uname
>> > > >>-r"
>> > > >>2018-09-26 09:55:14       (localhost)        -   DEBUG: Executing:
>> "cat
>> > > >>/etc/redhat-release"
>> > > >>2018-09-26 09:55:14       (localhost)        -   DEBUG: Executing:
>> > > "ethtool
>> > > >>-i sit0"
>> > > >>2018-09-26 09:55:14       (localhost)        -   DEBUG: Executing:
>> > > "ethtool
>> > > >>-i ip6tnl0"
>> > > >>2018-09-26 09:55:14       (localhost)        -   DEBUG: Executing:
>> > > "ethtool
>> > > >>-i ip6gre0"
>> > > >>*2018-09-26 09:55:14       (localhost)        -   DEBUG: Executing:
>> "ip
>> > > >>link set eth0 down"*
>> > > >>
>> > > >>
>> > > >>On Sun, Sep 23, 2018, 3:11 PM Jiri Pirko <jiri@resnulli.us> wrote:
>> > > >>
>> > > >>> Sun, Sep 23, 2018 at 06:26:33AM CEST, sandeepkishan108@gmail.com
>> > > wrote:
>> > > >>> >Hi jiri,
>> > > >>> >
>> > > >>> >Thanks for responding...
>> > > >>> >
>> > > >>> >Facing below errors when I am trying with lnst.
>> > > >>>
>> > > >>> Please make sure that all dependencies are up to date.
>> > > >>>
>> > > >>>
>> > > >>> >
>> > > >>> >On slave I see below errors -
>> > > >>> >ubuntu@ubuntu:~/lnst$ sudo lnst-slave -d
>> > > >>> >Loading config file '/etc/lnst-slave.conf'
>> > > >>> >2018-09-23 04:10:38       (localhost)        -    INFO: Started
>> > > >>> >2018-09-23 04:10:38       (localhost)        -    INFO: Using RPC
>> port
>> > > >>> 9999.
>> > > >>> >*2018-09-23 04:10:38       (localhost)        -   ERROR: Generic
>> > > netlink
>> > > >>> >protocol devlink not found*
>> > > >>> >*2018-09-23 04:10:38       (localhost)        -   ERROR: Please
>> check
>> > > if
>> > > >>> >the protocol module is loaded*
>> > > >>> >2018-09-23 04:10:38       (localhost)        -   DEBUG: Executing:
>> > > >>> "ethtool
>> > > >>> >-i dummy0"
>> > > >>> >2018-09-23 04:10:38       (localhost)        -   DEBUG: Executing:
>> > > >>> "ethtool
>> > > >>> >-i eth0"
>> > > >>> >2018-09-23 04:10:38       (localhost)        -   DEBUG: Executing:
>> > > >>> "ethtool
>> > > >>> >-i sit0"
>> > > >>> >2018-09-23 04:10:38       (localhost)        -   DEBUG: Executing:
>> > > >>> "ethtool
>> > > >>> >-i ip6tnl0"
>> > > >>> >2018-09-23 04:10:38       (localhost)        -   DEBUG: Executing:
>> > > >>> "ethtool
>> > > >>> >-i ip6gre0"
>> > > >>> >*2018-09-23 04:10:38       (localhost)        -   ERROR: Generic
>> > > netlink
>> > > >>> >protocol devlink not found*
>> > > >>> >*2018-09-23 04:10:38       (localhost)        -   ERROR: Please
>> check
>> > > if
>> > > >>> >the protocol module is loaded*
>> > > >>> >2018-09-23 04:10:38       (localhost)        -   DEBUG: Test cache
>> > > index
>> > > >>> >loaded
>> > > >>> >2018-09-23 04:10:38       (localhost)        -    INFO: Waiting
>> for
>> > > >>> >connection.
>> > > >>> >2018-09-23 04:11:43       (localhost)        -    INFO: Recieved
>> > > >>> connection
>> > > >>> >from 10.19.65.141
>> > > >>> >2018-09-23 04:11:43       (localhost)        -    INFO: Waiting
>> for
>> > > >>> >connection.
>> > > >>> >
>> > > >>> >LNST controller see below errors when i tried to check ping
>> recipe -
>> > > >>> >sandeep@sandeep:~$ sudo lnst-ctl -d run
>> > > >>> >code/lnst/recipes/examples/quick_guides/ping_check.xml
>> > > >>> >Loading config file '/etc/lnst-ctl.conf'
>> > > >>> >Loading config file '/home/sandeep/.lnst/lnst-ctl.conf'
>> > > >>> >2018-09-23 09:41:43       (localhost)        -    INFO:
>> > > >>> >
>> > > >>>
>> > > >>>
>> > >
>> >------------------------------------------------------------------------------------------------------------
>> > > >>> >    Trying recipe file
>> > > >>> >"code/lnst/recipes/examples/quick_guides/ping_check.xml" match 1
>> > > >>> >    Logs for this recipe will be stored in
>> > > >>>
>> >'/home/sandeep/.lnst/logs/2018-09-23_09:41:43/01_ping_check_match_1'
>> > > >>> >
>> > > >>>
>> > > >>>
>> > >
>> >------------------------------------------------------------------------------------------------------------
>> > > >>> >2018-09-23 09:41:43       (localhost)        -    INFO: No
>> previous
>> > > >>> >configuration found.
>> > > >>> >2018-09-23 09:41:43       (localhost)        -    INFO: Checking
>> > > machine
>> > > >>> >pool availability.
>> > > >>> >2018-09-23 09:41:43       (localhost)        -    INFO: Processing
>> > > pool
>> > > >>> >'default', directory '/home/sandeep/.lnst/pool'
>> > > >>> >2018-09-23 09:41:43       (localhost)        -   DEBUG: Querying
>> > > machine
>> > > >>> >'slave1': 10.19.66.31:9999
>> > > >>> >2018-09-23 09:41:43       (localhost)        -   DEBUG: Querying
>> > > machine
>> > > >>> >'slave2': 10.19.66.91:9999
>> > > >>> >2018-09-23 09:41:43       (localhost)        -    INFO: slave1
>> [UP]
>> > > >>> >2018-09-23 09:41:43       (localhost)        -    INFO: slave2
>> [UP]
>> > > >>> >2018-09-23 09:41:43       (localhost)        -    INFO: Finished
>> > > loading
>> > > >>> >pools.
>> > > >>> >2018-09-23 09:41:43       (localhost)        -   DEBUG:
>> Executing: "cd
>> > > >>> >"/usr/share/lnst/test_tools" && tar cf "/tmp/tmpxP0Czk"
>> "multicast""
>> > > >>> >2018-09-23 09:41:44       (localhost)        -   DEBUG:
>> Executing: "cd
>> > > >>> >"/usr/share/lnst/test_tools" && tar cf "/tmp/tmp78XAWh"
>> "tcp_conn""
>> > > >>> >2018-09-23 09:41:44       (localhost)        -    INFO: Matching
>> > > machines,
>> > > >>> >without virtuals.
>> > > >>> >2018-09-23 09:41:44       (localhost)        -    INFO: Trying
>> match
>> > > with
>> > > >>> >pool: default
>> > > >>> >2018-09-23 09:41:44       (localhost)        -    INFO: Pool match
>> > > >>> >description:
>> > > >>> >2018-09-23 09:41:44       (localhost)        -    INFO:   host
>> > > >>> >"testmachine1" uses "slave1"
>> > > >>> >2018-09-23 09:41:44       (localhost)        -    INFO:
>>  interface
>> > > >>> >"testifc1" matched to "1"
>> > > >>> >2018-09-23 09:41:44       (localhost)        -    INFO:   host
>> > > >>> >"testmachine2" uses "slave2"
>> > > >>> >2018-09-23 09:41:44       (localhost)        -    INFO:
>>  interface
>> > > >>> >"testifc2" matched to "1"
>> > > >>> >2018-09-23 09:41:44       (localhost)        -    INFO:
>> Connecting to
>> > > RPC
>> > > >>> >on machine testmachine1 (10.19.66.31)
>> > > >>> >*2018-09-23 09:41:44       (localhost)        - WARNING:
>> > > >>> >===================================*
>> > > >>> >*2018-09-23 09:41:44       (localhost)        - WARNING:
>> > > 10.19.66.31:9999
>> > > >>> ><http://10.19.66.31:9999/>*
>> > > >>> >*2018-09-23 09:41:44       (localhost)        - WARNING: NO SECURE
>> > > CHANNEL
>> > > >>> >SETUP IS IN PLACE*
>> > > >>> >*2018-09-23 09:41:44       (localhost)        - WARNING:  ALL
>> > > >>> COMMUNICATION
>> > > >>> >IS IN PLAINTEXT*
>> > > >>> >*2018-09-23 09:41:44       (localhost)        - WARNING:
>> > > >>> >===================================*
>> > > >>> >2018-09-23 09:41:44    (testmachine1)        -    INFO: Performing
>> > > machine
>> > > >>> >cleanup.
>> > > >>> >2018-09-23 09:41:44    (testmachine1)        -   DEBUG: Cleaning
>> up
>> > > >>> >leftover processes.
>> > > >>> >2018-09-23 09:41:44    (testmachine1)        -    INFO: Restoring
>> > > system
>> > > >>> >configuration
>> > > >>> >2018-09-23 09:41:44    (testmachine1)        -    INFO: Recieved a
>> > > >>> >controller connection.
>> > > >>> >2018-09-23 09:41:44    (testmachine1)        -   DEBUG:
>> > > >>> >    Traceback (most recent call last):
>> > > >>> >      File
>> > > >>>
>> >"/usr/local/lib/python2.7/dist-packages/lnst/Slave/NetTestSlave.py",
>> > > line
>> > > >>> >1432, in _process_msg
>> > > >>> >        result = method(*msg["args"])
>> > > >>> >      File
>> > > >>>
>> >"/usr/local/lib/python2.7/dist-packages/lnst/Slave/NetTestSlave.py",
>> > > line
>> > > >>> >82, in hello
>> > > >>> >        self._if_manager.rescan_devices()
>> > > >>> >      File
>> > > >>>
>> > >
>> >"/usr/local/lib/python2.7/dist-packages/lnst/Slave/InterfaceManager.py",
>> > > >>> >line 117, in rescan_devices
>> > > >>> >
>> self._devices[dev['index']].update_netlink(dev['netlink_msg'])
>> > > >>> >      File
>> > > >>>
>> > >
>> >"/usr/local/lib/python2.7/dist-packages/lnst/Slave/InterfaceManager.py",
>> > > >>> >line 416, in update_netlink
>> > > >>> >        if nl_msg.get_nested("IFLA_LINKINFO", "IFLA_INFO_KIND") ==
>> > > >>> "vxlan":
>> > > >>> >*    AttributeError: 'ifinfmsg' object has no attribute
>> 'get_nested'*
>> > > >>> >
>> > > >>> >2018-09-23 09:41:44       (localhost)        -   ERROR: Exception
>> > > raised
>> > > >>> >during configuration.
>> > > >>> >2018-09-23 09:41:44       (localhost)        -   DEBUG:
>> > > >>> >    Traceback (most recent call last):
>> > > >>> >      File "/usr/local/bin/lnst-ctl", line 182, in
>> get_recipe_result
>> > > >>> >        res = exec_action(action, nettestctl)
>> > > >>> >      File "/usr/local/bin/lnst-ctl", line 137, in exec_action
>> > > >>> >        return nettestctl.run_recipe()
>> > > >>> >      File
>> > > >>>
>> > > >>>
>> > >
>> >"/usr/local/lib/python2.7/dist-packages/lnst/Controller/NetTestController.py",
>> > > >>> >line 648, in run_recipe
>> > > >>> >        self._prepare_network()
>> > > >>> >      File
>> > > >>>
>> > > >>>
>> > >
>> >"/usr/local/lib/python2.7/dist-packages/lnst/Controller/NetTestController.py",
>> > > >>> >line 198, in _prepare_network
>> > > >>> >        self._prepare_machine(m_id, resource_sync)
>> > > >>> >      File
>> > > >>>
>> > > >>>
>> > >
>> >"/usr/local/lib/python2.7/dist-packages/lnst/Controller/NetTestController.py",
>> > > >>> >line 266, in _prepare_machine
>> > > >>> >        machine.init_connection(recipe_name)
>> > > >>> >      File
>> > > >>>
>> >"/usr/local/lib/python2.7/dist-packages/lnst/Controller/Machine.py",
>> > > line
>> > > >>> >286, in init_connection
>> > > >>> >        hello, slave_desc = self._rpc_call("hello", recipe_name)
>> > > >>> >      File
>> > > >>>
>> >"/usr/local/lib/python2.7/dist-packages/lnst/Controller/Machine.py",
>> > > line
>> > > >>> >250, in _rpc_call
>> > > >>> >        result = self._msg_dispatcher.wait_for_result(self._id)
>> > > >>> >      File
>> > > >>>
>> > > >>>
>> > >
>> >"/usr/local/lib/python2.7/dist-packages/lnst/Controller/NetTestController.py",
>> > > >>> >line 910, in wait_for_result
>> > > >>> >        self._process_message(msg)
>> > > >>> >      File
>> > > >>>
>> > > >>>
>> > >
>> >"/usr/local/lib/python2.7/dist-packages/lnst/Controller/NetTestController.py",
>> > > >>> >line 936, in _process_message
>> > > >>> >        raise CommandException(msg)
>> > > >>> >    CommandException: CommandException: Slave testmachine1:
>> 'ifinfmsg'
>> > > >>> >object has no attribute 'get_nested'
>> > > >>> >
>> > > >>> >2018-09-23 09:41:44       (localhost)        -   ERROR:
>> > > CommandException:
>> > > >>> >Slave testmachine1: 'ifinfmsg' object has no attribute
>> 'get_nested'
>> > > >>> >2018-09-23 09:41:44       (localhost)        -    INFO:
>> > > >>> >==================================================== SUMMARY
>> > > >>> >====================================================
>> > > >>> >2018-09-23 09:41:44       (localhost)        -    INFO:
>> > > >>> >code/lnst/recipes/examples/quick_guides/ping_check.xml match: 1
>> > > >>> >                                FAIL
>> > > >>> >2018-09-23 09:41:44       (localhost)        -    INFO:      Pool
>> > > match
>> > > >>> >description:
>> > > >>> >2018-09-23 09:41:44       (localhost)        -    INFO:      host
>> > > >>> >"testmachine1" uses "slave1"
>> > > >>> >2018-09-23 09:41:44       (localhost)        -    INFO:
>> > > interface
>> > > >>> >"testifc1" matched to "1"
>> > > >>> >2018-09-23 09:41:44       (localhost)        -    INFO:      host
>> > > >>> >"testmachine2" uses "slave2"
>> > > >>> >2018-09-23 09:41:44       (localhost)        -    INFO:
>> > > interface
>> > > >>> >"testifc2" matched to "1"
>> > > >>> >2018-09-23 09:41:44       (localhost)        -    INFO:      error
>> > > >>> message:
>> > > >>> >CommandException: Slave testmachine1: 'ifinfmsg' object has no
>> > > attribute
>> > > >>> >'get_nested'
>> > > >>> >2018-09-23 09:41:44       (localhost)        -    INFO:
>> > > >>>
>> > > >>>
>> > >
>> >=================================================================================================================
>> > > >>> >2018-09-23 09:41:44       (localhost)        -    INFO: Total test
>> > > time: 0
>> > > >>> >days, 0 hours, 0 minutes, 0 seconds
>> > > >>> >2018-09-23 09:41:44       (localhost)        -    INFO: Logs are
>> > > stored in
>> > > >>> >'/home/sandeep/.lnst/logs/2018-09-23_09:41:43'
>> > > >>> >
>> > > >>> >
>> > > >>> >sandeep@sandeep:~$ cat
>> > > >>> >code/lnst/recipes/examples/quick_guides/ping_check.xml
>> > > >>> ><!--
>> > > >>> >This is a recipe from a quick guide that is available on LNST wiki
>> > > page:
>> > > >>> >
>> > > >>> >
>> > > https://fedorahosted.org/lnst/wiki/QuickGuides/QuickGuidePingCheck
>> > > >>> >-->
>> > > >>> ><lnstrecipe>
>> > > >>> >    <network>
>> > > >>> >        <host id="testmachine1">
>> > > >>> >            <interfaces>
>> > > >>> >                <eth id="testifc1" label="tnet">
>> > > >>> >                    <addresses>
>> > > >>> >                        <address value="10.19.66.91/24"/>
>> > > >>> >                    </addresses>
>> > > >>> >                </eth>
>> > > >>> >            </interfaces>
>> > > >>> >        </host>
>> > > >>> >
>> > > >>> >        <host id="testmachine2">
>> > > >>> >            <interfaces>
>> > > >>> >                <eth id="testifc2" label="tnet">
>> > > >>> >                    <addresses>
>> > > >>> >                        <address value="10.19.66.31/24"/>
>> > > >>> >                    </addresses>
>> > > >>> >                </eth>
>> > > >>> >            </interfaces>
>> > > >>> >        </host>
>> > > >>> >    </network>
>> > > >>> >
>> > > >>> >    <task>
>> > > >>> >        <run host="testmachine1" module="IcmpPing">
>> > > >>> >            <options>
>> > > >>> >                <option name="addr"
>> > > value="{ip(testmachine2,testifc2)}"/>
>> > > >>> >                <option name="count" value="3"/>
>> > > >>> >            </options>
>> > > >>> >        </run>
>> > > >>> >    </task>
>> > > >>> ></lnstrecipe>
>> > > >>> >
>> > > >>> >Please help me to understand the issue here.
>> > > >>> >
>> > > >>> >Thanks for your help in advance.
>> > > >>> >
>> > > >>> >On Sun, Sep 23, 2018, 12:06 AM Jiri Pirko <jiri@resnulli.us>
>> wrote:
>> > > >>> >
>> > > >>> >> Sat, Sep 22, 2018 at 06:35:45PM CEST,
>> sandeepkishan108@gmail.com
>> > > wrote:
>> > > >>> >> >Hi,
>> > > >>> >> >I came across lnst for testing Linux network stack. Its nice
>> work.
>> > > >>> >> >
>> > > >>> >> >Is it possible to use this in Ubuntu ?
>> > > >>> >>
>> > > >>> >> Yes.
>> > > >>> >>
>> > > >>> >> >
>> > > >>> >> >Also can we run the c applications as part this framework  ?
>> > > >>> >>
>> > > >>> >> Yes.
>> > > >>> >>
>> > > >>> >>
>> > > >>> >> >
>> > > >>> >> >Thanks,
>> > > >>> >> >Sandeep.
>> > > >>> >>
>> > > >>>
>> > > >_______________________________________________
>> > > >LNST-developers mailing list --
>> lnst-developers@lists.fedorahosted.org
>> > > >To unsubscribe send an email to
>> > > lnst-developers-leave@lists.fedorahosted.org
>> > > >Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
>> > > >List Guidelines:
>> https://fedoraproject.org/wiki/Mailing_list_guidelines
>> > > >List Archives:
>> > >
>> https://lists.fedorahosted.org/archives/list/lnst-developers@lists.fedorahosted.org
>> > >
>>
>> > _______________________________________________
>> > LNST-developers mailing list -- lnst-developers@lists.fedorahosted.org
>> > To unsubscribe send an email to
>> lnst-developers-leave@lists.fedorahosted.org
>> > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
>> > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
>> > List Archives:
>> https://lists.fedorahosted.org/archives/list/lnst-developers@lists.fedorahosted.org
>>
>> Hi,
>>
>> the last executed command is "ip link set eth0 down" and that's probably
>> the issue - something tells me that eth0 is the device that has the
>> "10.0.0.6" ip address configured and LNST is setting it down. That
>> shouldn't happen because that cuts off the connection between the
>> lnst-ctl and lnst-slave processes.
>>
>> Can you give us the output of "ip a" on that slave machine?
>>
>Below is the *ip a* o/p from slaves -
>
>slave - 1:
>root@ubuntu:~# ip a
>1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group
>default qlen 1
>    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
>    inet 127.0.0.1/8 scope host lo
>       valid_lft forever preferred_lft forever
>    inet6 ::1/128 scope host
>       valid_lft forever preferred_lft forever
>2: eth0: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN group default
>qlen 1000
>    link/ether 00:02:4c:70:76:71 brd ff:ff:ff:ff:ff:ff
>3: sit0@NONE: <NOARP> mtu 1480 qdisc noop state DOWN group default qlen 1
>    link/sit 0.0.0.0 brd 0.0.0.0
>4: ip6tnl0@NONE: <NOARP> mtu 1452 qdisc noop state DOWN group default qlen 1
>    link/tunnel6 :: brd ::
>5: ip6gre0@NONE: <NOARP> mtu 1448 qdisc noop state DOWN group default qlen 1
>    link/gre6 00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00 brd
>00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00
>6: enx0023564c3197: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc
>pfifo_fast state UP group default qlen 1000
>    link/ether 00:23:56:4c:31:97 brd ff:ff:ff:ff:ff:ff
>    inet 10.0.0.18/24 brd 10.0.0.255 scope global enx0023564c3197
>       valid_lft forever preferred_lft forever
>    inet6 fe80::223:56ff:fe4c:3197/64 scope link
>       valid_lft forever preferred_lft forever
>
>
>slave - 2:
>root@ubuntu:~# ip a
>1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group
>default qlen 1
>    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
>    inet 127.0.0.1/8 scope host lo
>       valid_lft forever preferred_lft forever
>    inet6 ::1/128 scope host
>       valid_lft forever preferred_lft forever
>2: eth0: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN group default
>qlen 1000
>    link/ether 00:02:4c:70:76:70 brd ff:ff:ff:ff:ff:ff
>3: sit0@NONE: <NOARP> mtu 1480 qdisc noop state DOWN group default qlen 1
>    link/sit 0.0.0.0 brd 0.0.0.0
>4: ip6tnl0@NONE: <NOARP> mtu 1452 qdisc noop state DOWN group default qlen 1
>    link/tunnel6 :: brd ::
>5: ip6gre0@NONE: <NOARP> mtu 1448 qdisc noop state DOWN group default qlen 1
>    link/gre6 00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00 brd
>00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00
>6: enx0023563c4966: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc
>pfifo_fast state UP group default qlen 1000
>    link/ether 00:23:56:3c:49:66 brd ff:ff:ff:ff:ff:ff
>    inet 10.0.0.6/24 brd 10.0.0.255 scope global enx0023563c4966
>       valid_lft forever preferred_lft forever
>    inet6 fe80::223:56ff:fe3c:4966/64 scope link
>       valid_lft forever preferred_lft forever
>
>Thanks in advance.
>

Could you please send us the
    * LNST version
    * pyroute version
you use on both lnst-controller and lnst-slave machines?

Based on the output above your setup should be correct, so it may be
some LNST issue.

I am using ubuntu-16.04 on host and slaves its ubuntu-18.04

Initially I got the below error from controller side and which got fixed with change (added type) mentioned below-

 Traceback (most recent call last):
      File "/usr/local/bin/lnst-ctl", line 182, in get_recipe_result
        res = exec_action(action, nettestctl)
      File "/usr/local/bin/lnst-ctl", line 137, in exec_action
        return nettestctl.run_recipe()
      File "/usr/local/lib/python2.7/dist-packages/lnst/Controller/NetTestController.py", line 648, in run_recipe
        self._prepare_network()
      File "/usr/local/lib/python2.7/dist-packages/lnst/Controller/NetTestController.py", line 198, in _prepare_network
        self._prepare_machine(m_id, resource_sync)
      File "/usr/local/lib/python2.7/dist-packages/lnst/Controller/NetTestController.py", line 266, in _prepare_machine
        machine.init_connection(recipe_name)
      File "/usr/local/lib/python2.7/dist-packages/lnst/Controller/Machine.py", line 245, in init_connection
        hello, slave_desc = self._rpc_call("hello", recipe_name)
      File "/usr/local/lib/python2.7/dist-packages/lnst/Controller/Machine.py", line 209, in _rpc_call
        result = self._msg_dispatcher.wait_for_result(self._id)
      File "/usr/local/lib/python2.7/dist-packages/lnst/Controller/NetTestController.py", line 901, in wait_for_result
        messages = self.check_connections()
      File "/usr/local/lib/python2.7/dist-packages/lnst/Common/ConnectionHandler.py", line 54, in check_connections
        return self._check_connections(self._connections)
      File "/usr/local/lib/python2.7/dist-packages/lnst/Common/ConnectionHandler.py", line 72, in _check_connections
        data = recv_data(f)
      File "/usr/local/lib/python2.7/dist-packages/lnst/Common/ConnectionHandler.py", line 33, in recv_data
        if isinstance(s, IPRSocket):
    TypeError: isinstance() arg 2 must be a class, type, or tuple of classes and types

---------------------------------
def recv_data(s):
    if isinstance(s, type(IPRSocket)):
        msg = s.get()
        data = {"type": "netlink", "data": msg}
    elif isinstance(s, SecureSocket):
        try:
            data = s.recv_msg()
        except SecSocketException:
            return ""
    elif isinstance(s, Connection):
        data = s.recv()
    else:
        return None
    return data
-------------------------------

1) using v13 release from LNST.
2) using python-2.7

Thanks for your help.