14:31:57 <Greg_E_> #startmeeting Fuel@OPNFV
14:31:57 <collabot> Meeting started Tue Aug 30 14:31:57 2016 UTC.  The chair is Greg_E_. Information about MeetBot at http://wiki.debian.org/MeetBot.
14:31:57 <collabot> Useful Commands: #action #agreed #help #info #idea #link #topic.
14:31:57 <collabot> The meeting name has been set to 'fuel_opnfv'
14:32:08 <DanSmithEricsson> in fact, Fatih is off until thursday and the Slave is reporting "Offline" in Jenkins
14:32:32 <DanSmithEricsson> so unless someone knows how to change that state - i mean, i can start the slave, but i dont know about messing with labels during a week of release cutting
14:32:47 <DanSmithEricsson> might be "wiser" to run manual jobs till then? - again - up to the group what you guys need / want to do
14:33:12 <DanSmithEricsson> (another idea would be to get the toplogy for DPDK nailed down, documented and pushed up to the INFRA/PHAROS team - on Julien's page"
14:34:12 <mskalski> DanSmithEricsson: so this pod is already defined in jenkins but not added to daily deployments? is it possible to deploy some scenario on it from jenkis modifying job properties?
14:34:37 <mskalski> #info Michal Skalski
14:35:49 <z0d> #info Peter Barabas
14:36:14 <Greg_E_> #info Greg Elkinbard
14:39:12 <billyo> #info Billy O'Mahony
14:39:28 <fuel> #info David Chou
14:43:39 <fuel> One question: which version of Ubunu (14.0.4 or 16.0.4 or others) will be used in Compute node foe release D for fuel@opnfv ?
14:44:15 <Greg_E_> D is newton so 16.04 will be supported
14:44:54 <fuel> Thanks!  Still no CentOS?
14:45:16 <Greg_E_> nope
14:45:28 <fuel> Thanks!
14:48:40 <mskalski> fuel: Hi David, do you still use pod10-n1? I'm trying to reproduce a problem with new version of paramiko which we observed there but with no luck, do you think I could update paramiko version on this node and see if problem will appear?
14:50:06 <Greg_E_> Hi folks, we seem to be failing yardstick this week in a bunch of scenarios
14:50:23 <Greg_E_> is anybody chasing down this issue
14:53:19 <fuel> Michal:  I am still using pod10-n1,  but Yunhong may not use pod10-n5, I eill check with him, and let you know in email.
14:53:24 <DanSmithEricsson> #info Daniel Smith
14:54:00 <DanSmithEricsson> mskalski i see that it is registerd in Jenkins - however its marked as offline so that means to me the slave (on the jumphsot) is stopped
14:54:08 <mskalski> Greg_E_: Cathy probably resolved problems with yardstick runs on onos scenarios
14:54:27 <Greg_E_> it is failing on all scenarios
14:54:36 <DanSmithEricsson> mskalski - i "think" its really hust an issue of starting it - then adding the label in Jenkins (if you wanted to run jobs from a pool or singly)
14:55:36 <mskalski> no not at all
14:56:22 <DanSmithEricsson> (my two cents about ONOS) - cathy found an overlapp in IPs .. updated the POD2 override DHA and seems ok to me when i looked at her run last night
14:56:26 <DanSmithEricsson> let me find it
14:57:20 <DanSmithEricsson> https://build.opnfv.org/ci/view/fuel/job/fuel-os-onos-nofeature-ha-baremetal-daily-master/63/
14:57:25 <DanSmithEricsson> this seems to have YS fine
14:57:28 <DanSmithEricsson> but some functest have failed
14:57:38 <DanSmithEricsson> unless i am reading it wrong and that is from 3 hours ago i think ?
14:58:54 <DanSmithEricsson> so part of docter/inspector in FUNCTEST failed for that job
14:58:55 <DanSmithEricsson> https://build.opnfv.org/ci/view/fuel/job/fuel-os-onos-nofeature-ha-baremetal-daily-master/63/
14:59:00 <DanSmithEricsson> https://build.opnfv.org/ci/job/functest-fuel-baremetal-daily-master/436/console
15:00:33 <DanSmithEricsson> Michal - if you want - after this meeting, we can work on getting POD1 up so you can order jobs through jenkins,
15:00:41 <mskalski> DanSmithEricsson: Cathy's change was also cherry picked to stable/colorado right? last run for stable coloardo for onos was 2 days ago, new one should pick up changes
15:00:45 <Greg_E_> nosdn-nofeature, odl_l2-bgpvpn, odl_l2_sfc, odl_l3 are failing yardstick
15:00:48 <DanSmithEricsson> correct
15:01:01 <DanSmithEricsson> i dont know when in the rotation the C- bracnh is run.. there is alot of queing
15:01:07 <DanSmithEricsson> (greg - can you show link)
15:01:23 <DanSmithEricsson> so i can see the page you are looking at
15:01:55 <mskalski> DanSmithEricsson: https://build.opnfv.org/ci/view/fuel/job/yardstick-fuel-baremetal-daily-colorado/
15:02:16 <DanSmithEricsson> thx.
15:02:17 <DanSmithEricsson> lookin
15:02:30 <Greg_E_> this is on stable/colorado bare metal
15:03:50 <DanSmithEricsson> hmm.
15:04:06 <DanSmithEricsson> i see lots of "nova image-list" failures reported.. that is strange - and no URL's found
15:04:28 <DanSmithEricsson> i wonder.. is there a configuration in yardstick that matches the floating ranges we define in the DEA/DHA and they need to be updates to match the hcange that was made?
15:04:39 <DanSmithEricsson> might be a good idea to (on the new branch)
15:04:47 <DanSmithEricsson> run the scenarios manually and do a new "reaping" of the PODs
15:04:56 <DanSmithEricsson> to refresh and ensure the configurations are sound for each
15:05:45 <DanSmithEricsson> since POD2 was butchered up pretty good for different purposes the weeks prior (just a thought) - if you wanted to be really sure - another thing woul dbe to revert the change and see - but i dont see how the shrinking of a floating range by 2 ips (from .200 down to .198) in a range could impact
15:05:59 <DanSmithEricsson> unless YS is addressing those two ips somewhere statically (which would be weird i would think).
15:06:19 <DanSmithEricsson> What do you see Michal?
15:06:40 <DanSmithEricsson> I think we should look at this file in YS configuration
15:06:41 <DanSmithEricsson> etc/yardstick/nodes/fuel_virtual/pod.yaml
15:07:07 <DanSmithEricsson> and that it makes sense (looking - i dont know the YS repo well)  - any YS people around?
15:11:27 <DanSmithEricsson> ??
15:11:54 <mskalski> DanSmithEricsson: i think that yardstick fetch range of floating ips to use from deployed env, but this file which you pointed is interesting since we can't assume that something on given ip is an controller for example
15:13:12 <mskalski> it change between different deployments, question is if this file has an actual  impact on yardsitck run on bare metal
15:16:36 <billyo> Hi guys iirc you tell y/s where the fuel master is and it sshs there and parses the o/p from 'fuel nodes'
15:17:27 <billyo> I know it defintiltey had a problem if you had more that on deployment on the FM. Also don't know what it does for ha - which controller does it chose to pull openrc from? does nti matter.
15:17:43 <billyo> I'm not familiar with etc/yardstick/nodes/fuel_virtual/pod.yaml
15:19:46 <mskalski> billyo: all controllers has the same openrc copy so it doesn't matter but it sounds reasonable that yardstick fetch information from live env, and ignore this config file
15:23:16 <billyo> Also when I was running yardstick manually I had to modify this fetched openrc manually to change all reference of internalURL to publicURL. I'm not sure how y/s when run by jenkins get's round this.
15:23:37 <billyo> dunno if any of that helps
15:27:06 <mskalski> billyo: for bare metal servers jumphost has access to mgmt network, for virtual deployment I recently moved mgmt network to separate nic and configured bridge to which this nic is attache to also have connectivity from yardstick container
15:30:17 <mskalski> billyo: but for libvirt deployment iptables usually block connection from different location than host and because of that connections from container may require additional iptables rule (which is done by ci job)
15:31:33 <billyo> sounds like your are waaaay ahead of me here ;)
15:44:55 <DanSmithEricsson> agreed.. i would think that the YS would pull from the live configuration (env that is set out0, but again - not sure)
15:45:06 <DanSmithEricsson> however, i think we need to approach it in two differetn tracks
15:45:44 <DanSmithEricsson> for the BareMetal we should sort that out and if there is a change in the MGMT network - since in virtual env's that i setup - the only bridge that has a true physical nic is External
15:45:51 <DanSmithEricsson> all the other 4 are not bound to physical nics
15:46:21 <DanSmithEricsson> unless you are talking about a hybrid setup (some vComputes and some BMComputes - but i dont think that is a CI/CD supportted setup yet unless i missed alot)
15:47:12 <DanSmithEricsson> for me, i think its important to trace down the "change" that caused this - cause i really dont think it was the patch picked over.
15:47:18 <DanSmithEricsson> but we need a YS person - maybe Morgan?
15:47:59 <mskalski> DanSmithEricsson: but which change Daniel?
15:49:16 <DanSmithEricsson> sorry - i thought we were working on the assumption that the push that Cathy made to the dea override might be a cause of this
15:49:55 <DanSmithEricsson> maybe i missed something
15:50:05 <DanSmithEricsson> sorry ( trying to do too many chat windows at once).
15:51:40 <mskalski> ah ok, but this change has only impact on ericsson pod2
15:52:14 <DanSmithEricsson> correct
15:52:22 <DanSmithEricsson> ahh - ok - i missed something
15:52:28 <DanSmithEricsson> we are sayign that this is affecting on all pods?
15:52:37 <DanSmithEricsson> (all the YS jobs that Greg pointed out?).
15:54:11 <DanSmithEricsson> ok.. no i am folllowing you a bit more (i think)
15:54:15 <DanSmithEricsson> i see that in https://build.opnfv.org/ci/job/yardstick-fuel-virtual-daily-master/
15:54:23 <DanSmithEricsson> that all the ones that are runnign at on Virtual
15:54:27 <DanSmithEricsson> PODs
15:55:04 <DanSmithEricsson> although - nosdn-kvm-noha just passsed on ericsson-virtual an there is a nosdn-nofeature-noha running now
15:56:25 <DanSmithEricsson> so i think i am with you now Michal (and Billy)
15:56:26 <DanSmithEricsson> the https://build.opnfv.org/ci/job/yardstick-fuel-virtual-daily-master/198/console
15:56:44 <DanSmithEricsson> shows that when the Cirros is coming up on the 172.16.0.189 (which is the PUBLIC network)
15:56:47 <DanSmithEricsson> its not able to SSH in
15:56:56 <DanSmithEricsson> so my first thing I would check is that the security gruop is being created
15:57:02 <DanSmithEricsson> each time we do a branch
15:57:13 <DanSmithEricsson> this param seems to be lost / has to be updated (something to check)
15:58:03 <DanSmithEricsson> since looking at the log - seems to me like the heat template to bring up the cirros image worked ok
16:31:24 <__szilard_cserey> Hi Alex, I have merged your patch
16:31:42 <__szilard_cserey> https://gerrit.opnfv.org/gerrit/#/c/19487/
16:38:43 <Greg_E_> #endmeeting