14:31:57 <Greg_E_> #startmeeting Fuel@OPNFV 14:31:57 <collabot> Meeting started Tue Aug 30 14:31:57 2016 UTC. The chair is Greg_E_. Information about MeetBot at http://wiki.debian.org/MeetBot. 14:31:57 <collabot> Useful Commands: #action #agreed #help #info #idea #link #topic. 14:31:57 <collabot> The meeting name has been set to 'fuel_opnfv' 14:32:08 <DanSmithEricsson> in fact, Fatih is off until thursday and the Slave is reporting "Offline" in Jenkins 14:32:32 <DanSmithEricsson> so unless someone knows how to change that state - i mean, i can start the slave, but i dont know about messing with labels during a week of release cutting 14:32:47 <DanSmithEricsson> might be "wiser" to run manual jobs till then? - again - up to the group what you guys need / want to do 14:33:12 <DanSmithEricsson> (another idea would be to get the toplogy for DPDK nailed down, documented and pushed up to the INFRA/PHAROS team - on Julien's page" 14:34:12 <mskalski> DanSmithEricsson: so this pod is already defined in jenkins but not added to daily deployments? is it possible to deploy some scenario on it from jenkis modifying job properties? 14:34:37 <mskalski> #info Michal Skalski 14:35:49 <z0d> #info Peter Barabas 14:36:14 <Greg_E_> #info Greg Elkinbard 14:39:12 <billyo> #info Billy O'Mahony 14:39:28 <fuel> #info David Chou 14:43:39 <fuel> One question: which version of Ubunu (14.0.4 or 16.0.4 or others) will be used in Compute node foe release D for fuel@opnfv ? 14:44:15 <Greg_E_> D is newton so 16.04 will be supported 14:44:54 <fuel> Thanks! Still no CentOS? 14:45:16 <Greg_E_> nope 14:45:28 <fuel> Thanks! 14:48:40 <mskalski> fuel: Hi David, do you still use pod10-n1? I'm trying to reproduce a problem with new version of paramiko which we observed there but with no luck, do you think I could update paramiko version on this node and see if problem will appear? 14:50:06 <Greg_E_> Hi folks, we seem to be failing yardstick this week in a bunch of scenarios 14:50:23 <Greg_E_> is anybody chasing down this issue 14:53:19 <fuel> Michal: I am still using pod10-n1, but Yunhong may not use pod10-n5, I eill check with him, and let you know in email. 14:53:24 <DanSmithEricsson> #info Daniel Smith 14:54:00 <DanSmithEricsson> mskalski i see that it is registerd in Jenkins - however its marked as offline so that means to me the slave (on the jumphsot) is stopped 14:54:08 <mskalski> Greg_E_: Cathy probably resolved problems with yardstick runs on onos scenarios 14:54:27 <Greg_E_> it is failing on all scenarios 14:54:36 <DanSmithEricsson> mskalski - i "think" its really hust an issue of starting it - then adding the label in Jenkins (if you wanted to run jobs from a pool or singly) 14:55:36 <mskalski> no not at all 14:56:22 <DanSmithEricsson> (my two cents about ONOS) - cathy found an overlapp in IPs .. updated the POD2 override DHA and seems ok to me when i looked at her run last night 14:56:26 <DanSmithEricsson> let me find it 14:57:20 <DanSmithEricsson> https://build.opnfv.org/ci/view/fuel/job/fuel-os-onos-nofeature-ha-baremetal-daily-master/63/ 14:57:25 <DanSmithEricsson> this seems to have YS fine 14:57:28 <DanSmithEricsson> but some functest have failed 14:57:38 <DanSmithEricsson> unless i am reading it wrong and that is from 3 hours ago i think ? 14:58:54 <DanSmithEricsson> so part of docter/inspector in FUNCTEST failed for that job 14:58:55 <DanSmithEricsson> https://build.opnfv.org/ci/view/fuel/job/fuel-os-onos-nofeature-ha-baremetal-daily-master/63/ 14:59:00 <DanSmithEricsson> https://build.opnfv.org/ci/job/functest-fuel-baremetal-daily-master/436/console 15:00:33 <DanSmithEricsson> Michal - if you want - after this meeting, we can work on getting POD1 up so you can order jobs through jenkins, 15:00:41 <mskalski> DanSmithEricsson: Cathy's change was also cherry picked to stable/colorado right? last run for stable coloardo for onos was 2 days ago, new one should pick up changes 15:00:45 <Greg_E_> nosdn-nofeature, odl_l2-bgpvpn, odl_l2_sfc, odl_l3 are failing yardstick 15:00:48 <DanSmithEricsson> correct 15:01:01 <DanSmithEricsson> i dont know when in the rotation the C- bracnh is run.. there is alot of queing 15:01:07 <DanSmithEricsson> (greg - can you show link) 15:01:23 <DanSmithEricsson> so i can see the page you are looking at 15:01:55 <mskalski> DanSmithEricsson: https://build.opnfv.org/ci/view/fuel/job/yardstick-fuel-baremetal-daily-colorado/ 15:02:16 <DanSmithEricsson> thx. 15:02:17 <DanSmithEricsson> lookin 15:02:30 <Greg_E_> this is on stable/colorado bare metal 15:03:50 <DanSmithEricsson> hmm. 15:04:06 <DanSmithEricsson> i see lots of "nova image-list" failures reported.. that is strange - and no URL's found 15:04:28 <DanSmithEricsson> i wonder.. is there a configuration in yardstick that matches the floating ranges we define in the DEA/DHA and they need to be updates to match the hcange that was made? 15:04:39 <DanSmithEricsson> might be a good idea to (on the new branch) 15:04:47 <DanSmithEricsson> run the scenarios manually and do a new "reaping" of the PODs 15:04:56 <DanSmithEricsson> to refresh and ensure the configurations are sound for each 15:05:45 <DanSmithEricsson> since POD2 was butchered up pretty good for different purposes the weeks prior (just a thought) - if you wanted to be really sure - another thing woul dbe to revert the change and see - but i dont see how the shrinking of a floating range by 2 ips (from .200 down to .198) in a range could impact 15:05:59 <DanSmithEricsson> unless YS is addressing those two ips somewhere statically (which would be weird i would think). 15:06:19 <DanSmithEricsson> What do you see Michal? 15:06:40 <DanSmithEricsson> I think we should look at this file in YS configuration 15:06:41 <DanSmithEricsson> etc/yardstick/nodes/fuel_virtual/pod.yaml 15:07:07 <DanSmithEricsson> and that it makes sense (looking - i dont know the YS repo well) - any YS people around? 15:11:27 <DanSmithEricsson> ?? 15:11:54 <mskalski> DanSmithEricsson: i think that yardstick fetch range of floating ips to use from deployed env, but this file which you pointed is interesting since we can't assume that something on given ip is an controller for example 15:13:12 <mskalski> it change between different deployments, question is if this file has an actual impact on yardsitck run on bare metal 15:16:36 <billyo> Hi guys iirc you tell y/s where the fuel master is and it sshs there and parses the o/p from 'fuel nodes' 15:17:27 <billyo> I know it defintiltey had a problem if you had more that on deployment on the FM. Also don't know what it does for ha - which controller does it chose to pull openrc from? does nti matter. 15:17:43 <billyo> I'm not familiar with etc/yardstick/nodes/fuel_virtual/pod.yaml 15:19:46 <mskalski> billyo: all controllers has the same openrc copy so it doesn't matter but it sounds reasonable that yardstick fetch information from live env, and ignore this config file 15:23:16 <billyo> Also when I was running yardstick manually I had to modify this fetched openrc manually to change all reference of internalURL to publicURL. I'm not sure how y/s when run by jenkins get's round this. 15:23:37 <billyo> dunno if any of that helps 15:27:06 <mskalski> billyo: for bare metal servers jumphost has access to mgmt network, for virtual deployment I recently moved mgmt network to separate nic and configured bridge to which this nic is attache to also have connectivity from yardstick container 15:30:17 <mskalski> billyo: but for libvirt deployment iptables usually block connection from different location than host and because of that connections from container may require additional iptables rule (which is done by ci job) 15:31:33 <billyo> sounds like your are waaaay ahead of me here ;) 15:44:55 <DanSmithEricsson> agreed.. i would think that the YS would pull from the live configuration (env that is set out0, but again - not sure) 15:45:06 <DanSmithEricsson> however, i think we need to approach it in two differetn tracks 15:45:44 <DanSmithEricsson> for the BareMetal we should sort that out and if there is a change in the MGMT network - since in virtual env's that i setup - the only bridge that has a true physical nic is External 15:45:51 <DanSmithEricsson> all the other 4 are not bound to physical nics 15:46:21 <DanSmithEricsson> unless you are talking about a hybrid setup (some vComputes and some BMComputes - but i dont think that is a CI/CD supportted setup yet unless i missed alot) 15:47:12 <DanSmithEricsson> for me, i think its important to trace down the "change" that caused this - cause i really dont think it was the patch picked over. 15:47:18 <DanSmithEricsson> but we need a YS person - maybe Morgan? 15:47:59 <mskalski> DanSmithEricsson: but which change Daniel? 15:49:16 <DanSmithEricsson> sorry - i thought we were working on the assumption that the push that Cathy made to the dea override might be a cause of this 15:49:55 <DanSmithEricsson> maybe i missed something 15:50:05 <DanSmithEricsson> sorry ( trying to do too many chat windows at once). 15:51:40 <mskalski> ah ok, but this change has only impact on ericsson pod2 15:52:14 <DanSmithEricsson> correct 15:52:22 <DanSmithEricsson> ahh - ok - i missed something 15:52:28 <DanSmithEricsson> we are sayign that this is affecting on all pods? 15:52:37 <DanSmithEricsson> (all the YS jobs that Greg pointed out?). 15:54:11 <DanSmithEricsson> ok.. no i am folllowing you a bit more (i think) 15:54:15 <DanSmithEricsson> i see that in https://build.opnfv.org/ci/job/yardstick-fuel-virtual-daily-master/ 15:54:23 <DanSmithEricsson> that all the ones that are runnign at on Virtual 15:54:27 <DanSmithEricsson> PODs 15:55:04 <DanSmithEricsson> although - nosdn-kvm-noha just passsed on ericsson-virtual an there is a nosdn-nofeature-noha running now 15:56:25 <DanSmithEricsson> so i think i am with you now Michal (and Billy) 15:56:26 <DanSmithEricsson> the https://build.opnfv.org/ci/job/yardstick-fuel-virtual-daily-master/198/console 15:56:44 <DanSmithEricsson> shows that when the Cirros is coming up on the 172.16.0.189 (which is the PUBLIC network) 15:56:47 <DanSmithEricsson> its not able to SSH in 15:56:56 <DanSmithEricsson> so my first thing I would check is that the security gruop is being created 15:57:02 <DanSmithEricsson> each time we do a branch 15:57:13 <DanSmithEricsson> this param seems to be lost / has to be updated (something to check) 15:58:03 <DanSmithEricsson> since looking at the log - seems to me like the heat template to bring up the cirros image worked ok 16:31:24 <__szilard_cserey> Hi Alex, I have merged your patch 16:31:42 <__szilard_cserey> https://gerrit.opnfv.org/gerrit/#/c/19487/ 16:38:43 <Greg_E_> #endmeeting