13:30:52 #startmeeting Cross Community CI 13:30:52 Meeting started Wed Nov 1 13:30:52 2017 UTC. The chair is fdegir. Information about MeetBot at http://wiki.debian.org/MeetBot. 13:30:52 Useful Commands: #action #agreed #help #info #idea #link #topic. 13:30:52 The meeting name has been set to 'cross_community_ci' 13:30:56 #topic Rollcall 13:31:04 please type in your name if you are joining the meeting 13:31:36 #info Tianwei Wu 13:31:46 #info Stephen Wong 13:32:47 the agenda is on etherpad 13:32:49 #link https://etherpad.opnfv.org/p/xci-meetings 13:33:03 and as usual, we start with scenario status 13:33:19 #topic Scenario/Feature Status: k8-nosdn-nofeature 13:33:27 s3wong: did you get any reviews? 13:33:45 #info qiliang 13:34:09 fdegir: no --- FYI, the patch is here: https://gerrit.opnfv.org/gerrit/46153 13:34:17 #info s3wong sent the first patch for k8s integration 13:34:20 #link https://gerrit.opnfv.org/gerrit/#/c/46153/ 13:34:28 #info Victor Morales 13:34:38 s3wong: I suppose it is fine for people to review it even though it says WIP 13:34:46 It is WIP, probably why no one is looking. And it is under development, so expect changes 13:35:18 fdegir: agreed. At least please give feedback if the general direction of the implementation matches what folks expect 13:35:33 s3wong: will do 13:35:44 s3wong: we will do 13:36:08 s3wong: one thing I want to highlight is that we intend to place scenario stuff into https://gerrit.opnfv.org/gerrit/gitweb?p=releng-xci.git;a=tree;f=xci/scenarios 13:36:14 s3wong: for generic scenarios 13:36:26 I do want to say that at this point, kubespray isn't too consistently stable... at the very least, I kept on bumping into timing out (for the first time) during the wait time for control plane to come up (during kubeadm init part of the playbook) 13:36:45 s3wong: you can also take a look at sfc scenario in sfc repo to see how mbuild did that and adjust it for k8s 13:37:08 fdegir: sure --- I noticed. Will move my stuff over 13:37:23 s3wong: that's one of the purposes of this activity; evaluate kubespray and if you find out it is not stable enough, we can look at other options 13:37:46 fdegir: absolutely 13:38:09 s3wong: a related question 13:38:23 s3wong: clover project got approved yesterday so how do you see its relation to xci? 13:38:43 there were few references to xci so it would be good to get an indication regarding intentions 13:38:51 and congrats for the project btw 13:39:27 fdegir: we do intend to use xci-k8s for our installation --- we have no intention to implement k8s installation automation in Clover 13:39:36 fdegir: thanks 13:39:49 s3wong: so you have to fix the scenario :) 13:39:54 good to hear 13:40:00 fdegir: yes, I do :-) 13:40:07 anything else you want to add? 13:40:16 fdegir: that's it for me 13:40:21 thx s3wong 13:40:28 moving to ceph 13:40:34 #topic ceph in xci 13:40:45 hw_wutianwei: so the change is waiting few more reviews 13:40:55 fdegir: yep 13:41:04 #info xci ceph integration has been completed and the change is waiting for more review 13:41:15 Integrating ceph has finished. 13:41:25 #link https://gerrit.opnfv.org/gerrit/#/c/42503/ 13:41:36 other people can give more suggestions 13:41:50 #info the change will be submitted by the end of week so it is your chance to look at it and provide comments 13:42:24 great work hw_wutianwei ! 13:42:38 especially the perseverance 13:42:56 and thx for getting it done 13:43:04 fdegir: after finishing ceph, I can spend some time to other scenarios 13:43:15 that would be good 13:43:24 perhaps helping out with ovs 13:43:25 fdegir: such as ovs or k8s 13:43:28 and followed by dpdk 13:43:35 fdegir: yep 13:43:38 moving to ovs then 13:43:45 #topic ovs in xci 13:43:55 #info epalper has a patch for review for ovs integration 13:44:25 #link https://gerrit.opnfv.org/gerrit/#/c/43447/ 13:45:02 #info This type of features require us to adjust the xci itself which is what hwoarang also mentioned 13:45:33 no matter what, hw_wutianwei you can perhaps take a look at the patch to see how it looks 13:45:46 fdegir: yep 13:45:46 fdegir: what kind of adjustments? 13:46:08 fdegir: I will try to do 13:46:18 electrocucaracha: the thing is, we want to keep whatever deployed using in releng-xci/xci by default as same as the upstream osa 13:46:27 electrocucaracha: which doesn't have ovs and/or ceph 13:46:40 :O 13:46:54 electrocucaracha: and instead push the default stuff set/used by opnfv to a specific scenario 13:47:07 such as os-nosdn-nofeature which should have ceph and ovs 13:47:34 this is important for upstream patch verification since if we verify patches with ceph + ovs, upstream might say that is not valid 13:48:02 I hope I'm making sense 13:48:17 yes, it is... thanks 13:48:22 good 13:48:26 moving to Taseer 13:48:29 #topic congress in xci 13:48:37 Yes 13:48:47 I know you have good news 13:48:58 I think the conrgress role is close to completion 13:49:09 Can someone please paste the agenda ? 13:49:17 the etherpad link ? 13:49:27 #info Dimitrios Markou 13:49:41 OSA PTL told me he has put the request for inclusion of role into OSA 13:50:13 So it is a matter of time, 13:50:17 #info The congress integration is close to completion 13:50:19 #link https://review.openstack.org/#/c/503971/ 13:50:26 mardim: https://etherpad.opnfv.org/p/xci-meetings 13:50:33 fdegir, thanks :) 13:50:37 when the OpenStack TC approve 13:51:14 Taseer: thank you for this 13:51:26 fdegir: It it my pleasure ! 13:51:32 congress is another feature we might need to push to os-nosdn-nofeature scenario 13:51:40 this obviously depends on upstream as well 13:52:04 if upstream osa makes congress part of their gate, we can keep it by default as well 13:52:06 we'll see 13:52:39 #topic os-odl-sfc 13:52:48 mardim: do you know the status of sfc? 13:53:04 I can speak more for the status of ovs-nsh if you want 13:53:05 ? 13:53:08 fdegir 13:53:18 fdegir ^ * 13:53:28 I'll have it as next topic 13:53:34 let me add few words about sfc first 13:53:49 ok lets skip this because manuel is the expert fot the odl-sfc topic 13:53:56 ok sure 13:53:58 #info sfc scenario is committed in sfc repo but it needs 2 things before we get it finalized 13:54:23 #info first thing is similar to ovs itself, we need the groundwork finalized - the overall structure of things and scenario support 13:54:36 #info the external/child scenario support has been merged recently 13:55:15 #link https://gerrit.opnfv.org/gerrit/#/q/topic:add-role-hooks+(status:open+OR+status:merged) 13:55:40 #info And the second issue was about mbuil needing to have a later version of osa for a certain bugfix (if I am not mistaken) 13:56:00 #topic ovs-nsh 13:56:04 mardim: go ahead 13:56:25 ok so the blueprint that I had for the ovs-nsh suport 13:56:28 is merged 13:56:32 https://review.openstack.org/#/c/476121/ 13:56:48 and we are planning to upstream the ovs-nsh os neutron changes 13:56:54 #info Blueprint for ovs-nsh has been merged 13:56:58 that we have currently to a private repo 13:57:05 #link https://review.openstack.org/#/c/476121/ 13:57:19 Al;so we are palnning to create the ovs-nsh packages fro suse and redhat 13:57:32 Also* 13:57:37 for* 13:57:42 #info ovs-nsh changes will be done in upstream 13:57:45 That's all 13:57:53 fdegir, thanks 13:57:56 #info Packages for suse and redhat will be made available 13:58:05 this is also very good 13:58:09 thanks mardim 13:58:13 :) 13:58:17 mardim: an extra question 13:58:28 the default ovs scenario will use 2.6 (?) 13:58:35 and the sfc will use 2.? ? 13:59:02 sfc will use 2.6 ovs with yiyang's NSH patches 13:59:16 2.6.1 actually 13:59:18 mardim: I thought those patches were accpeted upstream 13:59:49 fdegir, I am not sure but I think they support nsh upstream for userspace only 14:00:13 fdegir, We need also kernelspace NSH support 14:00:21 mardim: ok 14:00:25 thanks for the clarification 14:00:34 fdegir, I think I remember correct on this 14:00:38 no problem :) 14:00:54 so, the next topuc is 14:00:57 #topic Baremetal status 14:01:17 #info David already got it working on Orange POD and it will be done on Nokia POD for long duration testing 14:01:25 #undo 14:01:25 Removing item from minutes: 14:01:44 #info David Blaisonneau already got it working on Orange POD and it will be done on Nokia POD for long duration testing 14:02:13 #info But his approach is a bit different from how we are thinking of doing things (to be more precise, how I was envisioning) 14:02:52 #info This is also related to how to structure things 14:02:54 #link https://etherpad.opnfv.org/p/xci-structure 14:03:15 #info The discussion is going on and we will continue once David is back from his vacation 14:03:22 #info Dave Urschatz 14:03:42 #info Tapio Tallgren 14:03:51 welcome ttallgren durschatz 14:04:10 it seems we had some mixup due to winter time change so sorry for that 14:04:22 np 14:04:33 ttallgren: your turn :) 14:04:38 #topic Centos support 14:04:59 ttallgren: any luck with it? 14:05:05 Yes, wait¨ 14:05:53 It crashes on one of the openstack-ansible modules 14:06:27 #info The installation fails during one of the osa modules 14:07:25 role is repobuild-prepare or something like that that 14:07:55 It is one of the modules that the script pulls in from github.com so it is not so easy for me to fix 14:08:06 ttallgren: can you perhaps post the log to hastebin/pastebin if you see it again so we can ask hwoarang to chase upstream 14:08:34 #info The failing role is repobuild-prepare (or something like that) 14:08:45 Yes, I can do that but not right now (I am not connected to the lab machine at the moment) 14:10:06 whenever you have time 14:10:36 ttallgren: also, it would be good to record the osa sha and perhaps the sha of the role so we know what version you are having trouble with 14:10:58 I copied the shas from releng-xci 14:11:09 I just had a look at osa centos gate jobs and the ones I looked either failed or timed out so upstream centos doesn't look healthy either 14:11:24 Good :-) 14:11:31 we need to check with hwoarang and others to get the latest status info 14:11:46 #action fdegir to check status of centos support upstream with hwoarang 14:11:56 ttallgren: I assume bifrost works just fine? 14:12:23 Yes 14:12:42 #info Bifrost on Centos looks good 14:12:54 thx ttallgren 14:13:11 moving to the next topic 14:13:16 #topic Improving stability 14:13:32 #info We have got some reports from users about the issues they are experiencing 14:13:59 #info The issues are mainly related to not using a clean installation 14:14:24 #info We need to ensure that we isolate ourselves as much as possible from the machine so we don't require users to reinstall their machines 14:15:14 #info This will be achieved by pushing everything into opnfv vm; bifrost installation, node provisioning/deployment, scenario installation and so on so the only requirement we will have on the host machine will be default ansible and libvirt stuff 14:15:50 #info This is also related to Dynamic CI and LaaS so what will be done has more uses 14:16:06 anyone has any questions/comments about this? 14:16:32 durschatz: maybe you since you are one of the imprtant and valued users of the XCI 14:17:05 yes. I totally agree. I ended having to redeploy OS on BM many times 14:17:18 and that did fix issues 14:17:19 :) 14:17:21 +1 14:17:21 sorry for that 14:17:27 :-) 14:17:30 just want to say this has highest prio for us atm 14:17:40 wonderful! 14:17:41 and first thing is getting PDF for vPODs created 14:18:02 #info PDF for vPOD is under review 14:18:15 #link https://gerrit.opnfv.org/gerrit/#/c/46493/ 14:18:40 #info Once that change gets merged, PDFs for other flavors will be created 14:18:58 AlexAvadanii: ^ 14:19:05 the last topic is about 14:19:12 #topic Bumping OSA SHA 14:20:19 #info hwoarang is working on moving us to a newer SHA which will have pre-queens 14:20:47 #link https://gerrit.opnfv.org/gerrit/#/c/46431/ 14:21:02 #topic AoB 14:21:13 anyone wants to bring up anything? 14:21:21 ANyone going to Sydney? 14:21:39 ttallgren: I am 14:21:43 I won't 14:21:44 have an xci talk :) 14:21:49 OpenStack loves xci 14:22:06 Great, see you there! 14:22:07 not me 14:22:17 fdegir: well I'm still struggling with the proxy stuff for aio, specially lxc_hosts role 14:22:25 ttallgren: +1 14:22:36 electrocucaracha: was your change merged? 14:23:09 fdegir: the change for adding proxy vars into the xci tasks? 14:23:32 fdegir: that needs more love hehehe 14:23:38 electrocucaracha: https://gerrit.opnfv.org/gerrit/#/c/45383/ 14:23:45 :) 14:24:22 electrocucaracha: so you are trying this out locally and hitting issues with lxc_hosts role 14:24:34 yeah, I figure out how to use the same approach without modifying the start_vm script 14:24:38 electrocucaracha: have you tried asking this in #openstack-ansible channel? 14:25:01 fdegir: yes, specially when that tries to get pip 14:25:15 electrocucaracha: and you use start_vm for running stuff yourself? 14:25:50 electrocucaracha: that might make it a bit more complicated then as that script is for ci as hwoarang mentioned on the change 14:25:56 fdegir: yes, because I want to keep my environment clean 14:26:22 electrocucaracha: I think what I mentioned above about more isolation will help you to develop/test things without needing to have that start_vm vm 14:26:33 fdegir: so I figure out adding those things to externally 14:26:34 https://gist.github.com/electrocucaracha/3b83004b0233b99c480546d895939839 14:26:51 electrocucaracha: and that was actually about when I found out how kolla-ansible uses bifrost 14:27:13 but that needs to be looked into later since it is much bigger change than we can afford right now 14:28:22 ok 14:28:37 anything more from anyone else? 14:28:44 fdegir: agree, I'm not sure how that can be implemented in the current schemas 14:29:05 +1 14:29:09 we will fix it 14:29:19 ONAP status on vPODS? 14:29:33 durschatz: thanks for reminding 14:30:04 durschatz: I think it is also about Auto project, isn't it? 14:30:15 yes 14:30:36 ish 14:30:40 so, we will support Auto as soon as we fix the issues I mentioned above 14:30:46 and we need k8s as well 14:30:47 OK 14:30:59 David will work on it 14:31:11 are we on track for Plugfest? 14:31:19 my expectation is to have both vPOD and BM ready by plugfest 14:31:24 at least for OpenStack 14:31:40 OK 14:31:40 for k8s, we need s3wong's opinion 14:32:01 and I know David's colleague is looking into Rancher so we will probably have something by that time 14:32:34 Thanks. That's it for me 14:32:44 our ambition is to put xci (OpenStack/k8s masters) on baremetal during plugfest 14:32:49 we will see 14:33:51 #info Next week's the meeting will be at 15:00CET and the invitation will be switched to UTC once all this time changes are over 14:33:58 thank you all and talk to you next week! 14:34:05 #endmeeting