13:00:12 <fdegir> #startmeeting Cross Community CI
13:00:12 <collabot`> Meeting started Wed Apr 11 13:00:12 2018 UTC.  The chair is fdegir. Information about MeetBot at http://wiki.debian.org/MeetBot.
13:00:12 <collabot`> Useful Commands: #action #agreed #help #info #idea #link #topic.
13:00:12 <collabot`> The meeting name has been set to 'cross_community_ci'
13:00:17 <fdegir> hi everyone
13:00:24 <David_Orange> Hi
13:00:27 <hw_wutianwei_> hi
13:00:31 <David_Orange> #info David Blaisonneau
13:00:32 <fdegir> #topic Rollcall
13:00:51 <fdegir> please type in your name if you are joining the meeting
13:01:09 <dmcbride> #info David McBride
13:01:19 <hwoarang> #info Markos Chandras
13:01:22 <hw_wutianwei_> #info Tianwei Wu
13:01:31 <mbuil> #info Manuel Buil
13:01:33 <joekidder> #info Joe Kidder
13:01:36 <fdegir> let's start and others can join on the way
13:01:43 <fdegir> #topic OpenCI
13:02:06 <fdegir> #info As highlighted in meeting invitation, OpenCI will be standing agenda item from now on
13:02:31 <fdegir> #info Anyone from OPNFV Community who is interested in OpenCI can join XCI Meeting and get the latest updates
13:03:09 <fdegir> #info OpenCI Infra has been setup and we have a homepage, wiki, gitlab stuff, mailing list and irc channel
13:03:28 <fdegir> #link https://openci.io/
13:03:40 <fdegir> #link https://gitlab.openci.io/openci/community/wikis/home
13:04:18 <joekidder> pretty fancy
13:04:22 <fdegir> #info A prototype to demonstrate CI/CD Federation is in progress - this will use events to establish communication between OPNFV and OpenDaylight CIs
13:04:33 <epalper> #info Periyasamy Palanisamy
13:04:35 <fdegir> anyone has questions/comments?
13:05:15 <fdegir> btw, the meeting agenda is on its usual place: https://etherpad.opnfv.org/p/xci-meetings
13:05:17 <David_Orange> what is "communication" ?
13:05:33 <fdegir> David_Orange: great question
13:05:37 <fdegir> let me info in
13:05:51 <David_Orange> sure
13:05:55 <fdegir> #info Our CIs currently rely on timers/polling and so on instead of doing things when things happen
13:06:17 <fdegir> #info By making CIs event driven, we can simply enable our CIs to talk to each other via events
13:06:37 <fdegir> #info For example, OpenDaylight has autorelease jobs and we currently ask if there is a new artifact there
13:07:38 <fdegir> #info With event driven CI, OpenDaylight CI/Autorelease job can simple announce availability of a new artifact which passed certain level of testing and promoted for the use of others (ie. reached to a certain Confidence Level) and anyone who is interested in those artifacts can consume the event and fetch the artifact
13:08:09 <fdegir> #info The events will carry certain metadata such as what level of testing that artifact passed, what the confidence level is, where it is stored and so on
13:08:26 <fdegir> #info Currently we do magic and parse Jenkins comments passed to Gerrit to find artifacts
13:08:27 <David_Orange> so it is a system of triggers to get feedback from partners
13:08:41 <fdegir> David_Orange: you can say that but it is more than that
13:09:02 <fdegir> #info Another example is CNCF parses ONAP Jenkins job logs to extract info about artifacts
13:09:05 <fdegir> these are all messy...
13:09:27 <fdegir> #info For federation to happen, a messaging protocol which all CIs adhere to is needed
13:09:46 <fdegir> #info The demo between OPNFV and OpenDaylight aims to highlight this fact and start the conversation around the protocol
13:10:38 <fdegir> #info Another and perhaps pretty crucial benefit of this is to establosh E2E Traceability since the events can refer to each other; I've been published because this event caused triggering of the job which published me
13:10:57 <David_Orange> a publish subscribe 'like' methods ?
13:11:02 <fdegir> David_Orange: yes
13:11:16 <fdegir> publishers and consumers
13:11:56 <David_Orange> ok, great, thanks for this clarification
13:12:03 <fdegir> David_Orange: np
13:12:18 <fdegir> if anyone has ideas/experience/interest, please contribute to this so we move it forward
13:12:39 <fdegir> if there is no other question about OpenCI, moving to the XCI part of the agenda
13:12:53 <fdegir> which is high prio items
13:12:58 <fdegir> #topic Baremetal Status
13:13:13 <fdegir> David_Orange: are you still looking into this or moved to Kolla?
13:13:30 <David_Orange> i am in the middle
13:13:33 <jmorgan1> #info Jack Morgan
13:13:43 <fdegir> David_Orange: ok
13:13:57 <David_Orange> trying to propose a base for moving all installer to pdf/idf
13:14:06 <fdegir> I want to let everyone know that the highest prio for us is to get Baremetal working
13:14:12 <David_Orange> (cf patch about inventory)
13:14:41 <David_Orange> maybe you should explain what you aim under 'baremetal'
13:14:46 <fdegir> scenarios etc are important but we have been promoting scenarios from post-merge but not continuing with the rest of the CI loops
13:15:12 <fdegir> #info We need to ensure we have working baremetal deployment in place - starting with os-nosdn-nofeature and with PDF/IDF
13:15:17 <fdegir> #info Rest has lower prio
13:15:22 <David_Orange> all baremeals ? just one ?
13:15:37 <fdegir> David_Orange: do you mean all PODs?
13:15:40 <David_Orange> yes
13:15:49 <fdegir> David_Orange: if we have one, that is a good start
13:16:35 <David_Orange> from my point of view there is 2 parts, the baremetal deploy of an OS, and the BM deploy of installers
13:16:51 <fdegir> OS=operating system or OS=openstack?
13:17:12 <David_Orange> fdegir: Operating system, sorry
13:17:39 <fdegir> and we don't talk about installers
13:17:46 <fdegir> we talk about getting scenarios on baremetal
13:17:57 <David_Orange> and in the middle a set of common roles that shall configure Op.S. with network and an inventory to simplify the work of the installer
13:18:09 <fdegir> and we currently have 2 installers which are eligible to go to baremetal; osa and kubespray
13:18:30 <David_Orange> that is the roles of patches around inventory and the one for network
13:18:48 <fdegir> David_Orange: are you talking about patches in prototypes folder or there are other patches?
13:19:20 <David_Orange> other patches, I will not touch the patch inside proto until review, maybe tomorrow or never
13:19:59 <David_Orange> fdegir: the scenarios are based on what the installer deploys, no ?
13:20:15 <fdegir> David_Orange: yes
13:20:36 <fdegir> David_Orange: but this is a more general comment - it is past time we stop talking about installers and focus on the scenarios
13:20:36 <David_Orange> so it shall impacts also the installers
13:21:16 <fdegir> just to clarify; my comment about baremetal eligibility of installers is based on the promoted scenarios
13:21:57 <fdegir> David_Orange: please paste the links to the patches you are talking about
13:22:11 <David_Orange> ok, you mean we focus on one simple scenario + installer, not all scenarios + installer
13:22:33 <fdegir> David_Orange: yes
13:22:33 <David_Orange> https://gerrit.opnfv.org/gerrit/#/c/55319/
13:22:47 <fdegir> David_Orange: once we have one working, the others need to be adapted which we have owners for
13:22:58 <David_Orange> sure
13:23:20 <dmcbride> fdegir: for release purposes, does this mean that all scenarios will have the option of osa or kubespray?
13:23:50 <fdegir> dmcbride: currently all openstack scenarios that are promoted use osa
13:23:55 <David_Orange> the other about network is https://gerrit.opnfv.org/gerrit/#/c/52841/ even if i dont think the actual version is good (cf tech talk AoB)
13:24:01 <fdegir> dmcbride: and all k8s scenarios that are promoted use kubespray
13:24:15 <dmcbride> fdegir: ok - got it
13:24:35 <fdegir> David_Orange: the 2nd change will probably have to wait unfortunately
13:24:56 <fdegir> David_Orange: the other change for kolla is disruptive - meaning that it will impact whole CI chain
13:24:59 <David_Orange> in the actual way i will put a -1
13:25:15 <fdegir> to everyone: please review https://gerrit.opnfv.org/gerrit/#/c/55319/
13:25:17 <fdegir> #link https://gerrit.opnfv.org/gerrit/#/c/55319/
13:25:42 <mbuil> it says WIP
13:25:48 <David_Orange> this one will also impact the whole chain
13:26:05 <fdegir> David_Orange: do you plan to continue working on https://gerrit.opnfv.org/gerrit/#/c/55319/ or is it ready for review?
13:26:09 <David_Orange> yes, because it can be enhanced and i wish feedback
13:26:17 <fdegir> mbuil: ^
13:26:34 <fdegir> David_Orange: you can tell ci which scenario you want your change to be tested
13:26:36 <mbuil> David_Orange: I understand that it is ready for review then
13:26:56 <fdegir> David_Orange: in order to do that, you need to add below lines to commit message
13:27:01 <fdegir> deploy-scenario:os-nosdn-nofeature
13:27:05 <fdegir> installer-type:osa
13:27:18 <fdegir> David_Orange: CI will then use osa and deploy os-nosdn-nofeature
13:27:29 <David_Orange> as i have the bad habit to create big patch, i probably dont have the good way to propose patches :) this one can work, as it is common and impact everyone i set WIP
13:27:59 <David_Orange> fdegir: ok, how can i do that ?
13:28:10 <David_Orange> (offline talk if you prefer)
13:28:13 <fdegir> few lines above
13:28:25 <fdegir> you need to add below lines to commit message
13:28:30 <fdegir> deploy-scenario:os-nosdn-nofeature
13:28:30 <David_Orange> ok, missed it, sorry
13:28:36 <fdegir> installer-type:osa
13:28:38 <fdegir> no spaces etc
13:29:06 <fdegir> btw, ci skips commit message updates so you need to touch a file in change to ensure the jobs get run
13:29:29 <fdegir> we can continue talking about baremetal after the meeting
13:29:35 <fdegir> thanks for the updates David_Orange
13:30:03 <David_Orange> about this patch, i added a test folder, to show reviewers that want to test it on local, that templates are creating exactly the actual templates :)
13:30:11 <fdegir> I take this as we will continue have you as our baremetal expert which is good
13:30:32 <fdegir> #topic CI Status
13:30:52 <fdegir> #info We have patchset verification and post merge jobs running for OpenStack scenarios, promoting stuff
13:31:01 <David_Orange> an will be in favour of a tech talk someday dedicated to avolution to BM
13:31:01 <fdegir> #link https://build.opnfv.org/ci/job/xci-merge-virtual-master/
13:31:32 <fdegir> #info The current criteria for patchset verification and post-merge is noha virtual deployment + healthcheck which will be revisited once we have baremetal is working
13:32:17 <fdegir> #info For Kubernetes scenarios, the criteria for patchset verification and post merge is only the deployment
13:32:27 <mbuil> is xci-merge-ubuntu-virtual-master != xci-verify-ubuntu-virtual-master?
13:32:33 <mbuil> sorry
13:32:36 <fdegir> #info Work to integrate functest healthcheck is still in progress and should be complete this week
13:32:44 <fdegir> mbuil: they do same thing at the moment
13:33:01 <fdegir> mbuil: that will change once we have baremetal working
13:33:03 <mbuil> fdegir: 100% sure they are the same?
13:33:15 <mbuil> one works and the other does not :(
13:33:18 <fdegir> mbuil: I 100% hope they are the same
13:33:39 <fdegir> mbuil: I'll check them and ping you
13:33:45 <dmcbride> fdegir: does HC apply to k8s scenarios, or only OS scenarios?
13:33:54 <fdegir> dmcbride: only OS at the moment
13:34:04 <mbuil> ok
13:34:12 <fdegir> dmcbride: patches to enable it were under review and should be ready soon - this week
13:34:21 <dmcbride> +1
13:34:36 <fdegir> dmcbride: https://gerrit.opnfv.org/gerrit/#/q/project:releng-xci+branch:master+topic:xci-functest-integration
13:35:01 <fdegir> dmcbride: some of them were abandoned due to me messing up things - conflicts etc
13:35:09 <fdegir> dmcbride: new ones will be sent
13:35:32 <fdegir> btw; anyone who might work with k8s scenarios will be blocked until the healthcheck is integrated
13:35:55 <fdegir> I jsut submitted a patch to enable the testing on jenkins job side but the actual test parts are in progress
13:36:51 <fdegir> #info XCI Dashboard is available to see the scenario status: http://129.192.69.214/xci.php
13:37:35 <fdegir> anyone has any questions about all the things I've mentioned above?
13:38:04 <fdegir> I want to reiterate that we are in pretty good shape from CI point of view
13:38:22 <jmorgan1> yup, great job
13:38:23 <fdegir> we need to get baremetal working so we can continue our journey towards establishing CI Evolution truly
13:38:45 <fdegir> and k8s healthcheck is important as well but it is pretty trivial comparing to baremetal
13:38:55 <fdegir> thx jmorgan1 :)
13:38:57 <OPNFV-Gerrit-Bot> David Blaisonneau proposed releng-xci: [WIP] Generate inventory file  https://gerrit.opnfv.org/gerrit/55319
13:39:06 <fdegir> #topic Long Duration Testing Support
13:39:25 <fdegir> #info We had some conversations with Test WG and they need a timeline for baremetal availability
13:39:30 <fdegir> David_Orange: ^
13:39:37 <fdegir> David_Orange: I promised them to ask this to you
13:39:50 <fdegir> David_Orange: you don't need to answer now so I am merely keeping my promise
13:40:11 <fdegir> #info We need to ensure they have something totally automated before the hackfest
13:41:23 <fdegir> #topic CI Support for Test Projects
13:41:50 <fdegir> #info We are working on enabling snapshotting of a known/good deployment for test projects so they can use it for gating their patches
13:41:56 <fdegir> epalper: anything you want to add?
13:42:27 <epalper> fdegir: I'm trying with export/import of XCI VM snapshots.
13:42:48 <epalper> https://gerrit.opnfv.org/gerrit/#/c/48391/
13:42:59 <fdegir> epalper: please focus on mini flavor if you have been trying it for others instead
13:43:25 <epalper> looks like we need to migrate qcow2 images with its xml
13:43:42 <epalper> instead of actual vm snapshots with its state
13:43:57 <epalper> this creates lots of problems
13:44:15 <David_Orange> fdegir: sorry someone in my office, i rewind the irc logs
13:44:19 <fdegir> epalper: ok - again, we can go into details offline
13:44:26 <epalper> sure
13:44:26 <fdegir> epalper: thanks for the update
13:44:47 <fdegir> #topic Quick Status Check for the Scenarios
13:44:57 <fdegir> anyone has any update for the scenarios they are working on?
13:45:05 <fdegir> mbuil: hw_wutianwei_: epalper: ^
13:45:50 <epalper> fdgedir: we need to run the tests against ODL oxygen for bgpvpn scenario. its not done yet
13:46:00 <hw_wutianwei_> fdegir:  I am working on k8-nosdn-nofeature and k8-canal-nofeature
13:46:29 <hw_wutianwei_> #link https://gerrit.opnfv.org/gerrit/#/c/54309/
13:46:34 <fdegir> #info os-odl-bgpvpn needs to switch to ODL Oxygen
13:46:48 <hw_wutianwei_> #info https://gerrit.opnfv.org/gerrit/#/c/55317/
13:46:50 <fdegir> #info Work is in progress with k8-nosdn-nofeature and k8-canal-nofeature
13:46:56 <hw_wutianwei_> please  review
13:47:05 <fdegir> #info k8-nosdn-nofeature switches network plugin from calico to kubenet
13:47:17 <fdegir> #info A new scenario k8-calico-nofeature will be created later on
13:47:25 <hw_wutianwei_> fdegir:  yep
13:47:57 <fdegir> #info Kubernetes scenarios hw_wutianwei_ and Taseer working on are important for Scenario Consolidation and SDF which will use the 4 k8s scenarios for prototyping
13:48:02 <mbuil> fdegir: moving sfc to Oxygen fixed our healthcheck issues for verification and merge in opensuse and for verification in ubuntu. However xci-merge-ubuntu-virtual-master still shows those issues
13:48:25 <mbuil> I can't reproduce them in laas :(
13:48:44 <fdegir> mbuil: there should be no difference at that part since they both use same script to run functest
13:49:05 <fdegir> mbuil: I've seen you did remerge which is good - if it fails again, we can take a closer look as I suggested above
13:49:45 <fdegir> I think that's all for the scenario updates
13:49:55 <fdegir> thx mbuil epalper hw_wutianwei_ and Taseer for taking care of the scenarios
13:50:11 <fdegir> #topic AoB
13:50:27 <fdegir> who added the topic "evolution of the shared role for configuring nodes"?
13:50:30 <dmcbride> is there a OPNFV project that is using Calico?
13:50:41 <David_Orange> fdegir: myself
13:50:44 <fdegir> dmcbride: i don't hthink so
13:50:49 <jmorgan1> do we have pdf support for xci?
13:50:58 <fdegir> jmorgan1: David_Orange is working on it
13:51:05 <jmorgan1> fdegir: thanks
13:51:36 <fdegir> David_Orange: would you like to share your thinking here so we can perhaps continue after the meeting or during next meeting or book a separate meeting?
13:51:43 <David_Orange> jmorgan1: pdf+idf in /prototypes to deploy Op.Sys, your are welcome to review it
13:52:05 <jmorgan1> fdegir: we will need it for CI evolution completeness
13:52:14 <jmorgan1> David_Orange: ok, i will thanks
13:52:51 <dmcbride> what is the status of idf?
13:53:04 <dmcbride> same as pdf?
13:53:08 <jmorgan1> dmcbride: its a work in progress
13:53:11 <David_Orange> the idea behind that talk is to have your feelings about common roles (configure network, inventory, configure...)
13:53:27 <jmorgan1> dmcbride: pdf is done, just needs opnfv labs to create them for all opnfv POD
13:53:36 <fdegir> David_Orange: i personally think we should try to keep things as common as possible until we have no possibility to have that
13:54:00 <dmcbride> jmorgan1: and the updates to support xci
13:54:03 <David_Orange> as we have more installers, and with the introduction of PDF/IDF, my opinion is that we have to share the maximum of roles to prepare the steps before the installers parts
13:54:03 <jmorgan1> dmcbride: IDF is a pre-SDF effort, they might be the same file or two files / efforts
13:54:07 <fdegir> David_Orange: the roles could be same but templates/vars could be different
13:54:31 <dmcbride> jmorgan1: ok - thanks
13:54:58 <David_Orange> fdegir: it is a possibility but it push more complexity to installer part
13:55:06 <jmorgan1> dmcbride: pdf support should be easier since the format of the file is done
13:55:11 <joekidder> quick question - does osa use pdf/idf?  I'm guessing it's outside of OPNFV scope...but not sure.
13:55:31 <fdegir> David_Orange: let us think about the impacts of multiple installers once we have one of them working
13:55:54 <David_Orange> as PDF/IDF is not always easy to read and get info from it, having a common basis for all installer masking a bit of the complexity of xDFs shall be a good option
13:55:57 <jmorgan1> dmcbride: idf or sdf or both are WIP.. 1st need to standarize on format of the file, need idf + sdf or idf will become sdf, etc
13:56:12 <fdegir> joekidder: osa doesn't really deal with that part
13:56:23 <fdegir> joekidder: it just gets openstack on nodes you prepare in advance
13:56:24 <jmorgan1> dmcbride: then once its working, then get support opnfv installers + xci support
13:56:44 <fdegir> joekidder: and then have the config files reflect the configuraiton you want to have depending on your nodes/networking
13:56:48 <David_Orange> fdegir: to have coded one (nearly 2) with PDF/IDF, managing networks with PDFs is not easy
13:57:12 <fdegir> joekidder: the pdf/idf is mainly used for provisioning with bifrost, host-bootstrap
13:57:25 <fdegir> joekidder: and then the config is also reflected to osa config files
13:57:37 <David_Orange> and pushing complexity to one installers is not a option in my view
13:58:05 <fdegir> David_Orange: sorry - lost track
13:58:06 <jmorgan1> dmcbride: David_Orange is the one really working on it, just sharing my observation ;)
13:58:41 <joekidder> fdegir ok.  thanks.  been focused on typical opnfv installers and need to start playing with xci to get more educated:)
13:59:09 <David_Orange> i mean , in the xDF, you dont have the info about interface name to use for example
13:59:10 <jmorgan1> we need baremetel support issue resolved 1st (sounds like) before pdf/idf support
13:59:41 <fdegir> David_Orange: how does fuel or daisy do that then?
13:59:45 <David_Orange> if we let installer parse all that stuff it will be a hard job done more than one time
14:00:06 <David_Orange> i dont know, but they probably have a pivot file to do that
14:00:22 <David_Orange> and they only have to do it once
14:00:22 <fdegir> let's end the meeting and we continue this conversation afterwards
14:00:28 <David_Orange> fdegir: sure
14:00:38 <fdegir> thanks all for joining!
14:00:40 <fdegir> #endmeeting