07:59:27 <ollivier> #startmeeting Functest weekly meeting 24 Apr. 2018
07:59:27 <collabot`> Meeting started Tue Apr 24 07:59:27 2018 UTC.  The chair is ollivier. Information about MeetBot at http://wiki.debian.org/MeetBot.
07:59:27 <collabot`> Useful Commands: #action #agreed #help #info #idea #link #topic.
07:59:27 <collabot`> The meeting name has been set to 'functest_weekly_meeting_24_apr__2018'
07:59:36 <ollivier> #info Cédric Ollivier
08:00:15 <LindaWang> #info  Linda Wang
08:00:40 <juhak> #info Juha Kosonen
08:02:53 <ollivier> Let's start. We will see if Delia or Serena joins us. Morgan and Jose are not connected.
08:03:06 <ollivier> #topic Action point follow-up
08:03:25 <ollivier> #info all docs have been updated (juju_epc is still missing)
08:03:31 <ollivier> #link https://jira.opnfv.org/browse/FUNCTEST-951
08:03:38 <ollivier> #link https://jira.opnfv.org/browse/FUNCTEST-958
08:03:46 <ollivier> #link https://jira.opnfv.org/browse/FUNCTEST-959
08:04:03 <ollivier> I will update juju_epc as Rebaca haven't done it yet.
08:04:14 <ollivier> Thank you for all updates/reviews
08:04:15 <depo> #info Delia Popescu
08:04:22 <ollivier> Hi Delia
08:04:28 <depo> Hi
08:05:02 <ollivier> #action ollivier describe juju_epc in docs
08:05:16 <ollivier> #info Functest Gates have been quickly introduced in Weekly Technical meeting
08:05:27 <ollivier> #link http://testresults.opnfv.org/functest/gates/
08:06:15 <ollivier> I think we have reached the best levels regarding linters. OPNFV has to introduce Functional gating
08:06:58 <ollivier> We should be able to get our results much more quickly. Then we require hardware as installers and a reference platform.
08:07:19 <LindaWang> which tests will be chosen to do functional gating?
08:07:42 <ollivier> I would have said all.
08:08:20 <LindaWang> all tests for os-nosdn-nofeature, right?
08:08:30 <ollivier> It's fine top wait 4-5 hours if we ensure that the patch is safe. Yes.
08:09:16 <LindaWang> only after at least two committers give +2?
08:09:23 <ollivier> Yes
08:09:35 <ollivier> else we stil leverage on the classical jobs.
08:10:19 <ollivier> as soons as workflow is voted +1 (2nd core dev in OpenStack)
08:10:52 <ollivier> Even if we don't introduce the full process, we should be able to get our results much more quickly.
08:11:17 <LindaWang> workflow is  voted by PTL or other check?
08:11:18 <ollivier> From the time being, only compass provides good results in master branch.
08:11:36 <ollivier> No workflow is voted by the second core as the submit button
08:12:14 <ollivier> (even if compass is installing Pike instead of Gambia)
08:13:06 <ollivier> Then Tim Irnish will check how we could get hw (+Pharos and maybe other weekly technical meetings)
08:14:14 <ollivier> Regarding the reference platform, we need one installer which is verifed by Functest  (and Queens should be supported)
08:14:49 <ollivier> devstack, kolla-ansible?, xci (if not master and baremetal has to be supported), apex ...
08:16:40 <ollivier> open topic but we have to improve the current CI/CD model. We should break the circular dependencies between Installers and Functest
08:16:46 <LindaWang> Do we need to deploy openstack for each funtional gating?
08:17:30 <LindaWang> Do we need to redeploy openstack each time for functional gating?
08:17:37 <ollivier> Maybe not if we are able to clean all resources at the end as proposed for G
08:18:39 <ollivier> My point is at least to have a proper Functest daily job. Then I think Functional is the best model but it's a next step.
08:18:46 <LindaWang> ok
08:19:05 <ollivier> As we need to convince, I have to explain the golden rules.
08:19:25 <ollivier> But OpenStack have done that for years.
08:19:53 <ollivier> #topic Functest Fraser
08:20:03 <ollivier> #info vyos_vrouter cleans all its resources
08:20:09 <ollivier> #link https://github.com/oolorg/opnfv-vnf-vyos-blueprint/pull/2
08:20:26 <ollivier> #info juju_epc is now working on Apex
08:20:43 <ollivier> We had to open the firewall...
08:20:51 <ollivier> #info https://jira.opnfv.org/browse/INFRA-236
08:21:05 <ollivier> #info NoneType errors when creating router in snaps have been fixed (master) and bypassed (Functest)
08:21:37 <ollivier> We may revert my changes as soon as Linda's patch is cherry-picked in stable/fraser
08:21:53 <ollivier> #link https://gerrit.opnfv.org/gerrit/#/c/56171/
08:21:58 <ollivier> #link https://gerrit.opnfv.org/gerrit/#/c/56197/
08:22:04 <ollivier> #link https://gerrit.opnfv.org/gerrit/#/c/56191/
08:22:42 <ollivier> #info Milestone Compliance for Fraser has been sent by email to David
08:23:35 <ollivier> We may recreate the Docker manifests if really needed. But from the time being, I haven't seen no bugfixes.
08:25:24 <ollivier> git tag is unlinked to Docker tag simply because of third-parties (snaps breaks the first opnfv-6.0.0 containers)
08:26:09 <ollivier> Anything about Fraser?
08:26:11 <LindaWang> This patch about updating tempest version(17.1.0) is still under review: https://review.openstack.org/#/c/563394/
08:26:12 <ollivier> Agree?
08:27:12 <ollivier> If it's merged on time, I will recreate the manifests. Else it will be part of 6.1.0
08:27:32 <LindaWang> Sur
08:27:34 <LindaWang> Sure
08:28:34 <ollivier> It will be automatically taken into account in :fraser
08:29:02 <ollivier> #Functest Gambia
08:29:08 <ollivier> #topic Functest Gambia
08:29:34 <ollivier> #info Gnocchi is passing vs Compass
08:29:46 <ollivier> #link http://artifacts.opnfv.org/logs/functest/huawei-pod1/2018-04-23_00-57-25/rally/opnfv-gnocchi.html
08:30:22 <ollivier> A proposal is under review https://gerrit.opnfv.org/gerrit/#/c/56323/
08:31:22 <ollivier> juhak: be free to comment if needed
08:32:35 <ollivier> That's great to see more patches in upstream projects than in Functest (requirements, rally and refstack, etc)
08:32:42 <ollivier> Thank you
08:32:56 <ollivier> #info refstack-client is being updated to OpenStack Queens
08:33:13 <ollivier> #link https://review.openstack.org/#/c/561777/4
08:33:37 <ollivier> then we will update refstack_defcore t 2018.02 as proposed by https://gerrit.opnfv.org/gerrit/55853
08:34:07 <ollivier> #info Notice of intent to participate in OPNFV Gambia has been sent to TSC
08:34:19 <ollivier> #undo
08:34:19 <collabot`> Removing item from minutes: <MeetBot.ircmeeting.items.Info object at 0x27a8110>
08:34:31 <ollivier> #info Notice of intent to participate in OPNFV Gambia has been sent to TSC:
08:34:33 <OPNFV-Gerrit-Bot> Merged functest: Add Rally GnocchiResource scenarios  https://gerrit.opnfv.org/gerrit/56323
08:34:48 <ollivier> current proposal is to follow the traditionnal track only
08:34:57 <ollivier> I think it's impossible to be stable in multiple branches without dedicated Functest gates
08:35:05 <ollivier> we need a full release cycle to be ready for tracking both
08:36:51 <ollivier> Be free to comment. I think we have to be careful to tracking both regarding the current solution and all xci docs currently only refer to Healthcheck (that should change but are we involved?)
08:37:54 <ollivier> Tempest would have been easier as it's used in OpenStack gates.
08:38:42 <LindaWang> But when we run tempest, some resources need to be created by Snaps
08:39:26 <ollivier> Yes. We would have to depend on OpenStack project (opensdk here)
08:39:31 <ollivier> openstacksdk
08:40:20 <LindaWang> But it would be difficult to create resources via openstacksdk i guess
08:41:33 <ollivier> If Functest has to follow master we must select frameworks which are selected by OpenStack Gates. Else snaps has to switch to master too.
08:41:47 <ollivier> I'm concerned by testcase exclusions even if technically speaking it's possible.
08:42:35 <ollivier> Please let me know if you (or your company) require Functest master asap.
08:43:12 <ollivier> What are the models selected by Compass, Daisy, Fuel (arm64, amd64)?
08:44:24 <ollivier> From the time being, we require hardware and gates. Else it would simply multiply our work for Healthcheck.
08:44:28 <ollivier> Agree?
08:44:43 <LindaWang> Yes
08:44:47 <juhak> agree
08:45:37 <ollivier> great. Sorry to have sent a first answer before that meeting but we are always behind milestones.
08:45:39 <LindaWang> Compass only chooses Queens
08:46:07 <ollivier> noted
08:46:25 <ollivier> #topic AoB
08:46:32 <ollivier> #info opnstacksdk offers functional tests but they seem linked to devstack and bigger than healthcheck
08:46:46 <ollivier> I just ran them for fun
08:49:25 <ollivier> About https://gerrit.opnfv.org/gerrit/56183, I may ask Steven the best API :)
08:50:08 <ollivier> It's not a big deal.
08:50:20 <juhak> yes, that's true
08:50:49 <ollivier> #info next meeting is canceled
08:51:48 <ollivier> the next one is public holiday in France too. I think I will take longer holidays.
08:52:07 <LindaWang> Got it. Enjoy your vacation
08:52:22 <juhak> have a great holiday
08:52:30 <LindaWang> Only 3-days holidays for Chinese
08:52:32 <LindaWang> :(
08:52:50 <ollivier> To conclude we have published our release Fraser. I think we have done a very good job all along the release! Great new Features
08:53:32 <ollivier> Thank you all!
08:54:15 <ollivier> I have to spend my holidays (I haven't take so many days and I'm french ;))
08:54:43 <juhak> :)
08:55:34 <ollivier> I think we can close the meeting in avance. Thank you all.
08:55:38 <ollivier> #endmeeting