08:00:44 <ollivier> #startmeeting Functest weekly meeting 20 Mar. 2018
08:00:44 <collabot`> Meeting started Tue Mar 20 08:00:44 2018 UTC.  The chair is ollivier. Information about MeetBot at http://wiki.debian.org/MeetBot.
08:00:44 <collabot`> Useful Commands: #action #agreed #help #info #idea #link #topic.
08:00:44 <collabot`> The meeting name has been set to 'functest_weekly_meeting_20_mar__2018'
08:00:52 <ollivier> #info Cédric Ollivier
08:01:01 <LindaWang> #info Linda Wang
08:01:13 <juhak> #info Juha Kosonen
08:01:26 <jose_lausuch> #info Jose Lausuch
08:01:43 <depo> #info Delia Popescu
08:03:11 <ollivier> #topic Action point follow-up
08:03:22 <ollivier> #info neutron-trunk was merged
08:03:54 <ollivier> I have seen it worked vs Apex but I have to check all the results.
08:04:15 <ollivier> compass?
08:04:29 <ollivier> still several subtests in failure?
08:04:41 <LindaWang> i have not checked that
08:05:21 <ollivier> #link http://artifacts.opnfv.org/logs/functest/lf-pod1/2018-03-19_20-37-21/neutron_trunk/tempest-report.html
08:05:40 <ollivier> ok. I think it's done.
08:05:42 <LindaWang> because no logs are pushed to artifacts  because of timeout on compass nosdn-nofeature
08:05:49 <ollivier> #link https://jira.opnfv.org/browse/FUNCTEST-950
08:06:01 <ollivier> #info Patrole testcase is finished and runs well (it were moved into smoke)
08:06:13 <ollivier> #link http://artifacts.opnfv.org/logs/functest/lf-pod2/2018-03-10_02-11-14/patrole/tempest-report.html
08:06:21 <ollivier> #link http://artifacts.opnfv.org/logs/functest/lf-pod1/2018-03-10_04-20-36/patrole/tempest-report.html
08:06:37 <ollivier> #info Functest job timeout was increased (temporarily solution due to Compass and Fuel Arm)
08:06:56 <ollivier> it seems a second patch is needed: https://gerrit.opnfv.org/gerrit/#/c/53877/
08:07:40 <ollivier> depo: I have seen any run for a while. Did a job raise timeout since the first patch was merged?
08:08:27 <ollivier> depo: last run was 10 days ago
08:08:49 <LindaWang> it still timeout on compass: https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-master/16/
08:09:17 <jose_lausuch> shall I  merge?
08:09:34 <ollivier> we could. But it should be considered as a bug.
08:09:56 <ollivier> If we compare duration between apex, daisy and arm, compass
08:11:01 <jose_lausuch> merged, we can go back to previous timeout when finding the reason
08:11:16 <ollivier> jose_lausuch: thank you
08:11:21 <jose_lausuch> np
08:11:39 <ollivier> #info a new wiki page has been written to explain how to run the new Kubernetes testcases
08:11:47 <ollivier> #link https://wiki.opnfv.org/pages/viewpage.action?pageId=20742412
08:12:12 <ollivier> #info opnfv/xtesting is now built for both architectures: amd64 and arm64
08:12:24 <ollivier> #info Functest leverages on Xtesting 0.31
08:12:36 <ollivier> #info lots of logs have been redirected to functest.log (tempest-based testcases, vnfs...)
08:12:43 <ollivier> Thank you al for that actions
08:14:08 <ollivier> Any question? Else I start to Functest topic.
08:14:24 <LindaWang> about the timeout, we do not know how long it takes before running functest testcases. The job takes more than 6 hours
08:15:22 <ollivier> The duration is much more shorter in our local POD and when testign Apex, Daisy...
08:16:00 <ollivier> It could be induced by bandwith but all testcases take more time.
08:16:10 <LindaWang> ok, i will ask Compass team to figure that out.
08:16:45 <ollivier> I could understand when testing different architectures.
08:17:14 <ollivier> Then out of vnf (download), all durations should be pretty equal.
08:17:54 <ollivier> less than 4 hours for Daisy.
08:18:13 <depo> ollivier: yes, we reached another timeout, after 360, my last timeout patch was not merged
08:18:36 <depo> ollivier: but we had functest run on POD6
08:18:42 <ollivier> depo: It's merged now.
08:18:55 <depo> ollivier: thank you
08:19:13 <ollivier> depo: > Jose
08:19:29 <ollivier> #topic Functest
08:19:57 <ollivier> #info vyos_vrouter's descriptor has been updated (the testcase works locally)
08:20:25 <ollivier> The testcase now supports Keystone v3 (non default domain names)
08:20:45 <ollivier> #link https://gerrit.opnfv.org/gerrit/#/c/54127/
08:21:05 <LindaWang> cloudify_ims live test failed, the results should not be PASS.
08:21:09 <ollivier> Could you please review https://gerrit.opnfv.org/gerrit/#/c/54131/ ?
08:21:22 <LindaWang> it seems as dns issue.
08:21:39 <ollivier> Let's see. There are 2 bugs in the testcase.
08:21:45 <OPNFV-Gerrit-Bot> Merged functest: Remove unused code in vyos_vrouter  https://gerrit.opnfv.org/gerrit/54131
08:21:53 <ollivier> thank you
08:22:28 <ollivier> Several runs may fail till the containers are being built.
08:22:31 <ollivier> #link https://build.opnfv.org/ci/job/functest-daisy-baremetal-daily-master/12/console
08:23:03 <ollivier> Simply because of conflicts between the third party repository and gerrit
08:23:15 <ollivier> Now it should work
08:24:28 <ollivier> About cloudify_ims, there are 2 bugs. The possible issue in DNS is not a big deal (a minor change has been applied to it).
08:25:11 <ollivier> But it seems that the testcase is passed even if tests fail. That's a bigger one which may have hidden log time issues. Let's see.
08:25:21 <LindaWang> any update about the blueprint?
08:25:23 <ollivier> (remember vping the last release)
08:25:47 <ollivier> I don't think so. I will check that right after the meeting if you could stay onlien.
08:25:59 <LindaWang> ollivier: thanks
08:26:20 <ollivier> #info Functest should fully support keystone v3 but last Joid runs were not so great.
08:26:32 <ollivier> #link https://build.opnfv.org/ci/view/functest/job/functest-joid-baremetal-daily-master/45/console
08:26:53 <ollivier> badly Narinder haven't install gsutil on his POD then we lost all debugs
08:27:23 <ollivier> But I think that our development for this release are done.
08:28:44 <ollivier> maybe an update for JOID https://jira.opnfv.org/browse/JOID-124 and a quick fix in cloudify_ims
08:29:10 <ollivier> Then thank you all. I think we could ask for the stable branch quite soon. Agree?
08:30:13 <ollivier> We may integrate a new Feature testcase but it's quite out of Functest https://gerrit.opnfv.org/gerrit/#/c/53957/
08:31:25 <ollivier> There is still one improvment when testing ims. https://gerrit.opnfv.org/gerrit/#/c/53715/ . But we will easily cherry-pick it if needed.
08:31:50 <ollivier> Agree?
08:32:02 <LindaWang> yes,  agree.
08:32:41 <ollivier> Great work.
08:32:47 <LindaWang> stor4nfv tests expects to be included in functest-kubernetes.
08:33:06 <ollivier> Then the functest change may be abandonned?
08:33:14 <LindaWang> yes
08:33:18 <ollivier> ok
08:34:13 <LindaWang> our document is to be updated too.
08:34:37 <ollivier> yes next topic
08:35:20 <ollivier> Could you please review https://gerrit.opnfv.org/gerrit/54137 ? It works locally
08:35:34 <ollivier> And this trivial one https://gerrit.opnfv.org/gerrit/54135
08:36:30 <ollivier> Then we do focus on our documentation to finish the release.
08:36:44 <ollivier> #info devguide or apidoc
08:36:55 <ollivier> #link https://jira.opnfv.org/browse/FUNCTEST-923
08:37:05 <ollivier> #link https://jira.opnfv.org/browse/FUNCTEST-938
08:37:22 <ollivier> I think testcases could be described in python modules as well.
08:38:10 <ollivier> #link http://functest.readthedocs.io/en/latest/apidoc/functest.opnfv_tests.sdn.odl.odl.html
08:38:13 <OPNFV-Gerrit-Bot> Merged functest: Fix apidoc builds  https://gerrit.opnfv.org/gerrit/54135
08:38:59 <OPNFV-Gerrit-Bot> Merged functest: Put TestResults.json in the right dir  https://gerrit.opnfv.org/gerrit/54137
08:39:10 <ollivier> Even if it's quite duplicated at the beginning it would be simpler to manage description in the right module instead of an external doc.
08:40:57 <ollivier> #info configguide
08:41:06 <ollivier> #link https://gerrit.opnfv.org/gerrit/#/c/54069/
08:41:16 <ollivier> patrole section in wiki could be moved to configguide too
08:41:29 <ollivier> #info userguide
08:41:39 <ollivier> #link https://gerrit.opnfv.org/gerrit/#/c/54107/
08:42:07 <ollivier> Be free to help updating docs. I think configguide is already quite updated.
08:43:01 <LindaWang> sure. i will help remove refstack-client part
08:43:05 <ollivier> The bigger part is about functest-kubernetes.
08:43:13 <ollivier> Thank you
08:43:22 <LindaWang> it is Konrad's todo list
08:43:31 <ollivier> #action all update the documentation
08:43:55 <ollivier> #topic functest-kubernetes
08:44:05 <ollivier> we do wait the next CI runs to get the logs at the ends
08:44:13 <LindaWang> #link https://build.opnfv.org/ci/view/functest/job/functest-compass-virtual-daily-master/69/console
08:44:14 <ollivier> #link https://gerrit.opnfv.org/gerrit/#/c/54085/
08:44:29 <LindaWang> logs have been uploaded now
08:44:50 <ollivier> Skipped: 651 ?
08:45:11 <LindaWang> actually only one test is included in k8s_smoke
08:45:26 <ollivier> ok
08:46:05 <ollivier> #info one patch vs Joid is being reviewed
08:46:15 <ollivier> #link https://gerrit.opnfv.org/gerrit/#/c/54093/
08:46:37 <LindaWang> do we need to remove KUBECONFIG in this patch?
08:46:43 <ollivier> #info we should still stop setting KUBECONFIG in env (mismatch between host and container envs).
08:47:14 <ollivier> I would propose to first etablish the process and then we can easily improve it
08:47:58 <ollivier> I would propose a second change as soon as we get our first 'PASS' results.
08:48:11 <ollivier> The change is quite trivial.
08:48:32 <ollivier> #link https://gerrit.opnfv.org/gerrit/#/c/53815/
08:49:17 <ollivier> I would prefer to first update K8s to 1.9.4
08:49:31 <ollivier> #link https://gerrit.opnfv.org/gerrit/#/c/54095/ (need to be updated)
08:49:39 <LindaWang> will update it soon
08:50:21 <ollivier> I think we should target the last release even if compass is behind. It's like Openstack (API)
08:50:37 <LindaWang> compass is v1.9.1
08:50:56 <ollivier> ok. Then no doubt about 1.9.4 :)
08:51:14 <ollivier> It should be a requirement from Release management as OpenStack.
08:52:17 <LindaWang> Done: https://gerrit.opnfv.org/gerrit/#/c/54095/
08:52:21 <LindaWang> will check that.
08:53:56 <ollivier> #topic AoB
08:54:07 <ollivier> I will be moving to LA in the next days.
08:54:51 <juhak> see you there
08:54:51 <LindaWang> Have a pleasant journey!
08:54:58 <ollivier> It's quite unclear now as I'm modifying my tickets.
08:55:26 <ollivier> I will prepare slides for G-release proposals. Then we could discuss Moday afternoon.
08:56:12 <jose_lausuch> have a nice trip!
08:56:13 <ollivier> Do we initiate a kubernetes session ? I think a breakout seems enough?
08:56:27 <ollivier> thank you.
08:56:57 <ollivier> jose_lausuch: depo: I will publish my slides on gerrit and we could have further discussions after my trip if needed.
08:56:58 <LindaWang> I hope you guys and Konrad would have a session. Still some issues to be solved
08:57:12 <jose_lausuch> ollivier: ok
08:57:13 <LindaWang> I will not go there, eitehr
08:57:30 <ollivier> ok. I thought you would be there.
08:57:51 <ollivier> Face 2 face meeting with Juha:)
08:57:51 <LindaWang> i thought so.
08:58:11 <juhak> cool
08:58:40 <ollivier> I think Serena would be there too.
08:59:03 <ollivier> Have you asked a plenary session for Konrad?
08:59:19 <LindaWang> i have asked Konrad to prepare a presentation.
08:59:32 <LindaWang> no
09:00:10 <ollivier> Ok. I think the best choice is to organize a meeting between us. I will open the breakout session to other OPNFV members as well.
09:00:24 <LindaWang> i hope you could have an informal meeting, where you could discuss
09:00:34 <LindaWang> yes, that is it.
09:00:49 <ollivier> Sure. on Monday afternoon if it's free.
09:01:00 <ollivier> and if he is there.
09:01:26 <ollivier> then we are on time. Thank you all this great week again. we are close to a new Great release.
09:01:41 <ollivier> gating is already good.
09:01:46 <ollivier> #endmeeting