08:02:29 <ollivier> #startmeeting Functest weekly meeting 6 Mar. 2018
08:02:29 <collabot`> Meeting started Tue Mar  6 08:02:29 2018 UTC.  The chair is ollivier. Information about MeetBot at http://wiki.debian.org/MeetBot.
08:02:29 <collabot`> Useful Commands: #action #agreed #help #info #idea #link #topic.
08:02:29 <collabot`> The meeting name has been set to 'functest_weekly_meeting_6_mar__2018'
08:02:49 <depo> #info Delia Popescu
08:03:27 <LindaWang> #info Linda Wang
08:03:47 <juhak> #info Juha Kosonen
08:04:23 <serena-zte> #info SerenaFeng
08:04:30 <ollivier> #info Cédric Ollivier
08:04:42 <ollivier> #topic Action point follow-up
08:05:11 <ollivier> #info David agreed that the former Jenkins jobs can be removed
08:05:37 <viktor_t> #info Viktor Tikkanen
08:05:42 <ollivier> The former gerrit change https://gerrit.opnfv.org/gerrit/#/c/51853/ can be merged again
08:05:58 <depo> great
08:06:24 <depo> Aric said that we should first delete the jobs, then remerge
08:06:31 <ollivier> depo: could you please take the actions on that again?
08:06:36 <depo> it wil fail if not, anyway
08:06:40 <depo> yes
08:06:46 <ollivier> Yes. Aric could do that this week (it was busy last Friday
08:06:56 <ollivier> ..he was busy..
08:07:03 <depo> I will contct him
08:07:12 <ollivier> thank you.
08:07:40 <ollivier> #info all opnfv docker repos were created last week (functest-kubernetes, functest-patrole ...)
08:08:11 <ollivier> opnfv/xtesting would have been a Docker automated build instead but it will be fixed later.
08:09:05 <LindaWang> will functest-core container be removed soon?
08:09:06 <LindaWang> Then other container could be built on top of functest/xtesting?
08:09:17 <ollivier> We are still waiting for https://gerrit.opnfv.org/gerrit/#/c/53001/ .
08:09:43 <ollivier> we should keep functest-core for all OpenStack testcases built on top of xtesting
08:10:07 <ollivier> functest-core also contains utils and core/vnf for third-parties
08:10:19 <LindaWang> you mean functest-core could be built on top of functest/xtesting?
08:10:56 <ollivier> on top of Alpine (xtesting installed as a python package) or on top of xtesting. Both are fine
08:11:09 <ollivier> From the time being, opnfv/xtesting is not built for arm
08:11:39 <ollivier> Then we should keep the current model (xtesting is installed by dependencies)
08:12:12 <ollivier> https://git.opnfv.org/functest/tree/requirements.txt#n29
08:13:01 <ollivier> I think the current model is better because it avoids race conditions between docker image builds.
08:13:25 <ollivier> But opnfV/xtesting should be built for arm too.
08:13:52 <ollivier> #topiv Xtesting
08:13:59 <ollivier> #topic Xtesting
08:14:24 <ollivier> I just set the right topic :)
08:15:03 <ollivier> #info the python package xtesting has been published
08:15:23 <ollivier> #link http://xtesting.readthedocs.io/en/latest/apidoc/xtesting.html
08:15:33 <ollivier> #info Functest, Functest Kubernetes and OPNFV features integrated in Functest were updated
08:16:05 <ollivier> #info new OPNAP testing docker images have been built on top of xtesting
08:16:15 <ollivier> #link new OPNAP testing docker images have been built on top of xtesting
08:16:23 <ollivier> #undo
08:16:23 <collabot`> Removing item from minutes: <MeetBot.ircmeeting.items.Link object at 0x1d2cd50>
08:16:33 <ollivier> #link https://hub.docker.com/r/colvert22/functest-onap/~/dockerfile/
08:17:08 <ollivier> This docker inherits from the official Docker image.
08:18:10 <ollivier> I will send an email to opnfv-tech-discuss about xtesting. It will detail how to install it via pip or how to run the container.
08:18:36 <ollivier> By default, samples are run.
08:22:02 <ollivier> Please let me know if you want much details. I think all adaptations have been done.
08:22:32 <LindaWang> since onap is built based on functest/xtesting
08:23:04 <LindaWang> i think it is better if other functest containers are built on functest/xtesting
08:23:33 <LindaWang> even though installing xtesting packages also works
08:24:13 <ollivier> We could switch only if we prepare a new multijob for xtesting.
08:25:19 <ollivier> but I'm quite afraid of race conditions and managing upper-constraints allows a kind of delay between xtesting and functest.
08:25:29 <LindaWang> now functest/xtesting would be built once new patch is merged. NO?
08:25:37 <ollivier> see snaps and functest
08:26:10 <LindaWang> yes, that is true.
08:26:16 <ollivier> Yes. But to go as fast as possible, I list xtesting in the classical Docker job instead of creating a new multijob.
08:26:54 <ollivier> I think the current model is fine for this release. xtesting should support ARM too even if this image is unused by Functest.
08:27:48 <ollivier> functest-kubernetes directly inherits from Alpine.
08:27:52 <ollivier> https://git.opnfv.org/functest-kubernetes/tree/docker/Dockerfile
08:30:04 <ollivier> I think it's clean and we can select the right xtesting version by upper-constraints.
08:31:03 <ollivier> #topic functest
08:31:22 <LindaWang> i will do that, add a new upper-contraints file
08:31:58 <ollivier> https://git.opnfv.org/functest/tree/upper-constraints.txt
08:32:35 <ollivier> https://git.opnfv.org/functest-kubernetes/tree/docker/Dockerfile#n18
08:32:56 <ollivier> At the end it should be centralized in the requirement project.
08:33:23 <LindaWang> oh, this upper-contraints  is from functest
08:34:10 <ollivier> Yes. as the previous release everything is hosted in functest from the time beign
08:34:29 <ollivier> #info A new wiki page gathers all results
08:34:39 <ollivier> #link https://wiki.opnfv.org/display/functest/Fraser+Release+Gating+via+Functest
08:36:16 <ollivier> It has already been shared with David and Gabriel. The pupose is to convince that Functest is working and avoids what happens in the previous release (all installers decided what scenarios were working)
08:36:38 <ollivier> It should be broadcast to Dovetail for their next releases.
08:37:31 <LindaWang> yes, i will tell Dovetail team.
08:37:49 <ollivier> #info we have already fixed 3 bugs
08:38:01 <ollivier> #link https://jira.opnfv.org/browse/FUNCTEST-945
08:38:09 <ollivier> #link https://jira.opnfv.org/browse/FUNCTEST-946
08:38:19 <ollivier> #link https://jira.opnfv.org/browse/FUNCTEST-947
08:38:40 <ollivier> But we have to wait the next ci runs to update the pretty tables. Thank you for all fixes.
08:39:10 <ollivier> I consider that all testcases are good enough for gating
08:39:42 <ollivier> Pelase let me know if you are considering any exception
08:40:47 <ollivier> JOID is defining non default Keystone v3 domains which may require additional updates in vnf but it should be ok
08:41:01 <ollivier> there is a possible mismatch between cloud configurations and testcase preferences in vnfs
08:41:51 <LindaWang> should we also list the successful testcases?
08:42:05 <ollivier> #link https://gerrit.opnfv.org/gerrit/#/c/53073/
08:42:13 <ollivier> Yes it's possible.
08:42:39 <ollivier> If everybody agrees, I can easily update the tables.
08:43:14 <LindaWang> it was caused by the two patches:
08:43:27 <LindaWang> #link https://gerrit.opnfv.org/gerrit/#/c/51845/
08:43:30 <LindaWang> #link https://gerrit.opnfv.org/gerrit/#/c/51933/
08:44:12 <LindaWang> listing all the testcases would be better in the release gating, and i could help maintain this page.
08:44:30 <ollivier> Ok I will update all the tables after the meeting
08:44:44 <LindaWang> i do not understand why the DNS configuration was removed in Snaps.
08:45:07 <ollivier> Regarding 8.8.8.8, we shouldn't consider it as an issue. The issue is more or less to force 8.8.8.8 as DNS which is a Cloud preference
08:45:58 <ollivier> We can bypass installer limitations but Functest could be reused in DC where a local DNS is used.
08:46:32 <ollivier> Setting 8.8.8.8 would break any deployment when public identity endpoint are a local name instead of an IP
08:48:15 <ollivier> Both patches about snaps were fine. I will double check the default OpenStack behavior if dns is unset.
08:49:19 <ollivier> We can bypass that for the release if it requires too much Installer updates
08:50:04 <ollivier> #info the testcase about Patrole was merged:
08:50:15 <ollivier> #info the multijob update is still under review
08:50:24 <ollivier> #link https://gerrit.opnfv.org/gerrit/#/c/53001/
08:50:38 <ollivier> #info the testing part update is proposed too but we must first check all the results
08:50:53 <ollivier> #link https://gerrit.opnfv.org/gerrit/#/c/53045/
08:51:27 <LindaWang> have you run it locally?
08:51:32 <ollivier> Yes.
08:51:45 <LindaWang> I did not notice we should also download policy.json
08:52:09 <ollivier> The results are bad if no policy.json are provided (it seems that Patrole doesn't skip correctly lots of tests)
08:52:24 <ollivier> We could have run it without policy.json.
08:53:20 <ollivier> REgardign the current results we must set the lowest criteria if we merge https://gerrit.opnfv.org/gerrit/#/c/53045/
08:53:44 <LindaWang> but in fact it only makes sense with policy.json , right?
08:53:45 <ollivier> It seems not so bad if we add all policy.json but it requires an update of this patch.
08:53:48 <ollivier> yes
08:54:21 <LindaWang> we have to use opnfv module from releng to fetch the policy.json from controllers?
08:54:53 <ollivier> that's a proposal. Or we download the official ones from repositories when building the containers.
08:55:10 <ollivier> but I think they are being removed from tree (by design)
08:55:45 <LindaWang> i am wondering the policy.json is not different from different installers.
08:56:22 <ollivier> That's the question. But we could easily override the policy.json by docker args.
08:56:24 <LindaWang> at least they are quite strict on some product deployments.
08:56:52 <ollivier> From products deployment or legals, they have to be overriden but it's already possible
08:57:16 <ollivier> We are working on that with Remi. At least Patrole is already well integrated
08:57:46 <ollivier> sorry we are late again. Few works about functest-kubernetes
08:57:54 <ollivier> #topic functest-kubernetes
08:58:04 <ollivier> #info two testcases are now available in our containers
08:58:15 <ollivier> #info the first unit tests was merged
08:58:23 <ollivier> #link https://gerrit.opnfv.org/gerrit/#/c/52337/
08:58:33 <ollivier> #link https://build.opnfv.org/ci/view/functest/job/functest-compass-virtual-daily-master/3174/console
08:58:42 <ollivier> logs must be published and testcases declared in TEST DB
08:58:58 <ollivier> A new wiki page could be written to explain how to run the new testcases
08:59:18 <ollivier> That's great
08:59:27 <ollivier> #info we are waiting for the first CI runs on JOID
08:59:28 <LindaWang> i will help create a new wiki
08:59:45 <LindaWang> but i failed to post the testcase to TEST DB
09:00:13 <LindaWang> i failed to declare the testcases to TEST DB
09:00:18 <ollivier> Thank you. I think it can follow the same model https://wiki.opnfv.org/pages/viewpage.action?pageId=13211751
09:00:37 <ollivier> I will try to create them. I need to declare patrole too.
09:00:55 <LindaWang> thanks
09:01:08 <ollivier> #topic AoB
09:01:40 <ollivier> I think we can already fix the version of our external dependencies (rally, odl tests). Do you agree?
09:01:59 <ollivier> Several of them should be fixed by commit id.
09:02:13 <LindaWang> which version of rally
09:02:25 <ollivier> (I forget refstack_client)
09:02:55 <ollivier> Do we switch to 0.10.1 ?
09:03:20 <LindaWang> stable 0.10 seems fine
09:03:46 <ollivier> A stable branch is good enough
09:04:43 <ollivier> For E we selected a tag (ARG RALLY_TAG=0.9.1)
09:04:53 <ollivier> juhak: what do you think?
09:05:30 <juhak> i think 0.10 is fine now
09:05:56 <ollivier> ok. Thank you
09:06:17 <ollivier> For the others external dependencies?
09:06:52 <ollivier> I would prefer fixing them right now
09:07:01 <ollivier> (refstack, odl, ...)
09:07:25 <ollivier> We will see later.
09:08:28 <ollivier> Thank you for the meeting. Great week again.
09:08:31 <ollivier> #endmeeting