08:00:48 <ollivier> #startmeeting Functest weekly meeting 18 Sept. 2018
08:00:48 <collabot> Meeting started Tue Sep 18 08:00:48 2018 UTC.  The chair is ollivier. Information about MeetBot at http://wiki.debian.org/MeetBot.
08:00:48 <collabot> Useful Commands: #action #agreed #help #info #idea #link #topic.
08:00:48 <collabot> The meeting name has been set to 'functest_weekly_meeting_18_sept__2018'
08:01:01 <ollivier> hi
08:01:07 <ollivier> #info Cédric Ollivier
08:01:19 <juhak> #info Juha Kosonen
08:01:29 <viktor_t> #info Viktor Tikkanen
08:02:29 <ollivier> fdegir: great. I didn't check if you switched to the right repo (opnfv)
08:03:41 <ollivier> #topic Action point follow-up
08:03:56 <ollivier> #info Functest (OpenStack and Kubernetes) Gambia and Hunter were released last Monday
08:04:04 <ollivier> #link https://lists.opnfv.org/g/opnfv-tech-discuss/topic/functest_gambia_and_hunter/25721234?p=,,,20,0,0,0::recentpostdate%2Fsticky,,,20,2,0,25721234
08:04:42 <ollivier> It should be noted that new testcases can be cherry-picked from master to stable/gambia or stable/hunter (e.g. add support for Rally OpenStack CI test cases)
08:05:42 <ollivier> and that features are disabled in stable/gambia and stable/hunter (they are synced with OpenStack Queens)
08:06:02 <ollivier> Functest Gambia will be continuously built to integrate changes required by Features.
08:06:38 <ollivier> #info XCI already selects the right tag
08:06:46 <ollivier> #link https://gerrit.opnfv.org/gerrit/#/c/62421/
08:07:20 <ollivier> Fuel, Compass, Daisy (?) and Apex jjbs should be updated.
08:08:08 <ollivier> (It should work anyway thanks to backward compatibility enforced by OS or K8s clients)
08:09:05 <ollivier> From the time being, snaps testcases are run only if SUT is OpenStack Queens or older.
08:09:29 <ollivier> (I think Snaps has to be updated due to new cinder microapis)
08:11:21 <ollivier> Be free to ask more details if unclear.
08:12:21 <OPNFV-Gerrit-Bot> Juha Kosonen proposed functest: Add support for Rally OpenStack CI test cases  https://gerrit.opnfv.org/gerrit/61895
08:13:47 <ollivier> #info all docs have been published online
08:13:58 <ollivier> #link https://functest.readthedocs.io/projects/configguide/en/latest/
08:14:08 <ollivier> #link https://functest.readthedocs.io/projects/devguide/en/latest/
08:14:23 <ollivier> #link https://functest.readthedocs.io/projects/userguide/en/latest/
08:14:37 <ollivier> ..etc..
08:15:22 <ollivier> We have to remove few former refs in our docs https://gerrit.opnfv.org/gerrit/#/c/62347/
08:15:38 <ollivier> #info projects/users are now cleant when tempest-based testcases are skipped
08:15:46 <ollivier> #link https://gerrit.opnfv.org/gerrit/#/c/62017/
08:15:53 <ollivier> #info all patches have been prepared to verify VIO
08:16:00 <ollivier> #link https://gerrit.opnfv.org/gerrit/#/c/62125/
08:16:38 <ollivier> #topic Functest
08:17:02 <ollivier> #info juju is being released (2.3.9) and should include a key fix about subnet discovery (required by parallel testing)
08:18:04 <ollivier> It should be cherry-picked to stable/fraser even if it only works right after deployment in sequential mode (OPNFV)
08:18:54 <ollivier> #info few tempest (full) subtests are failing
08:19:05 <ollivier> First CI runs:
08:19:12 <ollivier> #link https://build.opnfv.org/ci/view/functest/job/functest-fuel-virtual-daily-master/865/console
08:19:19 <ollivier> #link https://build.opnfv.org/ci/view/functest/job/functest-compass-virtual-daily-master/870/console
08:19:21 <viktor_t> I've checked those but have no clue...
08:19:50 <viktor_t> "Unexpected response code received" (503) from cinder in most cases
08:20:15 <ollivier> It's not so simple. In case of Fuel, it seems that snapshots are unsupported or badly configured.
08:20:53 <ollivier> I think we should skip few tests such as the one about novnc (we may consider that spice is deployed).
08:21:43 <ollivier> It's much more difficult in our case (OS forces only one config in gates)
08:22:31 <ollivier> I will share with you right after the results in Orange Openlab.
08:23:07 <viktor_t> OK
08:23:52 <ollivier> I think we badly have to detect the common failures and see how to progress from there.
08:25:33 <ollivier> That's the ony testcase which has to be enhanced.
08:25:46 <ollivier> Thank you viktor_t for your help about that.
08:26:24 <ollivier> Let's see if we get some results from Apex as well.
08:26:33 <ollivier> #topic 2 new testcases are under development:
08:26:45 <ollivier> #info Add support for Rally OpenStack CI test cases
08:26:54 <ollivier> #link https://gerrit.opnfv.org/gerrit/#/c/61895/
08:27:40 <ollivier> juhak: I saw your last update. Should I run the last update? The code seems already good.
08:28:11 <ollivier> If you agree, I can update your change to modify the jjbs as well.
08:28:28 <juhak> it would be good if you time
08:29:02 <juhak> I'm currently running tests, so far so good
08:29:09 <ollivier> sure. Thank you.
08:29:17 <ollivier> Great.
08:29:46 <ollivier> The first change already works here if I skipped the NeutronTrunk results.
08:30:53 <juhak> latest version skips NeutronTrunk if extension is not available
08:31:35 <ollivier> perfect. Then I will modify the jjbs and directly run your change. Is it still disabled in testcases.yaml?
08:31:50 <juhak> yes
08:32:57 <ollivier> Ok. I will update that part when adding the jjbs changes. Thank you. I think we are on time to add this testcase to stable/gambia.
08:33:16 <juhak> ok, thanks
08:33:26 <ollivier> Thank you!
08:33:32 <ollivier> #topic Run Intel NFV CI test-cases inside functest smoke (https://gerrit.opnfv.org/gerrit/#/c/61151/)
08:33:35 <ollivier> #undo
08:33:35 <collabot> Removing item from minutes: <MeetBot.ircmeeting.items.Topic object at 0x1c7a450>
08:33:44 <ollivier> #info Run Intel NFV CI test-cases inside functest smoke
08:33:52 <ollivier> #link https://gerrit.opnfv.org/gerrit/#/c/61151/
08:34:45 <ollivier> I have to check the last update. I think it has to be improved (we may detect if NUMA is supported)
08:35:01 <ollivier> Else it's already a good job (docs are updated as well)
08:36:04 <ollivier> #info userguide has to be updated (few new testcases have to described: shaker, vmtp, etc...)
08:36:12 <ollivier> #link https://functest.readthedocs.io/projects/userguide/en/latest/
08:37:02 <ollivier> #info we still do improve our download.sh (fdegir)
08:37:32 <ollivier> Anything else on OpenStack side?
08:38:01 <viktor_t> nope
08:38:18 <ollivier> #topic Functest-kubernetes
08:38:31 <ollivier> #info 1 fix has been published in stor4vnf
08:38:39 <ollivier> #link https://gerrit.opnfv.org/gerrit/#/c/62381/
08:39:41 <ollivier> #info we are checking if Functest master can poll K8s master
08:39:48 <ollivier> #link https://build.opnfv.org/ci/view/OPNFV%20XCI/job/xci-functest-virtual-opensuse-daily-master/47/console
08:41:04 <ollivier> Nothing else from K8s side. We simply faced with lots of issues when building containers. It's fine now as Cristina kindly stopped arm-build5.
08:41:30 <ollivier> We still faced with lots network connectivity troubles for amd64.
08:41:47 <ollivier> nothing new :(
08:42:05 <ollivier> #topic AoB
08:42:37 <ollivier> #info Dovetail is asking TSC if Keystone v2 has to be supported.
08:43:14 <ollivier> From my understanding, it has been removed right after Danube in Functest and it's more than obsolete regarding OS guidelines.
08:44:28 <ollivier> Even if I I consider it as quite dubious from a certification program, I think Dovetail can simply add a Keystone v2/v3 if it's mandatory.
08:44:57 <ollivier> As it's done in ONAP to support Queens.
08:46:01 <viktor_t> https://docs.openstack.org/keystone/rocky/contributor/http-api.html
08:48:42 <ollivier> Yes. I think we shouldn't hack Functest to diverge from OS guidelines. Dovetail could already have prepared the deprecation in their Danube-based releases (If I'm not wrong it was already deprecated).
08:49:08 <ollivier> Only E// is not supporting v2 if I'm not wrong (last TSC meeting)
08:49:11 <ollivier> v3
08:49:22 <ollivier> Agree?
08:50:03 <ollivier> Dovetail may  add a Keystone v2/v3 "proxy" if it's mandatory.
08:50:24 <ollivier> (as for the tempest hook to bypass nova microversions)
08:51:13 <ollivier> Anything else for Today's meeting?
08:51:38 <viktor_t> not from my side...
08:51:56 <juhak> all good
08:52:24 <ollivier> Thank you. Great week again.
08:52:28 <ollivier> #endmeeting