08:02:45 <ollivier> #startmeeting Functest weekly meeting 22 Jan. 2019
08:02:45 <collabot`> Meeting started Tue Jan 22 08:02:45 2019 UTC.  The chair is ollivier. Information about MeetBot at http://wiki.debian.org/MeetBot.
08:02:45 <collabot`> Useful Commands: #action #agreed #help #info #idea #link #topic.
08:02:45 <collabot`> The meeting name has been set to 'functest_weekly_meeting_22_jan__2019'
08:02:53 <ollivier> #info Cédric Ollivier
08:03:03 <juhak> #info Juha Kosonen
08:03:06 <ollivier> First meeting of the year. Happy New Year!
08:03:09 <viktor_t> #info Viktor Tikkanen
08:03:22 <juhak> Happy New Year
08:03:56 <ollivier> #topic OPNFV Hackfest
08:04:20 <ollivier> #info Functest related presentations were very well appreciated
08:04:30 <ollivier> #link http://testresults.opnfv.org/functest/gambia/
08:04:42 <ollivier> #link http://testresults.opnfv.org/functest/functest2019/
08:05:10 <juhak> job well done!
08:05:18 <ollivier> I will replay the Xtesting demo (how to deploy your own robot in a full CI/CD toolchain)
08:05:48 <ollivier> next Test Working group meeting. I can setup a specific meeting if needed
08:07:02 <ollivier> I think we are all aware about all the new updates done in 2018 ;). I add topics to discuss here about the possible next activities.
08:07:55 <ollivier> #info VSperf and Yardstick teams are interested in benefits brought by Xtesting
08:08:04 <ollivier> #info easily deploying the full CI/CD toolchain via Xtesting should meet the current OPNFV strategy
08:08:14 <ollivier> #info Xtesting Ansible role may be reused by ONAP devs to setup external bots (external functional gates)
08:08:23 <ollivier> #info we will plan a meeting with Akraino to check if Xtesting and Functest can help the project
08:09:05 <juhak> +1, that's great
08:09:44 <ollivier> Yes!
08:11:39 <ollivier> Any question? Be free to reply to my email sent yesterday if you need more details.
08:12:16 <ollivier> #topic Gates
08:12:26 <ollivier> #info all Jenkins jobs hosted in Releng have been generated by collivier.xtesting
08:13:30 <ollivier> Releng is now a classical Functest user. The few changes required by Releng (rolling release, gsutils) are managed by the Ansible role.
08:14:05 <ollivier> #info functest-virtual hosts an OS (Rocky) all-in-one which hosts a Kubernetes (v1.11) cluster:
08:14:38 <ollivier> cinder is ko after a full week (I fully reinstalled it yeasterday)
08:14:47 <ollivier> floating ips are active after a too long duration (few tempest tests have been backlisting)
08:14:56 <ollivier> it's unclear if we can’t find a K8s version for verifying all Functest containers from 1.11 to master
08:15:10 <Sunshine546> #info Cristina Pauna
08:15:24 <ollivier> Hello Cristina
08:15:51 <CristinaPauna> hi
08:16:03 <CristinaPauna> sorry for being late
08:16:33 <ollivier> I think I will update K8s to last stable release (1.13.6) in functest-virtual and use functest bot to verify k8s stable/gambia.
08:17:36 <ollivier> No pb. We just finished the OPNFV Hackfest summary. Be free to ask any detail later.
08:18:03 <ollivier> #info no progress on Apex installation to POD5
08:18:11 <ollivier> #link https://jira.opnfv.org/browse/INFRA-324
08:18:54 <juhak> unfortunately that's the case at the moment
08:18:57 <ollivier> juhak: Any change? I will push that topic. Else we do consider another solution.
08:19:01 <ollivier> ok
08:19:28 <ollivier> The issue is about Infra now, isn't it?
08:19:28 <juhak> would require changes on lab infra side
08:19:35 <ollivier> :) ok
08:19:51 <ollivier> I will ping Trevor and Aric this evening.
08:19:58 <juhak> ok, thanks
08:20:42 <ollivier> thank you for the work. At least the jjbs are place! We do require an full OS on baremetal and a second K8s POD.
08:20:57 <ollivier> #link are in
08:21:07 <ollivier> #undo
08:21:07 <collabot`> Removing item from minutes: <MeetBot.ircmeeting.items.Link object at 0x1bd6090>
08:21:11 <ollivier> #link https://build.opnfv.org/ci/view/xtesting/
08:21:31 <ollivier> #info functest and functest-kubernetes jjbs seem fine but jobs have mostly voted -1 due to SUT :
08:21:40 <ollivier> #link https://build.opnfv.org/ci/view/functest/
08:21:49 <ollivier> #link https://build.opnfv.org/ci/view/functest-kubernetes/
08:22:28 <ollivier> I do fix kolla ansible deployment (floating ip and cinder)..
08:23:05 <ollivier> viktor_t: juhak: If you want to add an external bot running on your lab, I can give you the quick procedure.
08:23:29 <viktor_t> OK, let's see...
08:25:38 <ollivier> #topic Openstack
08:25:47 <ollivier> #info (Heat) IMS is not always verified by SIP calls (the test is considered as passed if only one SIP test is ok)
08:26:11 <ollivier> I will check it after finishing the gates.
08:26:38 <ollivier> #info all possible activities are quickly listed in http://testresults.opnfv.org/functest/functest2019/
08:27:10 <ollivier> I would like to publish Functest python and GNU/Linux distribution packages, to clean all resources...
08:27:41 <ollivier> I am nnot clear about all logics in Rally. It may break parallel testing.
08:28:29 <juhak> about xrally-kubernetes:
08:28:37 <juhak> I already played a little bit with xrally-kubernetes few months back,
08:28:45 <juhak> https://bugs.launchpad.net/rally/+bug/1798375
08:29:27 <juhak> count me in for tasks related to xrally-kubernetes
08:29:29 <ollivier> Great! Do you think it could be included as new K8S test?
08:29:35 <ollivier> great! Thank you!
08:29:59 <juhak> I have no experience on sonobuoy/e2e-tests yet,
08:30:18 <ollivier> I am also considering rally in Xtesting if it's only about performance framework and unrelated to Infra testing (OS or K8S). Does it make sens'?
08:30:59 <ollivier> I just play with it few minutes. It's a wrapper on top of e2e tests. Not a big deal but it seems the official way.
08:31:24 <juhak> ok
08:32:08 <ollivier> juhak: what's the diff between rally and xrally? Is it the funture repo/name?
08:32:44 <juhak> not quite sure... need to clarify
08:33:32 <ollivier> ok. If Rally works for anything, we may consider it in Xtesting. Tempest is OS centric.
08:33:52 <ollivier> #topic possible activities about K8s testing
08:34:07 <ollivier> #action juhak integrate xrally-kubernetes
08:34:21 <ollivier> #info leverage on sonobuo
08:34:27 <ollivier> #undo
08:34:27 <collabot`> Removing item from minutes: <MeetBot.ircmeeting.items.Info object at 0x212c650>
08:34:32 <ollivier> #info leverage on sonobuoy
08:34:40 <ollivier> #link https://github.com/heptio/sonobuoy
08:34:50 <ollivier> #info add vnfs such as Clearwater
08:34:59 <ollivier> #link add vnfs such as Clearwater
08:35:10 <ollivier> #undo
08:35:10 <collabot`> Removing item from minutes: <MeetBot.ircmeeting.items.Link object at 0x1e81550>
08:35:19 <ollivier> #link https://github.com/Intel-Corp/clearwater-kubernertes
08:36:07 <ollivier> Valentin may be interested. Rebaca team proposed their helps about that as well.
08:36:26 <ollivier> #info allow e2e paralleling testing
08:37:05 <ollivier> It's not a big deal but we may split conformance testcase in two parts as for tempest full and scenario.
08:37:32 <ollivier> #info add e2e tests such as performance
08:37:57 <ollivier> It's more or less about regexes if it makes sens' to integrate these tests.
08:38:00 <juhak> ollivier: rally is the framework, rally-openstack includes openstack specific stuff, xrally-kubernetes kubernetes stuff
08:39:52 <ollivier> juhak: Agree. I don't know it ask for third-party plugins or if we can write easily samples.
08:40:05 <ollivier> directly on top of the engine.
08:41:03 <ollivier> If true, we could integrate in Xtesting as it's a powerful framework which could help for any benchmark tests even out of the infra domain.
08:41:58 <juhak> yes, that sounds good
08:42:43 <ollivier> let's check that.
08:43:55 <ollivier> Here are my proposals. Of course you're free to add any proposal on one of our 3 projects.
08:44:30 <ollivier> #topic AoB
08:45:34 <ollivier> I spent few days last weeks to integrate network access testing in a OPNFV-based CI/CD toolchain deployed via Xtesting.
08:46:08 <CristinaPauna> I just wanted to mention that I changed fuel master to run functest hunter as we discussed 2 weeks ago
08:46:24 <ollivier> The testcases were quickly integrated (python) and they run well. I will check other scenarios out of infra.
08:46:52 <ollivier> Yes. Thank you Cristina. I saw it yesterday. And we may check why Heat is failing on your POD
08:47:46 <ollivier> And we have to conclude about snaps. We are quite forced to remove the testcases if snaps is not updated.
08:48:11 <CristinaPauna> did Steven reply?
08:49:01 <ollivier> We already discussed quite a while when Apex started deoploying Rocky and master. I have to send a last email.
08:49:48 <CristinaPauna> do you know what needs to be changed for it to work?
08:51:14 <ollivier> The current condition is fine but I do check the update required in snaps to support Cinder micro versons. It should be noted that snaps requirements are already obsolete and steve refused the update due to magnum.
08:51:32 <ollivier> Cinder part has to be updated.
08:51:54 <ollivier> Technically speaking, the magnum part has to be updated to conform with OS.
08:52:31 <ollivier> even if it's out of OPNFV it blocks everything
08:53:34 <ollivier> Let's see. The current logic can't break any milestone.
08:53:42 <CristinaPauna> then I guess we don't have much choice
08:54:27 <CristinaPauna> did u sent any message to the TSC regarding this change? I haven't seen any but maybe I missed it
08:54:34 <ollivier> Yes. If it was another framework, we would have removed it...
08:54:56 <ollivier> No. I was very busy... I consider as less important that the new process we are building
08:55:04 <ollivier> ;)
08:55:31 <CristinaPauna> ok, maybe we can talk about it in the TSC meeting today
08:55:38 <CristinaPauna> do you have time to attend?
08:56:50 <ollivier> I can explain the issue but It's up to Functest to decide here. TSC could only decide to update snaps as a stzetegic project...
08:57:51 <CristinaPauna> It's good that we will discuss on that. I will ask Bin to add it to the agenda
08:58:17 <CristinaPauna> thanks
08:58:19 <ollivier> I would say no.
08:58:35 <CristinaPauna> no to add it to the agenda?
08:59:03 <ollivier> We may first contact Steve and then check with TSC if the project is closed or if TSC suggest to  update snaps
08:59:35 <CristinaPauna> ok
09:00:15 <ollivier> thank you.
09:00:20 <ollivier> Any AoB?
09:00:24 <CristinaPauna> on your earlier comment about heat & fuel: https://gerrit.opnfv.org/gerrit/66555
09:00:58 <ollivier> great!
09:01:16 <CristinaPauna> no other AoB from me
09:02:12 <ollivier> ok. Have a good week!
09:02:16 <ollivier> #endmeeting