08:00:21 <jose_lausuch> #startmeeting Functest weekly meeting April 5th 2016
08:00:21 <collabot`> Meeting started Tue Apr  5 08:00:21 2016 UTC.  The chair is jose_lausuch. Information about MeetBot at http://wiki.debian.org/MeetBot.
08:00:21 <collabot`> Useful Commands: #action #agreed #help #info #idea #link #topic.
08:00:21 <collabot`> The meeting name has been set to 'functest_weekly_meeting_april_5th_2016'
08:00:27 <jose_lausuch> #info Jose Lausuch
08:00:34 <juhak> #info Juha Kosonen
08:00:36 <viktor_nokia> #info Viktor Tikkanen
08:00:38 <lhinds> #info Luke Hinds
08:00:38 <ciprian-barbu> #info Ciprian Barbu (Enea)
08:00:42 <CG_Nokia> #info CG_Nokia
08:00:43 <JuhaHaapa> #info Juha Haapavirta
08:01:05 <jose_lausuch> viktor_nokia: now it should be right time! :)
08:01:16 <viktor_nokia> OK :)
08:01:49 <jose_lausuch> #link https://wiki.opnfv.org/display/functest/Functest+Meeting
08:02:10 <jose_lausuch> anyone else?
08:03:20 <jose_lausuch> #topic Action point follow-up (meeting on the 22th March)
08:03:37 <jose_lausuch> #link http://ircbot.wl.linuxfoundation.org/meetings/opnfv-testperf/2016/opnfv-testperf.2016-03-22-08.00.html
08:03:45 <jose_lausuch> #info viktor_nokia have a look at Tempest results on ocl/compass scenario
08:03:57 <lhinds> jose_lausuch, may I add sec test to the agenda (if time)
08:04:09 <jose_lausuch> that is the only action point from that meeting, the action points of the helsinki meetup are to be discussed later
08:04:15 <jose_lausuch> yes
08:04:25 <viktor_nokia> #info Viktor has contacted chenshuai
08:04:38 <jose_lausuch> lhinds: well, do you want to discuss it in depth?, I will mention it during the allocations
08:04:43 <viktor_nokia> #info compass+ocl is still not in troubleshooting due to floating ip issue
08:04:58 <jose_lausuch> viktor_nokia: ok, thannks, something to follow up?
08:05:14 <viktor_nokia> chenshuai will contact me if needed
08:05:20 <jose_lausuch> ok, thanks viktor_nokia
08:05:25 <jose_lausuch> #info morgan_orange submit the first proposals: done
08:05:30 <lhinds> jose_lausuch, just a couple of quick points, nothing that will take long
08:05:35 <jose_lausuch> ok
08:06:17 <jose_lausuch> #topic Outcome of the Functest meeting in Espoo
08:06:22 <jose_lausuch> some info I want to share with you
08:06:28 <jose_lausuch> #info minutes here: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-testperf/2016/opnfv-testperf.2016-03-30-06.02.html
08:06:34 <jose_lausuch> #info presentation from Morgan: http://opnfv.fr/opnfv_functest_release_C/#/
08:06:48 <jose_lausuch> #info some highlights:
08:07:39 <jose_lausuch> #info decision to split the tests in different Tiers with progressive execution (if one fails, don't execute next tier or group of tests)
08:07:50 <jose_lausuch> #info decision: implement a 'trust level' to not execute the long tests every time (save time).
08:08:08 <jose_lausuch> #info decission: split functest_utils.py into 2 different scripts, one for openstack functions only, and the other for the rest.
08:08:19 <jose_lausuch> #info automatic test reporting already in place: http://testresults.opnfv.org/reporting/index-status-apex.html
08:08:35 <jose_lausuch> #info decision: add new test cases like security group, flash test, ...
08:08:44 <jose_lausuch> #info decision: change the way we run tempest: remove static test list --> difficult to maintain. Have 2 separate suites: smoke-serial, and all-parallel.
08:08:51 <jose_lausuch> #info decision: have some basic and quick Rally scenarios before running the whole suite we already have.
08:08:58 <jose_lausuch> #info decision: move to Kibana Dashboard.
08:09:06 <jose_lausuch> am I missing anything?
08:09:22 <jose_lausuch> this is just for info, we will discuss now the tasks for everyone
08:11:54 <jose_lausuch> ok
08:11:58 <jose_lausuch> #topic Jira task allocation
08:12:03 <jose_lausuch> #info new EPICS created by Morgan.
08:12:07 <jose_lausuch> #link https://jira.opnfv.org/browse/FUNCTEST-178?jql=project%20%3D%20FUNCTEST%20AND%20issuetype%20%3D%20Epic%20AND%20status%20%3D%20Open
08:12:19 <jose_lausuch> these are epics now, covering all the areas for Colorado
08:12:31 <jose_lausuch> #info David_Orange1 - security group testing (https://jira.opnfv.org/browse/FUNCTEST-160)
08:12:36 <jose_lausuch> are you ok with this?
08:13:01 <David_Orange1> jose_lausuch: ok for me
08:13:14 <jose_lausuch> ok, thanks
08:13:34 <jose_lausuch> maybe, something to mention is to doublecheck what is in tempest regarding security as well
08:13:44 <jose_lausuch> David_Orange1 viktor_nokia can you sync on that?
08:13:47 <David_Orange1> ok, i add it as comment
08:13:52 <David_Orange1> sure
08:13:56 <jose_lausuch> David_Orange1: great, thanks
08:14:00 <jose_lausuch> #info jose_lausuch - Functest test management refactoring (https://jira.opnfv.org/browse/FUNCTEST-163)
08:14:15 <jose_lausuch> I have to work on that refactoring
08:14:28 <jose_lausuch> I hope to have it soon
08:14:40 <jose_lausuch> #info enikher (Nikolas) - Introduction of Flashtest (https://jira.opnfv.org/browse/FUNCTEST-166)
08:14:44 <jose_lausuch> enikher: ok?
08:15:32 <lhinds> quick question on this one, can I add a depended on?
08:15:58 <jose_lausuch> a depended on?
08:16:01 <jose_lausuch> what do you mean?
08:16:04 <enikher> yes
08:16:34 <enikher> I am fine with that
08:16:36 <lhinds> thanks, in fact second thoughts let me check some things over with you enikher
08:16:46 <lhinds> and then we can add a dependency
08:16:57 <jose_lausuch> lhinds: what kind of dependency?
08:17:28 <lhinds> functional dependency, I need to connect to the infra nodes, and we discussed that flashtest may be able to enable that happening
08:17:39 <lhinds> ^ security scan that is
08:18:05 <lhinds> same as you see on jira for SDN-VPN-38
08:18:39 <lhinds> but different as they want VM access
08:18:40 <enikher> yes in flash test that can easily done
08:19:08 <enikher> you can access the controllers, or the computes easily
08:19:18 <lhinds> enikher, thanks! shall I raise a new jira for comments / discussions?
08:19:19 <jose_lausuch> ok
08:19:36 <jose_lausuch> lhinds: yes, please, start the discussion :) so we also accelerate the adoption of flash test
08:19:41 <jose_lausuch> if there are more users for that
08:19:47 <lhinds> many thanks
08:19:58 <jose_lausuch> np
08:20:01 <jose_lausuch> ok, next, promise
08:20:09 <jose_lausuch> but Im not sure if bertrand is here
08:20:11 <jose_lausuch> #info Bertrand Souville - Study the opportunity to add new Open Source VNFs for Colorado (https://jira.opnfv.org/browse/FUNCTEST-167)
08:20:32 <jose_lausuch> I guess its fine…
08:20:40 <jose_lausuch> now its you lhinds
08:20:50 <jose_lausuch> #info lhinds (Luke Hinds) - Study the opportunity of basic security tests (https://jira.opnfv.org/browse/FUNCTEST-168)
08:20:56 <lhinds> thanks jose_lausuch
08:21:17 <jose_lausuch> and also https://jira.opnfv.org/browse/FUNCTEST-169
08:21:30 <lhinds> so we covered the connection discussion..
08:21:32 <jose_lausuch> not sure if this should be an epic, or task.. maybe we can have just 1 epic for security
08:21:57 <lhinds> I guess its moved beyond that now jose_lausuch
08:22:03 <jose_lausuch> #action jose_lausuch merge security epics and create appropriate task
08:22:10 <lhinds> as an update...
08:22:19 <jose_lausuch> do you want to discuss it now? or shall we do it later?
08:23:25 <lhinds> I have the test now connecting to the node, installing the OpenSCAP RPM, running the security tests, downloading the report...and if you put '--clean' as an argparse, it will remove all trace of the scan.
08:23:49 <jose_lausuch> lhinds: nice, and where are the code for those tests?
08:23:49 <lhinds> so its doing quite well, just the connection specifics to work out, and making sure its a 'fit' for functest.
08:24:00 <lhinds> jose_lausuch, that's my next question :)
08:24:08 <jose_lausuch> hehe ok
08:24:15 <jose_lausuch> where to place the code...
08:24:19 <jose_lausuch> where is it now?
08:25:00 <lhinds> I need to get this onto git, should I use functest gerrit / git and have a folder like vPing etc, or host in the security group?
08:25:28 <lhinds> I guess in functest makes sense, as you will call from your bash script?
08:25:40 <jose_lausuch> lhinds: yes, let's create a new directory "security" under /testcases
08:25:46 <lhinds> sure
08:25:51 <jose_lausuch> we can do it 2 ways
08:25:54 <jose_lausuch> we put it in functest
08:25:55 <jose_lausuch> or
08:26:02 <lhinds> merge?
08:26:06 <jose_lausuch> we have it in a remote repository that we clone in functest and use it
08:26:12 <jose_lausuch> that is up to you
08:26:17 <lhinds> ahh good point..
08:26:31 <lhinds> if its no issue for you to clone, that would be good.
08:26:32 <jose_lausuch> do you have an existing repository already in opfv?
08:26:34 <jose_lausuch> opnfv
08:26:46 <lhinds> I can get aric to create one for me with no issues
08:27:31 <jose_lausuch> lhinds: as you whish, but you can also put it in functest
08:27:44 <jose_lausuch> well, let´s see how this make sense
08:27:44 <lhinds> so I am just getting it to work on temporary basis with Apex, until flash test becomes the de'facto connection method.
08:27:52 <jose_lausuch> normally the repos in gerrit are for existing projects
08:28:02 <jose_lausuch> is the security group considered as project?
08:28:26 <lhinds> yep, that's ok. The security group is like an umbrella project..so we have a few in there for inspector and documentation
08:28:41 <jose_lausuch> ok..
08:28:59 <jose_lausuch> so if you want, we can start putting it in functest
08:29:38 <lhinds> jose_lausuch, I think we can start on that next week I hope. I just need to make some connection changes for Apex (heat_admin as sudo)
08:29:45 <jose_lausuch> ok
08:29:52 <jose_lausuch> great
08:30:04 <lhinds> as said that will only be a temp workaround, I will go via enikher 's flash framework
08:30:10 <jose_lausuch> sure
08:30:27 <jose_lausuch> anything else regarding security?
08:30:57 <lhinds> nope, just this is what I working on now... https://jira.opnfv.org/browse/APEX-125
08:31:03 <lhinds> thanks!
08:31:19 <jose_lausuch> lhinds: ok, thanks !
08:31:25 <jose_lausuch> moving on
08:31:26 <jose_lausuch> #info valentin_boucher - vIMS signaling tests (https://jira.opnfv.org/browse/FUNCTEST-171)
08:31:33 <jose_lausuch> he is not in, but he agreed
08:31:42 <jose_lausuch> #info viktor_nokia - Tempest evolution, remove customize suites (https://jira.opnfv.org/browse/FUNCTEST-172)
08:31:50 <viktor_nokia> It's OK
08:31:58 <jose_lausuch> viktor_nokia: some work to investigate this "full" flag :)
08:32:02 <jose_lausuch> maybe not the best solution
08:32:18 <jose_lausuch> the idea is to have also 2 possible ways to execute functest
08:32:24 <jose_lausuch> first smoke-serial
08:32:34 <jose_lausuch> and for the more complex tests cases, full-parallel
08:32:46 <jose_lausuch> but we saw that "full" takes a lot of time and too many test cases
08:33:00 <viktor_nokia> that was with --serial
08:33:10 <jose_lausuch> maybe there are other ways to run a relatively "full" suite
08:33:32 <jose_lausuch> ya , but you said something about 1000 tests?
08:33:35 <jose_lausuch> or more
08:33:44 <viktor_nokia> The number of test cases (~1500) is OK but we should adjust timeouts
08:33:59 <jose_lausuch> enikher: you also are a tempest expert :)
08:34:20 <jose_lausuch> if you have some ideas, you can align with viktor_nokia and me
08:34:46 <jose_lausuch> the idea is to remove the hard coded list we already have
08:35:05 <enikher> hey
08:35:10 <enikher> sorry was afk
08:35:11 <jose_lausuch> since that is not maintainable …test cases are changing every time
08:36:25 <jose_lausuch> enikher: np, I remember you told me once something like that
08:36:31 <jose_lausuch> that having a hard coded list is not a good idea
08:36:39 <enikher> yes
08:37:03 <enikher> may be it is better when we generate the list always and run some filters in the output
08:37:40 <enikher> through that some testcase which are know to be not use fully or not working for the scenario could be excluded
08:37:44 <jose_lausuch> #info may be it is better when we generate the list always and run some filters in the output
08:37:55 <jose_lausuch> #info through that some testcase which are know to be not use fully or not working for the scenario could be excluded
08:38:07 <enikher> sorry :-)
08:38:09 <jose_lausuch> enikher: ok, that makes sense
08:38:10 <jose_lausuch> thanks
08:38:30 <jose_lausuch> ok, moving to rally juhak
08:38:34 <jose_lausuch> #info juhak - Rally refactoring (https://jira.opnfv.org/browse/FUNCTEST-173)
08:38:44 <enikher> sorry jose
08:38:50 <jose_lausuch> enikher: dont be! :)
08:39:05 <enikher> do we have a jira ticket for that
08:39:08 <enikher> is it 172?
08:39:16 <jose_lausuch> enikher: yes
08:39:18 <jose_lausuch> that is the epic
08:39:26 <jose_lausuch> then we can create different sub-tasks
08:40:33 <jose_lausuch> juhak: ping
08:40:54 <juhak> pong, refactoring task is fine for me
08:41:27 <jose_lausuch> juhak: I think we should also have like 2 set of scenarios for rally
08:41:38 <jose_lausuch> 1 set that will be very simple and quick, for the smoke testing
08:41:42 <jose_lausuch> do you agree?
08:41:47 <juhak> yes
08:42:07 <jose_lausuch> in run_rally we could have a flag to indicate which set of scenarios to run
08:42:14 <jose_lausuch> up to you for implementation :)
08:42:29 <juhak> we actually already have --smoke option to run only one iteration per test case
08:42:38 <jose_lausuch> ah ok
08:42:41 <jose_lausuch> maybe we can use that one
08:42:46 <jose_lausuch> we haven´t so far
08:42:55 <juhak> but may still something like 40mins to execute
08:42:59 <juhak> need to check
08:43:00 <jose_lausuch> really?
08:43:07 <jose_lausuch> we need something that takes max 10 min
08:43:19 <jose_lausuch> maybe iterations = 1 or something
08:43:27 <jose_lausuch> like a sanity check
08:43:44 <jose_lausuch> (if it makes sense)
08:44:10 <jose_lausuch> ok
08:44:11 <juhak> yes, we need to split current set into two
08:44:21 <jose_lausuch> juhak: ok, thanks!
08:44:30 <jose_lausuch> next
08:44:31 <jose_lausuch> #info raghavendrachari
08:44:31 <jose_lausuch> - create a web portal to add test case/projects/pods to the DB (https://jira.opnfv.org/browse/FUNCTEST-176)
08:44:57 <jose_lausuch> morgan proposed you for this task, are you ok?
08:45:05 <jose_lausuch> otherwise we can leave it for someone else, as you wish
08:45:22 <jose_lausuch> you are also in the ODL stuff, together with others
08:46:24 <jose_lausuch> raghavendrachari: ping?
08:46:34 <raghavendrachari> hi
08:46:52 <raghavendrachari> yes i'll do , just i want db info
08:47:16 <jose_lausuch> raghavendrachari: what info do you need?
08:47:59 <raghavendrachari> what ever the information we need to staore in database
08:48:16 <jose_lausuch> raghavendrachari: ok, I will provide you with the wiki later
08:48:21 <raghavendrachari> ok
08:48:30 <jose_lausuch> there is a wiki explaining the API
08:48:37 <raghavendrachari> so can i use any framework right , no issues with that
08:48:42 <jose_lausuch> no
08:48:42 <raghavendrachari> flask ok ?
08:48:48 <jose_lausuch> flask?
08:48:59 <raghavendrachari> python 's framework
08:49:36 <raghavendrachari> that api we need to implement it ..
08:49:41 <lhinds> I would say flask is a good choice (i use it too)
08:49:45 <jose_lausuch> up to you, its a simple thing to be able to talk to the DB, to put stuff in the DB, some HTML friendly webpage
08:49:59 <raghavendrachari> ok
08:50:05 <jose_lausuch> http://flask.pocoo.org/ ?
08:50:21 <lhinds> jose_lausuch, yep
08:50:36 <raghavendrachari> yes this is official page
08:50:40 <jose_lausuch> #info https://wiki.opnfv.org/display/functest/Collection+Of+Test+Results
08:50:46 <jose_lausuch> raghavendrachari: that is the wiki you need
08:51:02 <David_Orange1> jose_lausuch: raghavendrachari: are we already using tornado for the api ?
08:51:06 <raghavendrachari> yeah i gone through this page
08:51:25 <David_Orange1> it is less wepage frendly but already a web server
08:51:33 <jose_lausuch> David_Orange1: I think we are, but I didn't set it up
08:52:14 <David_Orange1> yes, that was morgan that set it up on my recommendations if i remember
08:52:21 <jose_lausuch> David_Orange1: could be another possibility
08:52:25 <jose_lausuch> but as he said: this tasks consists in creating a web front end to allow people to administrate the DB from a web page (and not by calling the API)
08:52:38 <David_Orange1> i like flask too but it can be a good thing to have only one server, not 2
08:52:52 <jose_lausuch> you are right
08:53:01 <raghavendrachari> yes need to maintain one server
08:53:20 <David_Orange1> maybe a second task could be to move API from tornado to flask
08:53:24 <raghavendrachari> i'll comeup with est one
08:53:24 <jose_lausuch> but I think the idea of this is just the front end (web page) to create/modify/delete entries in the DB
08:53:37 <jose_lausuch> making calls to the DB
08:53:49 <raghavendrachari> yes
08:53:56 <David_Orange1> ok, np
08:54:12 <jose_lausuch> we are running out of time
08:54:13 <jose_lausuch> next
08:54:17 <jose_lausuch> #info raghavendrachari & cedric & others - ODL suite evolution (https://jira.opnfv.org/browse/FUNCTEST-177)
08:54:34 <jose_lausuch> raghavendrachari: I think you had questions about this, can we take them after the meeting?
08:54:44 <jose_lausuch> who is going to participate in this task?
08:54:45 <raghavendrachari> yeah
08:54:53 <jose_lausuch> cedric is not here?
08:55:00 <jose_lausuch> David_Orange1: what is his nickname?
08:55:06 <JuhaHaapa> I heard I'm part of "others"
08:55:18 <CG_Nokia> Also I am part of others
08:55:18 <jose_lausuch> JuhaHaapa: sorry!
08:55:24 <jose_lausuch> #undo
08:55:24 <collabot`> Removing item from minutes: <MeetBot.ircmeeting.items.Info object at 0x2f0a090>
08:55:39 <David_Orange1> jose_lausuch: cedric is not here
08:55:50 <jose_lausuch> #info raghavendrachari & cedric & CG_Nokia & JuhaHaapa - ODL suite evolution (https://jira.opnfv.org/browse/FUNCTEST-177)
08:56:16 <JuhaHaapa> I was happy to be named "others" :)
08:56:18 <jose_lausuch> raghavendrachari: I still have to give you the logs
08:56:20 <David_Orange1> i will ask to join the meeting next time
08:56:21 <raghavendrachari> am looking into the odl /openstack specs
08:56:27 <jose_lausuch> JuhaHaapa: its just that I forgot who was involved :)
08:56:34 <jose_lausuch> sorry for that
08:56:35 <CG_Nokia> Currently still "onboarding" myself to whole OPNFV area...
08:57:13 <jose_lausuch> CG_Nokia: no problem, just ask questions to any of us
08:57:17 <jose_lausuch> we are here to support
08:57:18 <raghavendrachari> yeah i forgot to send u mail yesterday , please send me the logs where the odl deamon is running .. in the same directory log files are  exist
08:57:23 <CG_Nokia> OK , Thx.
08:57:34 <jose_lausuch> raghavendrachari: ok, I will try, if the deployment is still up
08:57:41 <jose_lausuch> ok, next
08:57:42 <jose_lausuch> #info Serena Feng - Test API evolution (https://jira.opnfv.org/browse/FUNCTEST-178)
08:57:47 <jose_lausuch> I think she is not in...
08:57:57 <jose_lausuch> but we sent her an email, hopefully its ok
08:58:53 <jose_lausuch> ok
08:58:55 <jose_lausuch> before we close
08:58:59 <jose_lausuch> #topic Rally sync meeting date/time
08:59:03 <jose_lausuch> #link https://framadate.org/og8LmZ3vKgYSAT9b
08:59:22 <jose_lausuch> juhak viktor_nokia is 17h bad for you?
08:59:40 <juhak> I can cope with that
08:59:41 <jose_lausuch> well, morgan didnt specify the timezone...
08:59:45 <viktor_nokia> UTC?
08:59:54 <jose_lausuch> the idea is to have Boris, the Rally PTL
09:00:04 <jose_lausuch> it would be great to have you and enikher in that meeting
09:00:33 <jose_lausuch> enikher:  is that ok for you?
09:00:56 <jose_lausuch> I will try to reach boris-42 today and propose a time not too late for you and not too early for him
09:01:02 <jose_lausuch> he is based in the US
09:01:21 <jose_lausuch> ok, time to close the meeting
09:01:24 <jose_lausuch> thank you for today!
09:01:35 <jose_lausuch> if you dont have anything else to share
09:01:42 <viktor_nokia> thank you jose_lausuch
09:02:08 <jose_lausuch> #endmeeting