======================================================= #opnfv-testperf: Functest weekly meeting April the 19th ======================================================= Meeting started by morgan_orange at 08:00:12 UTC. The full logs are available at http://ircbot.wl.linuxfoundation.org/meetings/opnfv-testperf/2016/opnfv-testperf.2016-04-19-08.00.log.html . Meeting summary --------------- * call roll (morgan_orange, 08:00:26) * Morgan Richomme (morgan_orange, 08:00:32) * Viktor Tikkanen (viktor_nokia, 08:00:35) * Jose Lausuch (jose_lausuch, 08:00:41) * Juha Kosonen (juhak, 08:00:43) * David Blaisonneau (David_Orange, 08:00:49) * CG_Nokia (Colum Gaynor) (CG_Nokia, 08:00:51) * Juha Haapavirta (JuhaHaapa, 08:00:53) * (serena-zte, 08:00:55) * lhinds (lhinds, 08:01:13) * agenda is here https://wiki.opnfv.org/display/functest/Functest+Meeting (morgan_orange, 08:01:14) * serena (serena-zte, 08:01:21) * raghavendrachari (raghavendrachari, 08:01:30) * action point follow-up (morgan_orange, 08:02:02) * LINK: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-testperf/2016/opnfv-testperf.2016-04-12-08.00.html (morgan_orange, 08:02:23) * no AP last week (morgan_orange, 08:02:30) * test release criteria (morgan_orange, 08:02:39) * page created for each project to provide input about the release criteria https://wiki.opnfv.org/display/SWREL/Test+Release+Criteria (jose_lausuch, 08:04:47) * ACTION: jose_lausuch send reminder to project test PTLs to fill the tables for release criteria (jose_lausuch, 08:05:43) * ACTION: morgan_orange prepare presentation for test meeting on test criteria (morgan_orange, 08:06:52) * LINK: https://wiki.opnfv.org/display/SWREL/Feature+Test+Input (jose_lausuch, 08:08:50) * discussion on test criteria https://wiki.opnfv.org/display/SWREL/Test+Release+Criteria (morgan_orange, 08:18:20) * release != release criteria (morgan_orange, 08:18:42) * everything can be in the release (morgan_orange, 08:18:59) * test criteria are indicated to give an indicator if the test can be considered as successful or not (morgan_orange, 08:19:29) * we know that timing is challenging and currently 3h is too long (morgan_orange, 08:19:53) * that is why 2 mechanisms are planned for Colorado to reduce the duration of the run and not run tests systematically (if results are stable) (morgan_orange, 08:20:29) * test criteria = group of tests that need to succeed to validate the release (jose_lausuch, 08:20:46) * first mechanism: slicing tests into 5 tiers: health / smoke / openstack ready / VNFs / features (morgan_orange, 08:21:05) * second mechanism: use a trust indicator for each test case to trigger or not the test case (morgan_orange, 08:21:32) * not possible to get the real impacts on these mechanism yet...but it would be one of the main contribution for C release... (morgan_orange, 08:22:01) * trust indicator to be used on the long test cases (jose_lausuch, 08:22:04) * first tiers are short and will be run systematically (morgan_orange, 08:22:30) * ACTION: morgan_orange contact policytest to see if they are still alive (morgan_orange, 08:23:35) * ACTION: morgan_orange review new demands from feature projects and try to precise a way to work (morgan_orange, 08:25:39) * ACTION: viktor_nokia set tempest smoke to 100% (morgan_orange, 08:32:02) * ACTION: juhak add line Rally_smoke / rally full (morgan_orange, 08:32:20) * Security testing (morgan_orange, 08:35:16) * LINK: https://wiki.opnfv.org/display/functest/Functest+Security (lhinds, 08:36:07) * code for OpenScap scan merged yesterday https://gerrit.opnfv.org/gerrit/#/c/12411/ (morgan_orange, 08:36:09) * ACTION: luke to contact intel labs / tim rozet for security test integration (lhinds, 08:46:50) * functest offline (morgan_orange, 08:49:53) * ACTION: morgan_orange viktor_nokia contact Frank to see if offline could be considered as a requirement for C-release (morgan_orange, 08:53:14) * AoB (morgan_orange, 08:56:11) * yardstick planned to create a CLI, I think it is a good idea... (morgan_orange, 08:56:26) * ACTION: morgan_orange create functest cli epic (morgan_orange, 08:58:57) * ACTION: morgan_orange assign raghavendrachari for CLI (morgan_orange, 09:00:02) * I also created versions in Jiras (morgan_orange, 09:00:18) * LINK: https://jira.opnfv.org/browse/FUNCTEST-177 (raghavendrachari, 09:02:21) Meeting ended at 09:06:40 UTC. Action items, by person ----------------------- * jose_lausuch * jose_lausuch send reminder to project test PTLs to fill the tables for release criteria * juhak * juhak add line Rally_smoke / rally full * morgan_orange * morgan_orange prepare presentation for test meeting on test criteria * morgan_orange contact policytest to see if they are still alive * morgan_orange review new demands from feature projects and try to precise a way to work * morgan_orange viktor_nokia contact Frank to see if offline could be considered as a requirement for C-release * morgan_orange create functest cli epic * morgan_orange assign raghavendrachari for CLI * raghavendrachari * morgan_orange assign raghavendrachari for CLI * viktor_nokia * viktor_nokia set tempest smoke to 100% * morgan_orange viktor_nokia contact Frank to see if offline could be considered as a requirement for C-release People present (lines said) --------------------------- * jose_lausuch (136) * morgan_orange (126) * lhinds (42) * raghavendrachari (9) * serena-zte (8) * viktor_nokia (7) * boris-42 (3) * collabot (3) * juhak (2) * jlinkes_ (2) * JuhaHaapa (1) * CG_Nokia (1) * David_Orange (1) Generated by `MeetBot`_ 0.1.4