#opnfv-testperf: Functest weekly meeting April the 19th

Meeting started by morgan_orange at 08:00:12 UTC (full logs).

Meeting summary

  1. call roll (morgan_orange, 08:00:26)
    1. Morgan Richomme (morgan_orange, 08:00:32)
    2. Viktor Tikkanen (viktor_nokia, 08:00:35)
    3. Jose Lausuch (jose_lausuch, 08:00:41)
    4. Juha Kosonen (juhak, 08:00:43)
    5. David Blaisonneau (David_Orange, 08:00:49)
    6. CG_Nokia (Colum Gaynor) (CG_Nokia, 08:00:51)
    7. Juha Haapavirta (JuhaHaapa, 08:00:53)
    8. (serena-zte, 08:00:55)
    9. lhinds (lhinds, 08:01:13)
    10. agenda is here https://wiki.opnfv.org/display/functest/Functest+Meeting (morgan_orange, 08:01:14)
    11. serena (serena-zte, 08:01:21)
    12. raghavendrachari (raghavendrachari, 08:01:30)

  2. action point follow-up (morgan_orange, 08:02:02)
    1. http://ircbot.wl.linuxfoundation.org/meetings/opnfv-testperf/2016/opnfv-testperf.2016-04-12-08.00.html (morgan_orange, 08:02:23)
    2. no AP last week (morgan_orange, 08:02:30)

  3. test release criteria (morgan_orange, 08:02:39)
    1. page created for each project to provide input about the release criteria https://wiki.opnfv.org/display/SWREL/Test+Release+Criteria (jose_lausuch, 08:04:47)
    2. ACTION: jose_lausuch send reminder to project test PTLs to fill the tables for release criteria (jose_lausuch, 08:05:43)
    3. ACTION: morgan_orange prepare presentation for test meeting on test criteria (morgan_orange, 08:06:52)
    4. https://wiki.opnfv.org/display/SWREL/Feature+Test+Input (jose_lausuch, 08:08:50)
    5. discussion on test criteria https://wiki.opnfv.org/display/SWREL/Test+Release+Criteria (morgan_orange, 08:18:20)
    6. release != release criteria (morgan_orange, 08:18:42)
    7. everything can be in the release (morgan_orange, 08:18:59)
    8. test criteria are indicated to give an indicator if the test can be considered as successful or not (morgan_orange, 08:19:29)
    9. we know that timing is challenging and currently 3h is too long (morgan_orange, 08:19:53)
    10. that is why 2 mechanisms are planned for Colorado to reduce the duration of the run and not run tests systematically (if results are stable) (morgan_orange, 08:20:29)
    11. test criteria = group of tests that need to succeed to validate the release (jose_lausuch, 08:20:46)
    12. first mechanism: slicing tests into 5 tiers: health / smoke / openstack ready / VNFs / features (morgan_orange, 08:21:05)
    13. second mechanism: use a trust indicator for each test case to trigger or not the test case (morgan_orange, 08:21:32)
    14. not possible to get the real impacts on these mechanism yet...but it would be one of the main contribution for C release... (morgan_orange, 08:22:01)
    15. trust indicator to be used on the long test cases (jose_lausuch, 08:22:04)
    16. first tiers are short and will be run systematically (morgan_orange, 08:22:30)
    17. ACTION: morgan_orange contact policytest to see if they are still alive (morgan_orange, 08:23:35)
    18. ACTION: morgan_orange review new demands from feature projects and try to precise a way to work (morgan_orange, 08:25:39)
    19. ACTION: viktor_nokia set tempest smoke to 100% (morgan_orange, 08:32:02)
    20. ACTION: juhak add line Rally_smoke / rally full (morgan_orange, 08:32:20)

  4. Security testing (morgan_orange, 08:35:16)
    1. https://wiki.opnfv.org/display/functest/Functest+Security (lhinds, 08:36:07)
    2. code for OpenScap scan merged yesterday https://gerrit.opnfv.org/gerrit/#/c/12411/ (morgan_orange, 08:36:09)
    3. ACTION: luke to contact intel labs / tim rozet for security test integration (lhinds, 08:46:50)

  5. functest offline (morgan_orange, 08:49:53)
    1. ACTION: morgan_orange viktor_nokia contact Frank to see if offline could be considered as a requirement for C-release (morgan_orange, 08:53:14)

  6. AoB (morgan_orange, 08:56:11)
    1. yardstick planned to create a CLI, I think it is a good idea... (morgan_orange, 08:56:26)
    2. ACTION: morgan_orange create functest cli epic (morgan_orange, 08:58:57)
    3. ACTION: morgan_orange assign raghavendrachari for CLI (morgan_orange, 09:00:02)
    4. I also created versions in Jiras (morgan_orange, 09:00:18)
    5. https://jira.opnfv.org/browse/FUNCTEST-177 (raghavendrachari, 09:02:21)


Meeting ended at 09:06:40 UTC (full logs).

Action items

  1. jose_lausuch send reminder to project test PTLs to fill the tables for release criteria
  2. morgan_orange prepare presentation for test meeting on test criteria
  3. morgan_orange contact policytest to see if they are still alive
  4. morgan_orange review new demands from feature projects and try to precise a way to work
  5. viktor_nokia set tempest smoke to 100%
  6. juhak add line Rally_smoke / rally full
  7. luke to contact intel labs / tim rozet for security test integration
  8. morgan_orange viktor_nokia contact Frank to see if offline could be considered as a requirement for C-release
  9. morgan_orange create functest cli epic
  10. morgan_orange assign raghavendrachari for CLI


Action items, by person

  1. jose_lausuch
    1. jose_lausuch send reminder to project test PTLs to fill the tables for release criteria
  2. juhak
    1. juhak add line Rally_smoke / rally full
  3. morgan_orange
    1. morgan_orange prepare presentation for test meeting on test criteria
    2. morgan_orange contact policytest to see if they are still alive
    3. morgan_orange review new demands from feature projects and try to precise a way to work
    4. morgan_orange viktor_nokia contact Frank to see if offline could be considered as a requirement for C-release
    5. morgan_orange create functest cli epic
    6. morgan_orange assign raghavendrachari for CLI
  4. raghavendrachari
    1. morgan_orange assign raghavendrachari for CLI
  5. viktor_nokia
    1. viktor_nokia set tempest smoke to 100%
    2. morgan_orange viktor_nokia contact Frank to see if offline could be considered as a requirement for C-release


People present (lines said)

  1. jose_lausuch (136)
  2. morgan_orange (126)
  3. lhinds (42)
  4. raghavendrachari (9)
  5. serena-zte (8)
  6. viktor_nokia (7)
  7. boris-42 (3)
  8. collabot (3)
  9. juhak (2)
  10. jlinkes_ (2)
  11. JuhaHaapa (1)
  12. CG_Nokia (1)
  13. David_Orange (1)


Generated by MeetBot 0.1.4.