#opnfv-meeting: OPNFV Performance and Test

Meeting started by trevor_intel1 at 14:02:02 UTC (full logs).

Meeting summary

    1. Trevor Cooper (trevor_intel1, 14:02:22)
    2. YaoguangWang (YaoguangWang__, 14:03:25)

  2. Release Criteria discussion (trevor_intel1, 14:05:01)
    1. Mark Beierl (mbeierl, 14:06:06)
    2. Maryam Tahhan (vsperf) (mtahhan, 14:06:51)
    3. Ana Cunha (anac2, 14:07:34)
    4. proposal is to make release the same as with release B (trevor_intel1, 14:10:15)
    5. we don't want to run daily tests that tie up the whole testing pipeline - resources are a concern to include in the CI pipeline (mtahhan, 14:18:57)
    6. weekly tests can run for longer (mtahhan, 14:19:11)
    7. we have to be careful about what tests get included as part of Yardstick and functest ci (mtahhan, 14:19:32)
    8. functest looking at reducing the test execution time (mtahhan, 14:19:58)
    9. daily runs should be a subset of test cases that we have run on CI PODs (mtahhan, 14:23:07)
    10. other/extended test cases run on separate (non CI) PODs (mtahhan, 14:23:41)
    11. Suggestion: longer running tests run by the individual projects on their own CI pipeline or POD, and then report to a common dashboard (mbeierl, 14:26:15)
    12. we need to replicate our Results DB (mtahhan, 14:29:58)
    13. at the moment there's only one (mtahhan, 14:30:08)
    14. we should investigate and pick what results solution will fit the testing projects needs (mtahhan, 14:31:34)
    15. general agreement was reached that there should be a single common place for storing results, but how to display and report may be up to different projects (mbeierl, 14:33:32)
    16. test projects to document all test run times (mtahhan, 14:37:14)
    17. dedicated PODs for the extended tests are required (mtahhan, 14:37:56)
    18. https://wiki.opnfv.org/display/SWREL/Colorado+Testing+-+Discussion+and+Proposals (trevor_intel1, 14:41:36)
    19. Jose will update the test matrix asking for test cases proposed to include in CI and include estimate of time to run each test case (trevor_intel1, 14:45:40)
    20. https://wiki.opnfv.org/display/SWREL/Colorado+Testing+-+Discussion+and+Proposals#ColoradoTesting-DiscussionandProposals-FeatureProjectMatrix (jose_lausuch1, 14:47:24)
    21. Trevor ask David for time in Tuesday release meeting on topics of 1) Proposal re test criteria 2) What feature projects need to know re test projects (trevor_intel1, 15:00:01)
    22. Use Colorado testing page to get started ... Bryan (trevor_intel1, 15:02:49)


Meeting ended at 15:03:07 UTC (full logs).

Action items

  1. (none)


People present (lines said)

  1. mtahhan (12)
  2. trevor_intel1 (9)
  3. collabot` (3)
  4. mbeierl (3)
  5. anac2 (2)
  6. YaoguangWang_ (2)
  7. jose_lausuch1 (2)
  8. YaoguangWang__ (1)
  9. bryan_att (1)


Generated by MeetBot 0.1.4.