========================================== #opnfv-meeting: OPNFV Performance and Test ========================================== Meeting started by trevor_intel1 at 14:02:02 UTC. The full logs are available at http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2016/opnfv-meeting.2016-04-14-14.02.log.html . Meeting summary --------------- * Trevor Cooper (trevor_intel1, 14:02:22) * YaoguangWang (YaoguangWang__, 14:03:25) * Release Criteria discussion (trevor_intel1, 14:05:01) * Mark Beierl (mbeierl, 14:06:06) * Maryam Tahhan (vsperf) (mtahhan, 14:06:51) * Ana Cunha (anac2, 14:07:34) * proposal is to make release the same as with release B (trevor_intel1, 14:10:15) * we don't want to run daily tests that tie up the whole testing pipeline - resources are a concern to include in the CI pipeline (mtahhan, 14:18:57) * weekly tests can run for longer (mtahhan, 14:19:11) * we have to be careful about what tests get included as part of Yardstick and functest ci (mtahhan, 14:19:32) * functest looking at reducing the test execution time (mtahhan, 14:19:58) * daily runs should be a subset of test cases that we have run on CI PODs (mtahhan, 14:23:07) * other/extended test cases run on separate (non CI) PODs (mtahhan, 14:23:41) * Suggestion: longer running tests run by the individual projects on their own CI pipeline or POD, and then report to a common dashboard (mbeierl, 14:26:15) * we need to replicate our Results DB (mtahhan, 14:29:58) * at the moment there's only one (mtahhan, 14:30:08) * we should investigate and pick what results solution will fit the testing projects needs (mtahhan, 14:31:34) * general agreement was reached that there should be a single common place for storing results, but how to display and report may be up to different projects (mbeierl, 14:33:32) * test projects to document all test run times (mtahhan, 14:37:14) * dedicated PODs for the extended tests are required (mtahhan, 14:37:56) * https://wiki.opnfv.org/display/SWREL/Colorado+Testing+-+Discussion+and+Proposals (trevor_intel1, 14:41:36) * Jose will update the test matrix asking for test cases proposed to include in CI and include estimate of time to run each test case (trevor_intel1, 14:45:40) * LINK: https://wiki.opnfv.org/display/SWREL/Colorado+Testing+-+Discussion+and+Proposals#ColoradoTesting-DiscussionandProposals-FeatureProjectMatrix (jose_lausuch1, 14:47:24) * Trevor ask David for time in Tuesday release meeting on topics of 1) Proposal re test criteria 2) What feature projects need to know re test projects (trevor_intel1, 15:00:01) * Use Colorado testing page to get started ... Bryan (trevor_intel1, 15:02:49) Meeting ended at 15:03:07 UTC. People present (lines said) --------------------------- * mtahhan (12) * trevor_intel1 (9) * collabot` (3) * mbeierl (3) * anac2 (2) * YaoguangWang_ (2) * jose_lausuch1 (2) * YaoguangWang__ (1) * bryan_att (1) Generated by `MeetBot`_ 0.1.4