======================================================= #opnfv-meeting: Test&performance weekly meeting May 5th ======================================================= Meeting started by morgan_orange at 14:00:05 UTC. The full logs are available at http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2016/opnfv-meeting.2016-05-12-14.00.log.html . Meeting summary --------------- * call roll (morgan_orange, 14:00:13) * Morgan Richomme (morgan_orange, 14:00:17) * Jose Lausuch (jose_lausuch, 14:02:02) * qiliang (ql, 14:02:36) * Frank Brockners (frankbrockners, 14:02:45) * zhifeng (zhifeng, 14:02:54) * Mark Beierl (mbeierl, 14:03:10) * topic Test Criteria (morgan_orange, 14:05:27) * Maryam Tahhan (mtahhan, 14:05:52) * LINK: https://wiki.opnfv.org/display/PROJ/Daisy+Nfv (mbeierl, 14:09:53) * release criteria applies to scenarios individually (jose_lausuch, 14:10:02) * as the test group, we have the mission to validate a release and each of the scenarios (jose_lausuch, 14:10:26) * the number of features might increase significantly, since the idea is to test everything, this will cause time concerns (jose_lausuch, 14:13:24) * to validate a scenario (functest case): 4 consecutive runs + smoke tests passing + scenario specific test (~1h testing time) (jose_lausuch, 14:14:10) * Frank suggests the benefit of pulling the definitions of scenarios out of Jenkins and into scenario definition files that scenario owners can manage (mbeierl, 14:17:48) * Suggestion understood, but probably not doable in C time (mbeierl, 14:19:45) * LINK: https://wiki.opnfv.org/display/SWREL/Test+Release+Criteria (mbeierl, 14:26:23) * LINK: https://wiki.opnfv.org/display/SWREL/Colorado+scenario+inventory+and+dependencies - List of scenarios (frankbrockners, 14:32:38) * ACTION: morgan_orange review Colorado scenario and conbtact scenario owner to list scenario specific test list (morgan_orange, 14:34:17) * roadmap (morgan_orange, 14:34:26) * more resources allocation roadmap (morgan_orange, 14:34:38) * to be sync with david karr (action from Infra group to setup CI Intra resources) (morgan_orange, 14:38:04) * plugfest (morgan_orange, 14:39:54) * presentations on Functest, Yardstick, StorPerf well received (morgan_orange, 14:40:24) * several integrations done, Yardstick and Functest launched successfully (morgan_orange, 14:41:36) * all the installers represented (morgan_orange, 14:42:02) * first tests collected (morgan_orange, 14:42:45) * LINK: http://plugfest.opnfv.org/testapi/results (morgan_orange, 14:42:47) * Approach to testing (morgan_orange, 14:47:29) * consolidation on OPNFV testing in progress (morgan_orange, 14:47:49) * one goal = create a white paper to clarify what is testing in OPNFV (morgan_orange, 14:48:04) * some wiki pages have to be updated (morgan_orange, 14:49:11) * ACTION: all review testing main page and re-share first attempt on domain coverage (morgan_orange, 14:50:09) * LINK: https://wiki.opnfv.org/display/functest/Testing (morgan_orange, 14:50:39) * Clarification on the test results: The above link shows only results of OPNFV test projects. It is simple pass/fail and basic information on the criteria. This database does *not* contain any propriety test results such as VNF performance, etc. (mbeierl, 14:50:43) * LINK: https://wiki.opnfv.org/display/functest/Testing+Coverage (morgan_orange, 14:51:02) * presentation of Alan's Draft on Testing approach (morgan_orange, 14:52:13) Meeting ended at 15:04:32 UTC. Action items, by person ----------------------- * morgan_orange * morgan_orange review Colorado scenario and conbtact scenario owner to list scenario specific test list People present (lines said) --------------------------- * morgan_orange (27) * jose_lausuch (8) * mbeierl (8) * collabot` (5) * frankbrockners (3) * mtahhan (3) * zhifeng (1) * ql (1) * QiLiang (0) Generated by `MeetBot`_ 0.1.4