======================================== #opnfv-dovetail: dovetail weekly meeting ======================================== Meeting started by xudan_ at 14:01:51 UTC. The full logs are available at http://ircbot.wl.linuxfoundation.org/meetings/opnfv-dovetail/2018/opnfv-dovetail.2018-10-24-14.01.log.html . Meeting summary --------------- * Handling of Offline scripts in Dovetail repo (xudan_, 14:06:54) * ACTION: xudan will remove these scripts. (xudan_, 14:10:11) * VNFSDK integration: Current Progress (xudan_, 14:12:18) * ACTION: xudan will create some jira tickets about this integration work (xudan_, 14:13:10) * anyone who are interested in this can pick them. (xudan_, 14:13:30) * LINK: https://wiki.lfnetworking.org/display/LN/Performance+Testing?preview=/8257568/8257570/LFN%20Certification_%20evolution%20proposal%2015102018.pdf (mbeierl, 14:16:37) * performance testing (xudan_, 14:16:56) * wiki page https://wiki.lfnetworking.org/display/LN/Performance+Testing (xudan_, 14:17:07) * presentation https://wiki.lfnetworking.org/download/attachments/8257568/LFN%20Certification_%20evolution%20proposal%2015102018.pdf?version=1&modificationDate=1539627657000&api=v2 (xudan_, 14:17:30) * etherpad https://etherpad.lfnetworking.org/p/LFN_Cert_Performance_Discussions (xudan_, 14:17:43) * What is performance testing and how does it relate to CVC? There is no pass/fail for performance, so that must be reporting only (mbeierl, 14:34:28) * which brings up the point that Dovetail and CVC are two separate goals. CVC is a subset of Dovetail. (mbeierl, 14:35:00) * Dovetail has optional tests, and we certainly have the leeway to extend the optional tests to include performance (mbeierl, 14:35:28) * Performance then does not provide a pass/fail, but it does provide additional information above the basic functions. (mbeierl, 14:36:07) * to paraphrase Al, first we show that it works, then we can say how fast it works (mbeierl, 14:36:41) * Dovetail initially proposed the scope of OVP, but now there is the LFN CVC that is taking this concept and moving it forward and will have its own direction (mbeierl, 14:40:59) * Dovetail is able to perform tests such as performance, and is not bound to create a pass/fail opinion on it (mbeierl, 14:42:14) * it would be the CVC that would make a decision on how they want to use these numbers (mbeierl, 14:42:40) * LINK: http://testresults.opnfv.org/reporting/ (mbeierl, 14:57:57) * Mark asks the question: how does Dovetail see itself in relationship to the test results dashboard? Can Dovetail become the project that helps with release verification? (mbeierl, 14:58:36) * Al Believes: instead of thresholds, there can be a system of references - performance of well-known platforms - which users can compare new results against. This makes the results more meaningful to users! (mbeierl, 15:01:16) Meeting ended at 15:04:17 UTC. People present (lines said) --------------------------- * mbeierl (12) * xudan_ (11) * collabot (3) Generated by `MeetBot`_ 0.1.4