15:00:14 #startmeeting Testing group weekly meeting January 5th 15:00:14 Meeting started Thu Jan 5 15:00:14 2017 UTC. The chair is morgan_orange. Information about MeetBot at http://wiki.debian.org/MeetBot. 15:00:14 Useful Commands: #action #agreed #help #info #idea #link #topic. 15:00:14 The meeting name has been set to 'testing_group_weekly_meeting_january_5th' 15:00:38 #topic call role 15:01:01 #info Morgan Richomme 15:01:09 #info kubi 15:01:23 #info HelenYao 15:01:26 #info Trevor Cooper 15:01:27 #info Yujun Zhang 15:01:46 #info Larry Lamers 15:02:02 #info agenda : https://wiki.opnfv.org/display/meetings/TestPerf 15:02:03 #info Rex 15:02:09 #info LeoWang 15:02:14 #topic action point follow-up 15:02:23 #link http://ircbot.wl.linuxfoundation.org/meetings/opnfv-testperf/2016/opnfv-testperf.2016-12-15-15.00.html 15:02:34 #info yuyang_ plan a Bottleneck update for the testing community beginning of January => done 15:02:36 #info Mark Beierl 15:02:55 #info trevor_intel create an etherpad page on stress test: with short term view (Danube) and longer view (stress test strategy) => done 15:03:09 #info morgan_orange cretae a page for vnfOnBoarding for testing => done 15:03:18 #link https://wiki.opnfv.org/pages/viewpage.action?pageId=8687767 15:04:32 #topic Process of Testperf Ecosystem Diagram Modification 15:04:44 #link https://wiki.opnfv.org/display/testing 15:04:44 Still trying to connect to GTM 15:04:52 #chair kubi001 trevor_intel yujunz 15:04:52 Current chairs: kubi001 morgan_orange trevor_intel yujunz 15:04:54 remind me of important info please 15:06:06 yujunz: are you connected on the GTM? 15:06:16 Still trying 15:06:23 https://global.gotomeeting.com/join/305553637 15:06:25 The client is out of date 15:06:27 #info Jack 15:06:38 And upgrading seems take a long time 15:07:43 #info will come back on diag topic once everybody is connected 15:08:04 #topic A new test case development plan 15:08:18 #link https://wiki.opnfv.org/display/meetings/TestPerf?preview=/2926539/8688394/test_case_development_plan.pptx 15:09:45 #info linked to Dovetail project whose goal: define and provide a set of OPNFV related validation criteria 15:21:13 #info Functest is running Tempest since Arno. In the default smoke suite list there are currently 165 cases by default (that can be extended if needed) for tempest.api.network => I count more than 50 tests 15:36:54 #topic back to Process of Testperf Ecosystem Diagram Modification 15:37:12 #info yujunz show the new version of the diagram (qtip externalized) 15:38:13 #info moving QTIP out of qualification testing to another box benchmark 15:40:30 #info trevor_intel reminds that one the main goal of the initial graph was to avoid duplication/overlap in domains/tooling 15:40:45 #info show the relationship as a vision accross the test projects 15:41:38 #link https://lists.opnfv.org/pipermail/opnfv-tech-discuss/2017-January/014310.html 15:41:55 #info test projects are still very independent (vsperf versus yardstick) 15:48:42 #action trevor_intel suggest an evolution of the graph in order to stick to the reality as close as possible (remove cperf?, change connections to identify standalone/interactions between project, which project exposes what to who,...) 15:49:43 #info kubi001 mentions a risk to get fragmentation, multiplication of domains 15:50:30 #topic Review Danube priorities 15:52:15 #action averybody review mail sent yesterday 15:52:24 #topic Update on stress testing 15:52:39 #link https://etherpad.opnfv.org/p/DanubeStressTest 15:53:32 #info 3 scenarios proposed in the etherpad 15:53:56 #info a user of the platform shall be able to run 15:54:01 #info it shall be simple 15:54:14 #info basic level of performance 15:54:36 #info first test to try to break the system (experimental) 15:58:51 #info still one week to review the different high level proposal 15:59:43 #action kubi001 make synthesis of the proposal for week 4 16:01:13 #topic Bottlenecks & Yardstick update 16:01:29 #info postponed to next week 16:01:40 #topic AoB 16:02:58 #info Reminder: APAC slot next week 16:03:03 #action mbeierl summary on discussion on unit tests (best practices, recommendations,..) + presentation on week 3 16:03:13 #endmeeting