14:01:53 #startmeeting OPNFV Test and Performance meeting 14:01:53 Meeting started Thu May 21 14:01:53 2015 UTC. The chair is trevor_intel. Information about MeetBot at http://wiki.debian.org/MeetBot. 14:01:53 Useful Commands: #action #agreed #help #info #idea #link #topic. 14:01:53 The meeting name has been set to 'opnfv_test_and_performance_meeting' 14:02:00 #info Trevor Cooper 14:03:01 #info Ana Cunha 14:03:22 #info Morgan Richomme 14:03:50 any issue with gotomeeting? 14:04:05 #info Jose Lausuch 14:04:06 no works for us 14:04:14 ยง https://global.gotomeeting.com/join/305553637 14:05:06 #action Trevor arrange vSwitch tst framework for next week (with demo) 14:10:02 #info need people to review pharos (and functest docs) 14:10:26 #info big audience at openstack summit, expectations on NFV 14:13:08 #info lots of work on installation ahead , synchro BGS/pharos 14:14:13 #info Orange have started installing solutions on the 2 PODs ... need feedback to Pharos 14:16:35 #info Plan in functest ... suite of tests automatically integrated into CI and runs on eg 10 test beds ... then compare results. Difference will be be from topologies, capabilities, compare KPIs 14:18:34 #topic Functest 14:19:53 #info status ... 4 suites of tests ... build, deploy with CI and then run tests 1) Bench / Rally 2) Tempest 3) vPing 4) ODL suite 14:20:04 #info vIMS not ready 14:20:06 #link https://wiki.opnfv.org/r1_rally_bench 14:20:25 #link https://wiki.opnfv.org/r1_tempest 14:20:40 #link https://wiki.opnfv.org/r1_vping 14:20:54 #https://wiki.opnfv.org/opnfv_functional_testing 14:21:32 #info 2 tools used 1) Rally - developed for Open Stack 2) Robo framework used by ODL ... can be used for any automated testing 14:22:42 #https://build.opnfv.org/ci/view/functest/ 14:22:47 #link https://build.opnfv.org/ci/view/functest/ 14:22:48 #info There are still errors in the test results ... trying to reduce and understand why failure ... so cannot do a complete run 14:23:43 #info 2 Jenkins jobs created 1. Jump 1 and 2. Jump 2 14:24:21 #link http://artifacts.opnfv.org/functest/docs/functest.html 14:24:25 #info There is some manual installation ... detailed in documentation 14:25:11 #info Hoping to reach full run tonight on POD 1 14:26:03 #link https://wiki.opnfv.org/functextnexttaks 14:28:59 #info After release 1 ... new VNFs ... vIMS, vCPE, vSBC, ... new scenarios of exisiting test suites ... working on API to post results form multiple test beds - create dashboard ... integrate new tools, Yardstick, etc. ... sync with ETSI test group, take test specs and automate into functest 14:29:36 #info need to get listed contributors engaged 14:30:47 #info next week Morgan will present slides for pwople wanting to get involved with functest 14:33:19 #topic Yardstick 14:33:54 #info have started pushing code to repo and should be doen this week 14:34:32 #info There is a readme file which should be enough to get started 14:35:34 #info Documentation for auto build ... should be in place soon 14:35:44 #info will make a demo after Arno 14:36:17 #info Discussion last week on what we should test ... no conclusions 14:36:42 https://gerrit.opnfv.org/gerrit/#/admin/projects/yardstick 14:37:19 #info Jira is also started with tasks 14:40:11 #info Re test cases ... 1) not vendor specific 2) how to model? 14:41:57 #info Consolidate list of test cases ... for automation need non-vendor specific VNFs ... need concensus on which to start with 14:43:20 could we upgrade https://wiki.opnfv.org/functextnexttaks 14:44:45 #agree Collect use cases .... use wiki page above 14:48:38 #endmeeting