15:00:50 <morgan_orange> #startmeeting Test & Performance weekly meeting December 12th
15:00:50 <collabot`> Meeting started Thu Dec 17 15:00:50 2015 UTC.  The chair is morgan_orange. Information about MeetBot at http://wiki.debian.org/MeetBot.
15:00:50 <collabot`> Useful Commands: #action #agreed #help #info #idea #link #topic.
15:00:50 <collabot`> The meeting name has been set to 'test___performance_weekly_meeting_december_12th'
15:01:00 <morgan_orange> #chair jose_lausuch frankbrockners
15:01:00 <collabot`> Current chairs: frankbrockners jose_lausuch morgan_orange
15:01:30 <jose_lausuch> #info Jose Lausuch
15:02:25 <fdegir> #info Fatih Degirmenci
15:02:48 <frankbrockners> #info Frank Brockners
15:03:22 <morgan_orange> #info Morgan Richomme
15:04:36 <jose_lausuch> #topic Functest status
15:04:55 <jose_lausuch> #info making progress to run functest on the 4 installers
15:05:39 <jose_lausuch> #info almost successful running Functest from Jenkins on all of them, some environment issues to be fixed
15:05:55 <jose_lausuch> #info vPing working everywhere
15:06:22 <jose_lausuch> #info tempest runs everywhere but gives different kindof errors
15:06:44 <jose_lausuch> #info rally and vIMS not fully stable: some issues on some installers
15:07:27 <jose_lausuch> #info integration started of bgpvpn project
15:08:08 <jose_lausuch> #info no installer running opencontrail yet
15:08:49 <jose_lausuch> #topic Yardstick status
15:09:01 <jose_lausuch> #info defined 11 test that MUST run on any installer
15:10:01 <jose_lausuch> #info they will continue developing some test cases after the code freeze
15:10:32 <jose_lausuch> #info the deadline is to freeze de feature projects code (tests cases) but not integration in yardstick/functest/..
15:11:52 <jose_lausuch> #info minimum 4 times in a row from the CI passing the criteria defined by functest and yardstick
15:12:19 <jose_lausuch> #topic Qtip status
15:21:47 <jose_lausuch> #info identify which test are acceptable if they don´t pass due to installed features in place that prevent them to pass
15:22:28 <jose_lausuch> #info making sure that the tests run on different labs. Soon run from jenkins
15:22:40 <jose_lausuch> #info qtip to run within a docker container too
15:22:46 <jose_lausuch> docker rocks :)
15:23:48 <morgan_orange> jose super docker star
15:27:38 <jose_lausuch> #info make sure that qtip runs also in fuel and apex
15:29:00 <fdegir> #info New test projects will be taken into CI once the development work is done and validated against the existing installers
15:29:18 <jose_lausuch> #topic VSperf
15:29:26 <fdegir> #info The order of CI runs will be: build (if valid), deploy, functest, yardstick
15:29:53 <fdegir> #info Jobs of other test frameworks will be added accordingly once they're confirmed to be ready
15:29:54 <jose_lausuch> #info no particular concerns to raise so far
15:30:02 <jose_lausuch> sorry fatih :)
15:30:07 <jose_lausuch> info stuff, I stop
15:30:12 <fdegir> np jose_lausuch
15:30:19 <fdegir> I'm done, just wanted to capture stuff
15:31:08 <jose_lausuch> any vsperf member, please info things too
15:35:32 <fdegir> https://build.opnfv.org/ci/job/installer-controller-pod-daily-master/
15:37:23 <fdegir> above is the example job
15:38:28 <jose_lausuch> #info there won´t be a jjob for each scenario, jjob will be "dumb", the test projects have to read the parameters of the scenario and proceed accordingly
15:39:15 <jose_lausuch> #info generic jobs for scenarios
15:39:27 <jose_lausuch> #link https://build.opnfv.org/ci/job/installer-controller-pod-daily-master/
15:40:34 <fdegir> #info Patch under review https://gerrit.opnfv.org/gerrit/#/c/4781/
15:42:12 <jose_lausuch> #topic Release stability
15:43:54 <jose_lausuch> #info Chris and Debra propose lab ready: deploy without problems. run the basic tests without problem, but the features themselves don't need to be as stable as the infrastructure
15:47:41 <jose_lausuch> #info Debra asks what happens is some tests work on all installers but 1 (for example)
15:48:08 <jose_lausuch> #info Morgan points out that those minimum set of tests must work on all installers (Openstack infra verification, …)
15:52:50 <jose_lausuch> #topic Demo
15:53:43 <jose_lausuch> #link https://wiki.opnfv.org/opnfv_test_dashboard/opnfv_kibana_dashboards
15:54:35 <jose_lausuch> it asks for user/password
16:05:57 <jose_lausuch> #closemeeting
16:06:23 <jose_lausuch> #endmeeting