16:04:21 <debrascott> #startmeeting Brahmaputra Release
16:04:21 <collabot`> Meeting started Tue Dec 15 16:04:21 2015 UTC.  The chair is debrascott. Information about MeetBot at http://wiki.debian.org/MeetBot.
16:04:21 <collabot`> Useful Commands: #action #agreed #help #info #idea #link #topic.
16:04:21 <collabot`> The meeting name has been set to 'brahmaputra_release'
16:04:28 <debrascott> #topic roll call
16:04:35 <ChrisPriceAB> #info to add to meeting minutes rpaik.  The topic of the updte from the board meeting has been dleayed until the meeting on the 22nd.
16:04:50 <ChrisPriceAB> oops sorry debra
16:05:08 <debrascott> https://global.gotomeeting.com/join/341956909
16:05:15 <ChrisPriceAB> #info Chris Price (opnfvdocs)
16:05:18 <bryan_att> #info Bryan Sullivan
16:05:21 <n0ano> #info n0ano (Don Dugger - Intel)
16:05:38 <mbeierl> #info Mark Beierl (StorPerf)
16:05:48 <uli-k_> #info Uli Kleber, Octopus
16:05:48 <anac1> #info Ana Cunha (Yardstick)
16:05:53 <VikramDham> #info Vikram Dham (QTIP)
16:06:00 <Parviz> #info Parviz Yegani
16:06:07 <zhipeng> #info Howard (Parser,Multisite)
16:06:08 <jose_lausuch> #info Jose Lausuch (Functest)
16:06:21 <fdegir> #info Fatih Degirmenci (Releng)
16:06:26 <simona_> #info Simona Coppola (Intel)
16:06:31 <bin_> #info Bin Hu (IPv6)
16:06:50 <billyoma> #info Billy O'Mahony
16:06:52 <GeraldK> #info Gerald Kunzmann (DOCOMO)
16:06:57 <debrascott> #topic Agenda
16:07:04 <frankbrockners> #info Frank
16:07:09 <frankbrockners> #info Frank Brockners
16:07:09 <ljlamers> #info Larry Lamers
16:07:24 <ashyoung> #info Ashlee Young (onosfw)
16:07:29 <frankbrockners> International dial numbers for GTM don't seem to work
16:07:39 <frankbrockners> rpaik - could you check?
16:09:41 <StuartMackie> #info Stuart Mackie - OpenContrail
16:10:13 <debrascott> #Update CI/Config Files/Genesis
16:10:14 <frankbrockners> #link https://wiki.opnfv.org/genesis/configuration-files-discussion?&#common_config_files
16:11:26 <debrascott> #info config file proposals have been made, 3 have been agreed upon as starting point for each area. Now depends on people putting comments into Gerrit
16:13:32 <debrascott> #note that the files are not finalized, but just a starting point is agreed upon
16:14:17 <trevor_intel> #info Trevor Cooper (Pharos)
16:14:24 <debrascott> #topic installer plugin discussions
16:16:30 <debrascott> #info seems teams are now making progress on plugins
16:17:16 <debrascott> #topic any other blockers toward milestone E??
16:18:15 <debrascott> #info Uli is concerned whether matrix will really allow us to release on Feb 2
16:18:50 <fdegir> if unit test don't exist
16:18:57 <fdegir> are they out?
16:19:10 <fdegir> or the other stuff
16:19:43 <jose_lausuch> http://213.77.62.197/test_projects
16:20:23 <debrascott> #info some test cases are declared in database, but will get a very ugly jason file but progress of tests is not known
16:21:11 <fdegir> +++++++++1
16:21:17 <fdegir> what is our release criteria??
16:21:19 <debrascott> #info What is the criteria for Milestone E; which projects need to provide unit test
16:21:30 <trevor_intel> fdegir: jump servers in PODs 5, 6, 8 will be available tomorrow
16:21:40 <fdegir> standalone projects can pass the milestone, etc
16:21:43 <mbeierl> define "Unit Test"   CI   functional test or project code level self tests?
16:21:46 <debrascott> #info Yardstick will not be ready with all test cases by Milestone E
16:21:59 <fdegir> but the B-release itself
16:22:12 <fdegir> and not just features
16:22:14 <jose_lausuch> http://213.77.62.197/test_projects/<project_name>/cases
16:22:15 <jose_lausuch> example: http://213.77.62.197/test_projects/sfc/cases
16:22:18 <fdegir> we have bunch of other type of projects
16:23:05 <mbeierl> Example from StorPerf: https://build.opnfv.org/ci/view/storperf/job/storperf-merge-master/ shows number of test cases and code coverage.  Does this matter to Brahmaputra?
16:24:00 <fdegir> will the test case failures be taken into account when evaluating release-readiness?
16:24:05 <fdegir> which tests cases are allowed to fail?
16:24:21 <mbeierl> Should be 0, IMHO
16:24:36 <mbeierl> If the test cannot pass, then either fix the code or remove the test :)
16:24:55 <fdegir> mbeierl: this might end up not having any test cases
16:25:03 <fdegir> or having test cases based on what is tested
16:25:07 <fdegir> both are wrong
16:25:25 <mbeierl> Again, define test case in this scenario.  Code coverage or functionality coverage
16:26:24 <mbeierl> fdegir: you are correct in that statement, and my statement is explicitly worded that way to make people think about why the test exists.
16:28:07 <fdegir> I think we must at least match what we released in Arno SR1 in order to release B
16:28:08 <ChrisPriceAB> #info it is important for projects that are going to break features such as HA if you use them to document the limitations of the feature on the release.
16:28:53 <ChrisPriceAB> #info in addition if a feature test case is not able to pass it should not be a documented feature of the release.
16:33:15 <ChrisPriceAB> #link https://wiki.opnfv.org/releases/brahmaputra expectations on projects and capabilities for Brahmaputra
16:34:38 <debrascott> #link https://wiki.opnfv.org/releases/brahmaputra/release_plan
16:38:27 <jose_lausuch> perfect question
16:39:35 <anac1> yes !
16:40:44 <fdegir> which combination we are going to do that exercise against?
16:41:04 <fdegir> for arno, we knew we have os + odl
16:41:08 <fdegir> what we have for b?
16:41:59 <mbeierl> "if a feature test case is not able to pass it should not be a documented feature of the release." - what about if a feature doesn't have a test case it should not be a documented feature? :)
16:42:21 <fdegir> we need a basic combination
16:42:28 <fdegir> which we have been crying for weeks
16:43:24 <ChrisPriceAB> Hay mbeierl, on the page https://wiki.opnfv.org/releases/brahmaputra it states that for a feature to be release in Brahmaputra it must be verified.  That means a repeatable test case proving it.
16:44:57 <mbeierl> awesome!
16:57:38 <fdegir> trevor_intel: thanks trevor_intel !
16:57:57 <fdegir> looking forward to get my hands on them
17:00:28 <uli-k_> Sorry, need to drop out now....
17:01:16 <debrascott> #info continue test discussions this week in Pharos and Test meetings
17:01:22 <debrascott> #endmeeting