14:30:34 #startmeeting release daily sync 14:30:34 Meeting started Fri Sep 19 14:30:34 2014 UTC. The chair is gzhao. Information about MeetBot at http://ci.openstack.org/meetbot.html. 14:30:34 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 14:30:34 The meeting name has been set to 'release_daily_sync' 14:30:54 #topic roll call 14:31:07 Please #info in 14:31:15 #info gzhao for release 14:31:48 #info Phil Robb 14:32:09 * regXboi parachutes in 14:32:13 #info colindixon for TTP 14:32:51 #chair colindixon edwarnicke 14:32:51 Current chairs: colindixon edwarnicke gzhao 14:32:53 * colindixon notes that we *really* need to add a #rollcall command that records just the rollcall all in one place so we can get started whenever 14:33:07 * colindixon adds it to his list of things to add to the meetbot 14:33:19 colindixon: your meetbot fu is that strong? 14:33:37 #info Hideyuki for VTN 14:34:00 regXboi: only one way to find out? 14:34:00 #info regXboi for general mischief and gadfly-ness 14:34:12 #info thomas packetcable 14:34:49 give one more minute for people to info in 14:36:02 #info abhijitkumbhare for OpenFlow plugin (on another meeting same time) 14:36:40 #topic autorelease 14:36:56 do we have rep from bgpcep 14:37:07 #info paulq for sfc 14:37:24 https://jenkins.opendaylight.org/odlautorelease/job/autorelease-helium-worker/ 14:37:32 it seems as though the auto-release is failing the last two runs 14:37:54 https://www.irccloud.com/pastebin/8oj2sfr5 14:38:16 it seems failed at bpgcp 14:38:40 #info alagalah for GBP 14:38:43 #info edwarnicke 14:38:49 #info oflibMichal 14:38:55 Apologies... I was distracted investigating the autorelease failure 14:39:00 #link https://jenkins.opendaylight.org/odlautorelease/job/autorelease-helium-worker/ the last two auto-releases (58 and 59) have failed at BGPCEP 14:39:17 edwarnicke: gzhao My apologies, tbachman has inexplicably gone offline so I think he may have Interwebs failure 14:39:34 gzhao: The nightly did build successfully though, and has been added here: https://wiki.opendaylight.org/view/Karaf:Step_by_Step_Guide#Download_the_RC 14:39:39 #link https://wiki.opendaylight.org/view/Karaf:Step_by_Step_Guide#Download_the_RC 14:40:02 #undo 14:40:02 Removing item from minutes: 14:40:05 nightly build RC1-3 was successfully push to nexus 14:40:29 #link https://wiki.opendaylight.org/view/Karaf:Step_by_Step_Guide#Download_the_RC the nightly build (RC1-3) did build successfully and can be downloaded here 14:41:04 alagalah: no problem 14:41:17 gzhao: Could you pause the test runs while I investigate so that I don't loose the workspace to one? 14:41:48 edwarnicke: have you pinged rovarga or do we think it’s an issue with autorelease and not bgpcep? 14:42:21 colindixon: I actually don't think this is bgpcep's issue 14:42:30 colindixon: So here's whats' weird 14:43:12 #link https://jenkins.opendaylight.org/odlautorelease/job/autorelease-helium-worker/59/console complains it can't find artifact org.opendaylight.controller:sal-dom-xsql:bundle:1.1-Helium-RC1-v201409191037 14:43:25 it is a failure in controller 14:43:48 #link https://jenkins.opendaylight.org/odlautorelease/job/autorelease-helium-worker/ws/.m2repo/org/opendaylight/controller/sal-dom-xsql/1.1-Helium-RC1-v201409191037/ and yet here is that artifact in the m2repo for the workspace 14:44:19 colindixon: rovarga Can you double check me here that I'm not crazy? 14:44:29 Because it looks like its complaining about an artifact that is *present* 14:45:05 [ERROR] MavenReportException: Error while creating archive: 14:45:12 Exit code: 1 - /opt/jenkins-odlautorelease/workspace/autorelease-helium-worker/controller/opendaylight/md-sal/sal-dom-xsql/src/main/java/org/opendaylight/xsql/XSQLProvider.java:5: error: cannot find symbol 14:45:16 import org.opendaylight.yang.gen.v1.http.netconfcentral.org.ns.xsql.rev140626.XSQL; 14:46:04 rovarga: yes, that is the error shown in auto-release 14:47:40 note that this is javadoc:aggregate 14:47:50 and since xsql's javadoc failed 14:48:01 it cannot pull in the appropropriate jar 14:48:53 so once xsql passes javadoc, so will bgpcep 14:49:20 rovarga: Ah 14:49:30 rovarga: ok, need research more which change cause this 14:49:38 #info rovarga notes that it appears as though xsql’s javadoc build is failing which is why bcpcep can’t find the jar and so fixing that should fix the auto-release 14:49:48 anything else we need to cover on auto-release? 14:50:44 rovarga: Any other hints gratefully accepted 14:51:12 #info tbachman for groupbasedpolicy 14:51:28 tbachman: -:) 14:51:33 welcome! 14:51:37 sorry folks! 14:51:39 back :) 14:51:46 my IRC client was out to lunch :( 14:51:48 edwarnicke and rovarga, can I #action you two to work on this? 14:51:50 had to go off VPN 14:52:16 colindixon: I think its fair to action me 14:52:34 colindixon: I would be hesitant to punish rovarga 's kindness by putting that monkey on his hack :) 14:52:36 back 14:53:01 #action edwarnicke to work on resolving the auto-release issue with the new information from the bgpcep team 14:53:13 note not mentioning rovarga by name so that he isn’t actioned 14:53:19 gzhao: next topic? 14:53:30 #topic RC2 release 14:54:03 #info we’re planning to cut RC2 artifacts on Monday 9/22 at 5p pacific (that’s midnight UTC between 9/22 and 9/23) 14:54:10 For final release cut set on Monday, any project see any issues 14:54:35 #info the TSC has said that those artifacts will be the Helium release artifacts unless there are any show-stopping issues 14:54:47 ^^^^^ THAT IS A BIG DEAL ^^^^^ 14:55:10 colindixon: Could you say that louder! :) 14:55:23 edwarnicke: if I could figure out how on IRC, I would 14:55:38 current three projects in yellow are: integration, ovsdb and pcmm 14:55:51 colindixon: you need to add #shout 14:56:37 * tbachman is sorry for joining the party late 14:57:09 were there issues brought up with RC1-3? 14:57:15 tbachman, hideyuk__, xsited, abhijitkumbhare, paulq_, alagalah, oflibMichal, edwarnicke, gzhao, phrobb, regXboi (everyone that’s #infoed in) please note that we are planning to use RC2 artifacts for Helium release unless any major issues are found 14:57:28 that’s a good shout :) 14:57:50 there are a lot of projects not update https://docs.google.com/spreadsheets/d/1PYxjiSYEks44uJByVO1P44rnI5xTJRulpKyrSsDQF9g/edit#gid=1751723309 14:57:56 I’ve currently found 2 NPEs in RC1-3 :( 14:58:01 colindixon: OK. 14:58:01 #info edwarnicke understands that the RC2 artifacts scheduled to be cut Monday Sept 22 at 5pm PST will be used as release artifacts unless a show stopper is uncovered 14:58:06 we would need their karaf feature testing status 14:58:13 tbachman: You are a testing machine! 14:58:14 colindixon: you do need #shout 14:58:19 lol 14:58:26 breaking machine is more like it 14:58:32 #action gzhao to send a mail to release saying that RC2 artifacts are going to be release artifacts 14:58:41 #undo 14:58:41 Removing item from minutes: 14:58:59 #action gzhao to send a mail to release saying that RC2 artifacts are going to be release artifacts including instructions to update the testing doc 14:59:32 so, yeah, I don’t know how else to yell about this? 14:59:39 I could #agreed it so it’s more bold in the notes 14:59:47 but people aren’t going to read the notes 15:00:18 I think we’re going to have just try to get acks today and over the weekend 15:00:26 Suffice it to say: go scream it at your friends 15:00:37 Could folks #info in their acks as I did above? 15:00:59 gzhao: maybe it makes sense to add a box to the testing spreadsheet for projects to ack it? 15:01:38 ack edwarnicke 's info to make sure everyone is on the same page? 15:01:51 tbachman, hideyuk__, xsited, abhijitkumbhare, paulq_, alagalah, oflibMichal, edwarnicke, gzhao, phrobb, regXboi (everyone that’s #infoed in) please #Info an ack of the fact that we’re planning to make RC2 artifacts the Helium release barring show-stopping bugs 15:02:19 #info /me acks 15:02:28 ack colindixon - will need to take a look 15:02:28 #info colindixon acks that he understands RC2 artifacts (cut Monday at 5p pacific) will be release artifacts barring show stoping bugs 15:02:28 #undo 15:02:29 Removing item from minutes: 15:02:35 #undo 15:02:35 Removing item from minutes: 15:02:42 #info colindixon acks that he understands RC2 artifacts (cut Monday at 5p pacific) will be release artifacts barring show stoping bugs 15:02:43 #info regXboi acks (not sure why - i'm only here for mischief :) ) 15:02:50 #info gzhao acks 15:03:07 #info +1 / ack 15:03:12 #info ACK 15:03:12 not my day on IRC :( 15:03:16 what are we acking? 15:03:18 edwarnicke: ACs regXboi 's mischief :) 15:03:21 * tbachman_ keeps dropping off :( 15:03:35 tbachman: “colindixon acks that he understands RC2 artifacts (cut Monday at 5p pacific) will be release artifacts barring show stoping bugs” 15:03:56 #info tbachman acks that he understands RC2 artifacts (cut Monday at 5p pacific) will be release artifacts barring show stoping bugs 15:04:03 sweet 15:04:16 ok, I mean, the next thing is to hunt people down via e-amil and IRC 15:04:20 which is all we can do 15:04:35 * edwarnicke casts about for his spear and face paint 15:04:36 and we’ll probably have to re-cut again on Tuesday, but we can hope 15:04:48 * edwarnicke is more hopeful that colindixon 15:04:48 * colindixon is ever the optimist 15:04:57 ok 15:05:00 #info Hideyuki acks that he understands RC2 artifact will be release artifacts barring show stoping bugs 15:05:03 thanks! 15:05:17 edwarnicke: I think we are pretty likely to get a good image out of RC2... I may be up all night fixing small issues in build... but I think we will get a good image 15:05:22 #topic project status reports/issues 15:05:31 any projects have issues that they want to bring up 15:05:41 #info groupbasedpolicy is seeing two NPEs 15:05:41 I know that VTN is likely still working on things, how is that going hideyuk__ 15:05:47 Was going to see if anyone else has encountered them 15:05:47 or if they’re already known and being fixed 15:06:01 tbachman: do we have bugs? 15:06:02 Luis yesterday mentioned some bug in openflow plugin 15:06:04 not yet 15:06:10 yeah 15:06:15 tbachman_: Which things? 15:06:17 I’ll open them now 15:06:19 tbachman: can we file bugs to track them? 15:06:30 tbachman: many thanks :) 15:06:34 colindixon: will get right on this — and will put the bugs in here :) 15:06:40 thanks 15:06:47 gzhao: we probably want to keep a list of known blocking bugs 15:07:09 colindixon: yes 15:07:32 colindixon: but we need to have bugs reported first 15:07:47 #info VTN project is working on system test failures. https://lists.opendaylight.org/pipermail/vtn-dev/2014-September/000608.html 15:07:57 #undo 15:07:57 Removing item from minutes: 15:08:14 #link https://lists.opendaylight.org/pipermail/vtn-dev/2014-September/000608.html hideyuk__ says VTN project is working on system test failures 15:08:20 it will end up as a link that way 15:08:33 any other projects facing issues 15:08:49 I’m assuming not (or that nobody’s testing) since we haven’t heard anything 15:09:07 #action colindixon to work with gzhao to start making a list of known helium blocking bugs 15:09:26 #action colindixon to work with gzhao to hunt down projects make them fill out the testing spreadsheet 15:09:46 * gzhao is a little surprised no one says anything about 9/22 15:10:00 #link https://docs.google.com/spreadsheets/d/1PYxjiSYEks44uJByVO1P44rnI5xTJRulpKyrSsDQF9g/edit#gid=1751723309 this is the helium testing spreadsheet 15:10:09 * regXboi suspects people are in shock 15:10:15 gzhao: what projects are still in yellow/red? 15:10:27 red: documentation 15:10:28 * regXboi wanders away - back in a few 15:10:39 yellow: integration, ovsdb and pcmm 15:10:56 I think ovsdb probably should be moved to green 15:11:00 here’s one: https://bugs.opendaylight.org/show_bug.cgi?id=1984 15:11:01 have you heard from the yellow projects about why they’re yellow and if they’ll get to green? 15:11:15 #link https://bugs.opendaylight.org/show_bug.cgi?id=1984 one of the NPE bugs reported by GPB 15:11:41 #info documentation is still a project in red (but that is known and unlikely to change) 15:11:49 Madhu: can you confirm that ovsdb is green ( 15:12:14 #info pcmm, integration and ovsdb are currently yellow 15:12:22 and the other https://bugs.opendaylight.org/show_bug.cgi?id=1985 15:12:24 I understand why integration might be yellow 15:12:37 colindixon: initially projects are put in M5 status, and with reduced scope complete Karaf etc, they moved to green 15:12:40 #link https://bugs.opendaylight.org/show_bug.cgi?id=1985 the other NPE bug reported by GBP 15:12:43 #link https://bugs.opendaylight.org/show_bug.cgi?id=1985 the other NPE reported by GBP 15:12:48 #undo 15:12:48 Removing item from minutes: 15:13:12 gzhao: yeah I understand that 15:13:15 I think Madhu might have also seen that first one 15:13:18 in OVSDB 15:13:38 so, Madhu and xsited do you know if pcmm and ovsdb should be moved to green? 15:14:20 #action gzhao to follow up with Madhu and xsited directly about ovsdb and pcmm to figure out if they can be moved to green 15:14:27 gzhao: colindixon we are facing issues with flow programming 15:14:27 #topic blocking issues 15:14:43 so guys.. not sure how folks are moving project to green 15:14:45 #undo 15:14:45 Removing item from minutes: 15:14:52 Madhu: we haven’t 15:14:58 is it okay to move projects to green status even with known issues ? 15:15:01 do you have a link for the bug(s) 15:15:20 colindixon: I think he’s seen the same as 1984 15:15:22 colindixon: yes. we have opened quite a few 15:15:22 Madhu: Karaf feature tested alone and compatibility, testing and documentation are on schedule 15:15:39 Madhu: no blocking issue 15:15:50 Madhu: no, but we’re trying to understand where we’re at in terms of things 15:15:57 so if you have blocking bugs 15:16:01 we’d like to track them 15:16:10 so we can get things together as efficiently as possible 15:16:13 colindixon: gzhao yes. we have blocking issues 15:16:20 Madhu: I got that 15:16:30 we are working actively to debug / fix some of them 15:16:42 #Info Madhu notes that ovsdb is having issues with flow programming (blocking issues), hence being yellow 15:17:00 #info tbachman notes that GBP is having issues with flow programming (blocking issue) 15:17:03 abhijitkumbhare: Do you have any report of issues for OFplugin from OVSDB ? 15:17:19 Madhu: and did you hear that the current plan is to try to use RC2 artifacts (cut on Monday) for Helium release if we don’t have any show-stopping bugs? 15:17:32 colindixon: Madhu having blocking issue is red status 15:17:40 tbachman: Anything other than 1984 and 1985 ? 15:17:43 colindixon: yep. I saw the emails :) 15:17:54 colindixon: Madhu :yellow is documentation and testing behind schedule. 15:17:57 edwarnicke: those are the only ones I have 15:18:08 Madhu: so, if you have bugs with links, gzhao, edwarnicke, and everyone can try to help 15:18:23 tbachman: OK... and how are they blocking flow programming (one looks like a stats issue and the other an issue on switch disconnect at at glance) 15:18:24 gzhao and I are going to keep a list of blocking bugs so that we have some idea of where we stand 15:18:33 tbachman: (not objecting, trying to understand :) ) 15:18:44 guys. the bugs aren't specific to openflowplugin or mdsal or yangtools 15:18:47 edwarnicke: certainly :) 15:18:52 there are bugs in also usage 15:18:57 I seem to miss the last 2 flows on one node 15:18:58 edwarnicke - I don't see any reported bugs from OVSDB to OF plugin at the moment 15:18:59 which are specific to ovsdb as well 15:19:02 58/58 are good on one 15:19:04 i will send u guys the bug id 15:19:06 abhijitkumbhare: Have you had any report of bugs to OFplugin from OVSDB? 15:19:07 but only 56/58 are on the other 15:19:32 edwarnicke: abhijitkumbhare responded above saying “I don't see any reported bugs from OVSDB to OF plugin at the moment” 15:19:34 it doesn’t happen every time, either 15:19:35 edwarnicke: please read my messages agove. 15:19:59 Madhu edwarnicke - are there any blocking issues? 15:20:06 #info Madhu notes that these issues may not turn out to be bugs outside of OVSDB 15:20:15 tbachman: So clearly we need to dig into that, do you have reason to tie those to 1984 and 1985 (asking because I am trying to prioritize getting the flows working, and I am guessing the NPEs may not be related to that) 15:20:24 edwarnicke: abhijitkumbhare we are debugging issues... 15:20:26 Madhu: Thank you for doing the debugging work 15:20:42 Madhu: even so, it would be nice to have (even a really simple one line) bug report for those things so people outside OVSDB can track things as well and maybe help 15:20:42 edwarnicke: abhijitkumbhare it takes time and am here in this meeting when debugging :) 15:20:44 Madhu: How can we help you to make sure that if these are outside OVSDB, they get handled asap? 15:20:56 edwarnicke: yeah, flows are most important. If those bugs are unrelated, am happy to ignore. 15:21:16 tbachman: I don't *know* they are unrelated ;) I was just curious if you knew they *were* related :) 15:21:54 edwarnicke: I need to triple-check, but I don’t believe I see the NPEs when it works (doesn’t happen every time) 15:21:55 tbachman: Which two flows are missing? 15:21:59 colindixon: edwarnicke gzhao abhijitkumbhare we are all working actively on issues... we don't know the exact root-causes. we don't want to file a bug stating "flow programming is broken". it can very well be usage issue 15:21:59 the last two :) 15:22:04 tbachman: That is very useful info 15:22:05 and some are very random 15:22:13 actually 15:22:16 I take that back 15:22:24 I need more runs 15:22:27 to be sure 15:22:29 we will pass on the bug info today once we get somewhere. 15:22:30 Madhu: You have my cell ( 919-621-0958 )... seriously, call me as soon as you know. 15:22:37 since we’re on the topic already 15:22:39 edwarnicke: thanks sir. i will 15:22:41 #topic blocking issues 15:22:42 * tbachman will perform some more debugging 15:22:49 Madhu: also could you ack like “colindixon acks that he understands RC2 artifacts (cut Monday at 5p pacific) will be release artifacts barring show stoping bugs” 15:22:51 tbachman: are u testing in karaf ? 15:23:09 gzhao: ack. 15:23:25 Madhu: thanks 15:23:30 #Info tbachman and Madhu seem to be debugging potentially-related issues around flow programming and will keep people abreast of the issues 15:23:40 colindixon: thanks 15:23:50 #info Madhu acks he understands RC2 artifacts (cut Monday at 5p pacific) will be release artifacts barring show stoping bugs 15:23:52 edwarnicke: 1 clue though 15:23:53 thanks 15:24:04 ChristineH: welcome 15:24:06 when i have a bunch of flows to be programmed in quick succession 15:24:08 so, do we have other blocking issues 15:24:18 the flow programming doesn't fail.. but gets lost somewhere in the jungle 15:24:25 so i had to introduce thread.sleep to make it work . 15:24:32 yep... Thread.sleep(). 15:24:34 #info we have a break in auot-release which edwarnicke is hunting down 15:24:41 I need that sleep... but am giving it to my code 15:24:48 RODL 15:24:52 ROFL even ;) 15:24:54 :-) 15:24:59 any other known blocking issues 15:25:07 Rolling out the door laughing? 15:25:23 ChristineH: did you resolve the issues you found yesterday? 15:25:39 brb guys. busy debugging. ping if it is absolutely needed :). thanks for all the great work colindixon gzhao edwarnicke 15:25:51 ChristineH: just so you know, we are planning to cut RC2 artifacts on monday at 5p pacific (midnight UTC between 9/22 and 9/23) and use them for the helium final release unless there are show-stopping issues 15:25:58 Madhu: thanks 15:26:09 ChristineH: it would be great if you could ack that just so we know that you understand :-) 15:26:11 hi gzhao and all. SNMP4SDN's status is still yellow, because karaf command problem is still not yet solved (but already move forward than yesterday), I think the bug is internal and will be solved soon. Besides, snmp4sdn's MD-SAL is not yet completed. 15:26:38 colindixon: I see. 15:27:15 gzhao: the karaf command can be seen now, just there's other internal bug. 15:27:36 gzhao, ChristineH: what is the issue? 15:28:43 ChristineH: snmp4sdn's MD-SAL is not yet completed? only bug fixing should be done at this stage 15:28:58 colindixon: yesterday ChristineH 15:29:24 colindixon: could see karaf command after installed feature, today it seems to be different issue. 15:29:43 colindixon: s/could/couldn't 15:30:36 #info it appears as though snmp4sdn is having issues with karaf and may or may not be code-frozen 15:31:04 gzhao: that would indicate that the karaf features were blocking while loading 15:31:13 was the integration feature test still working? 15:32:36 colindixon: bundle:list showed it miss some dependency, I think ChristineH 15:32:39 fixed that 15:33:09 gzhao, colindixon: the APIs which are exposed by MD-SAL are frozen, but I didn't have enough time to carefully test the implementation 15:33:27 ChristineH: ah so this is testing 15:34:08 #info ChristineH notes that the the part of the code which isn’t frozen is because of bug testing 15:34:25 ChristineH: please reach out to gzhao, edwarnicke, me or anyone else 15:34:28 if you need help 15:34:48 colindixon: thanks! :) 15:35:00 ChristineH: do you have a bug that can used to track the issue? 15:35:57 gzhao: not yet, but I believe should :) 15:36:04 any other projects have issue or status 15:36:15 meeting time is 6 minutes over 15:36:15 let me post them later. 15:36:24 ChristineH: thanks 15:36:31 #action ChristineH to file a bug around the issues they are facing, she will e-mail gzhao with that info 15:36:43 edwarnicke, gzhao or any other projects have blocking issues? 15:36:49 otherwise, we’l end the meeting 15:37:09 I don't have anything now 15:37:24 ok 15:37:34 thanks everyone! 15:37:39 #endmeeting