14:58:04 #startmeeting OPNFV Pharos 14:58:04 Meeting started Wed Sep 9 14:58:04 2015 UTC. The chair is trevor_intel. Information about MeetBot at http://wiki.debian.org/MeetBot. 14:58:04 Useful Commands: #action #agreed #help #info #idea #link #topic. 14:58:04 The meeting name has been set to 'opnfv_pharos' 14:58:18 #info trevor_intel 14:58:47 Proposals for agenda topics ... 14:59:11 1. Labs for CI resources 14:59:20 2. MAAS PoC update 14:59:28 3. Rls B milestones 14:59:37 4. Jira backlog 14:59:53 #info Fatih Degirmenci 15:00:19 #info Uli Kleber 15:00:20 Please comment on agenda ... what do you think we should discuss? 15:00:53 sounds good. 15:00:56 good to start with 15:01:55 Anybody who can represent MAAS and give us an update? 15:02:14 Lets defer it then 15:02:44 Start with CI resources ... email from Morgan and Fatih? 15:02:59 morgan_orange: ping 15:03:09 fdegir: ping 15:03:31 morgan_orange: can you join the meeting? 15:03:34 pharos 15:03:48 we're starting to talk about the mail you sent 15:03:48 I can but cyril_auboin_ora is here for Orange 15:04:03 ok, welcome cyril_auboin_ora 15:04:05 he will be the orange contributor to pharos 15:04:08 thanks ;) 15:04:21 but I can join this week :) 15:04:21 anyway, I agree with what morgan_orange stated 15:04:22 welcome cyril_auboin_ora: 15:04:30 #info Morgan Richomme 15:04:32 thank you 15:04:47 to summarize what morgan_orange said 15:04:49 #info Pharos wiki page refactored a little bit 15:04:57 we need to know how many pods each lab provides 15:05:04 and what are they purposed for 15:05:15 #link http://wiki.opnfv.org/pharos 15:05:23 are they only available for metal deployment 15:05:33 #info proposal to add columns to have visibility on the number of PoDs and their usage 15:05:40 #info to optimize resources.. 15:05:48 or they can provide resources for other activities such as build, virt deploy, etc 15:06:06 #info it is just a proposal and it is up to the Pharos project to decide to keep them or not 15:06:23 and this is actually inline with what octopus expects/needs 15:06:43 we need to know how a certain slave can be used 15:06:46 As teh Intel lab owner I don't knwo what teh requriemetns are for "other" activities 15:07:02 So I don't know what to offer 15:07:14 an example could be the repurposed LF POD1 15:07:24 we will get 6 servers from POD1 15:07:34 2 of them will be ubuntu and used for builds 15:07:59 like installer iso builds, verify jobs that do builds such as vswitchperf 15:08:22 the rest of the servers, 4 of them, are centos and will be used for virt deployments 15:08:40 so these are the types of activities we need resources for 15:08:47 And who has access to them? 15:08:50 single/standalone nodes 15:08:56 only ci 15:08:58 #info daniel smith 15:09:02 for the ci stuff 15:09:10 so practically, Intel POD2 (if no more used by redhat team to be confirmed) could be used for CI activities 15:09:12 and ci people to install needed tools, packages etc 15:09:24 Yes that is fine 15:09:58 trevor_intel: does this mean we can break the pod down and connect each server seperately yo jenkins? 15:10:08 to opnfv jenkins I mean 15:10:12 But I feel Octopus should document all the CI requirements for a community lab including support needs 15:10:25 Yes anythign is poissible :) 15:10:35 If we know what is needed 15:10:59 trevor_intel: https://wiki.opnfv.org/pharos_rls_b_spec#ci_requirements_for_pharos_labs 15:11:07 We haev 6 PODs and only 4 are being used ... and we are building another 3 15:11:08 these are the initial requirments 15:11:39 we can add more/concrete reqs if we're allowed to grab one of the pods 15:12:12 like os, storage, connectivity, etc needs 15:13:23 Ok that makes sense ... I propose that you take a POD and document requiremetns as it evolves ... other labs can use that to setup a "CI POD" too 15:13:31 i think that you wont be able to define the POD requirements 15:13:32 trevor_intel: who should we contact in order to take the pod? 15:13:39 is it you or someone else? 15:13:44 you will only be able to define the requirements for the Hook in node (the Jumphost/GW) 15:13:55 lmcdasm: these are standalone servers 15:13:59 ahh.. ok 15:14:02 sorry :) 15:14:03 to be used for builds, etc 15:14:07 gotcha :) 15:14:08 like ericsson-build 15:14:11 apologies 15:14:11 :) 15:14:11 Only 1 network needed? 15:14:14 (i came late) 15:14:14 np 15:14:25 trevor_intel: yes 15:14:33 since only virt deploys will run on them 15:14:58 or builds 15:15:08 or fw verification activities 15:15:21 for yardstick or other frameworks to run fw functional testing 15:15:27 Please send me an email stating the names of everybody who needs access and any basic requirements ... networks, storage, OS's etc. 15:15:37 trevor_intel: will do, thanks 15:15:44 basically each of your nodes will have a "public IP" 15:15:52 and then inside the nodes all the internals will be loops ont he nodes 15:15:58 so each will have a container network inside 15:16:04 right 15:16:08 for the OS storage reqs - Fatih - are you doing HA 15:16:14 or are you doing different models or?> 15:16:29 you're asking questions that are outside my comfort zone 15:16:33 hehe 15:16:35 ok - no sweat 15:16:41 my point was really that in setting requirements 15:16:42 I'll bug you lmcdasm to identify that type of details 15:16:47 and reqs 15:16:49 we can come up with models 15:16:57 so that you have alot more people that can participate 15:16:57 and then contact to trevor_intel 15:17:00 sounds good 15:17:07 we can detail it later if you are still high level'in it 15:17:09 :) 15:17:27 yep 15:17:39 Enough progress today on CI resource topic? 15:17:47 a queestion 15:17:54 on there (its related to otehr stuff so relevant) 15:18:05 I only answer questions :) 15:18:06 for the CI pipeline are you just doing Jenkins slaving 15:18:22 lmcdasm: that is the 2nd type of Ci resource 15:18:25 or are you going to setup a tunnel between the central Jenkins node as well (if not already in place) 15:18:27 ok 15:18:42 and we need help there to identify the pod setup 15:18:49 ok 15:18:51 cool 15:18:53 we can sort that 15:18:55 so we can hace jumpserver 15:19:01 like the lf pods 15:19:02 ya.. i was thinking (my slides) 15:19:07 about howe we wannt setup the centrla node 15:19:13 connections through F/W / etc. 15:19:16 and how that willwork 15:19:17 stage is yours :) 15:19:19 hehe 15:19:26 hehe 15:19:33 well - trevor is running the meeting 15:19:40 so i dont wanna hijack i t:P 15:19:50 Think we move on, ok? 15:19:53 ya 15:19:54 ha ha 15:19:55 ok 15:20:10 Now do we have anybody from MAAS PoC? 15:20:12 (plus i dont have a solution just yet - some ideas but thats it) 15:20:16 #info. Iben 15:20:22 On my phone 15:20:37 Driving 15:20:48 Iben! 15:20:50 No audio. Right? 15:21:04 Pay attention (to driving) 15:21:09 No audio 15:21:15 Dropping off kids at school. 15:21:20 ya.. dont drive and text 15:21:23 join back after 15:21:25 :) 15:21:36 Will be stopped soon. Okay. Maybe 5 minutes 15:21:37 I rhink Narinder created an etherpad for maas poc 15:21:39 Rls B miletones? 15:21:44 can't find it 15:21:52 https://etherpad.opnfv.org/p/PharosMAASPoc 15:22:16 guess we have to postpone until iben__ comes back 15:22:22 Lest defer MAAS for now ... would ratehr we focus on Rls B 15:22:34 Ok? 15:22:36 Can someone call me in? 4087824726 15:22:56 iben__: There is no audio 15:22:58 iben__: irc only 15:23:16 #topic Rls B planning 15:24:33 Dan Smith's work on milestones? 15:25:11 Any comments? 15:25:59 Dan can you walk us through your proposal? 15:26:35 Do you have a link? 15:27:29 hey there. 15:27:40 sorry - was in a chat in another window 15:27:46 for the PPT i sent around - im going to do some more work on it 15:28:13 but basically for our B-Release it sumamarizes what we discussed last week (uli- i forgot to add you on the list - apologies - maybe someone can send it while i type) 15:28:50 anywa - i think for a realistic goal - the idea is really, in a nut shell, to have a single node (in LF or somewhere) that has some established "tunnels" (i didnt pick any of the tech - that is the first ms - to define the connection reference) 15:28:54 I will send to Uli 15:29:02 to Jumphosts/gateways in each of the communbity labs 15:29:28 we will then have a very basic connection that can tell us something simple (like a IPMI list of hosts) or something that shows what "resources each lab has" 15:29:39 this setup will allow us to grow later and send "commands" to the linked nodes 15:29:48 that can then install installers (foreman, maas, fuel, etc) 15:29:52 or do other things - 15:30:05 but i think for B-release the idea of establishing the requiremnts for a jumphost 15:30:20 some functions that it has to provide (hypervisors, PXE, some tools to ping and vpn, etc) 15:30:39 and defining how we want labs to conncet in a secure manner is a good three document MS we can do crowd sourcing the community and lab owners 15:31:04 and then for a delivrable - if we can have this cental node setup and efined (in LF - can be a VM even) and some links to a lab (say Trevors and ours) in a srecure way as a template 15:31:21 +1 to these things 15:31:23 jsut a node 15:31:24 that would be something pretty good (and ill make the cheesy page that shows the connections and a healthcheck - ping to the "connectedlabs) 15:31:39 Jenkins doesn't connect to labs directly 15:31:40 its not fancy, but if we do the plumbing right it will allow extension for otehr to use the links later 15:31:45 instead, jumphosts connect to jenkins 15:31:54 right 15:32:00 to simplify a bit 15:32:01 so the gateway/jumphost could be a jenkins slave 15:32:05 yes 15:32:05 could be running and installer 15:32:08 could be doing both 15:32:17 the idea is really to make the workload agnostic 15:32:29 Jenkins has a time sync page that's nice for the slaves. 15:32:36 that's the setup we have for LF POD 15:32:39 but make the link and hookup flexi enough to allow jenkins or installers or whatever to eventually "send orders" to labns to do "things" 15:32:43 And we are doing an ipv6 dashboard too. 15:32:49 swett.. we can use that as a model Iben 15:32:55 cool.. send it along and we can see 15:33:12 im completely fine with stealing UI and css from jenkins pages ;P 15:33:22 IPv6 we just want to piggy back on existing dashboard. 15:33:38 Do we all agreew with this as our theme for rls b ... "Connected community labs with visible capability and deployment/usage monitoring"? 15:33:47 For jenkins the functionality you want may already be there. 15:34:04 Just scrape the data 15:34:11 trevor_intel: +1 15:34:17 It's already monitoring lab connectivity. 15:34:26 iben__: I can do magic when the labs are connected to jenkins 15:34:35 we don't need to mess around with jenkins dashboard 15:34:44 but if we can't get anything setup 15:34:47 we fallback to it 15:35:15 Jenkins dashboard doesn't tell much other than its connected? 15:35:18 So this new dashboard is to be independent to that? 15:35:22 Iben - its monitoring the connectiivty 15:35:26 Time sync also 15:35:37 but it doesnta llow for the command line / HW level processing and order we will want to send to the gateway/jumpshost 15:36:02 i would like to steer way form locking ourselves into using a Jenking slave approach for all lab orders we want to send .. im not saying later that we cannot 15:36:14 Gotcha 15:36:17 Good idea 15:36:24 but i would like to leave it open and small for now - i think that a applicatino free link between labs (and Jenkins over top) is a good goal for now 15:36:50 but again - just me 15:37:19 if we all say ' - well thats not that fancy cause jenkins has all the labs connected and we want to pursure Jenkins at the lab central node" then im fine with it too :) 15:37:51 lmcdasm: I agree with milestone list 15:38:01 but I think developer usage specific milestone is missing 15:38:05 on slide 6 15:38:11 all of them are named CI 15:38:54 do we want to follow which labs are used/providing developer resources? 15:38:55 ya - 15:38:58 i didnt try DI usage 15:39:02 cause i wasnt sure how far to go 15:39:04 :) 15:39:06 :) 15:39:13 and the other comment is 15:39:14 i think that its going to be hard to define a stanard for DI role 15:39:20 cause people are going to use their labs for what they want 15:39:28 please feel free to change the stories created in JIRA 15:39:39 and put the stories you defined on slides 15:39:43 i do think that its important that the CI role when people understand is to really give up HW and let it be under the central node command 15:39:55 yep 15:39:58 hehe - i cant "change" anything in JIRA (open ticket :P). 15:40:03 :( 15:40:17 so i think that one of the tricks with this setup - is that we need to really be careful to explain about commitment of resources. 15:40:36 since it will be a pain int he ass to setup something and then when the person says i wanna try something else - tear down the setup 15:40:42 we cant avoid ti - but we can communicate about it :) 15:41:45 yep 15:42:21 We need a template for each lab to fill that includes resource commitments and then make it visible through the dashboard 15:42:45 #info Iben Rodriguez - Spirent - now on laptop 15:43:03 Ok so next steps for miletones? 15:43:11 by resources do we mean people or hardware? 15:43:20 or both? 15:43:34 both IMO 15:43:42 also - typical sla - response time expectations would be nice 15:43:57 some labs are really run as a “best effort” basis with minimal expectations 15:44:05 I think we need more than a template. 15:44:13 others are fully staffed around the clock 15:44:23 Lab resources might change over time - hopefully only in one direction. 15:44:25 uli-k: yes template is bare minimum 15:45:05 The dashboard is our tool to provide some accountability 15:45:18 agreed 15:45:34 we also need to, i think, provide some options ot people - as stated, we have low-end labs and high-end labs 15:45:39 OK so the data from the template will be put on the dashboard? 15:45:48 i think that if we are to provide a category of CI lab types (doesnt have to be alot) 15:46:00 but i think lumping everytone's lab together to find a common ground might be tough 15:46:31 also there are many “private” labs being used for OPNFV testing and development with different projects 15:46:55 we should give a way for them to be listed but acknowledge that they are not publicly accessable (yet) 15:47:06 its a good point 15:47:09 this way we encourage companies to open their labs 15:47:13 Yes. 15:47:19 what is the scope here - all labs involved in OPNFV, CI labs, ? 15:47:45 so we list them on the Dashboard and have a "private" labs (rather than "CONNECTED/ONILNE/DOWN" beside their name on the dashbard 15:47:50 that works for me 15:47:52 for me showing what others are doing helps gain approval for funds from mgmt and execs - the pharos page is great for this now 15:47:53 uli-k: In teh extreme the dashbopard shows that you are meeting your SLA or there is a gap ... we shoudl accomodate any scale of lab or level of access but just want to know reality from marketing story 15:48:16 and the kenkins slave page show the current reality of what’s really being tested now 15:48:16 so self-defining SLA? 15:48:18 +1 15:48:26 how people book those labs? 15:48:30 in the template we have the person outline their own metrics (servers available, etc) 15:48:34 don't we have something called booking system? 15:48:36 (fatih - not decided yet) 15:48:41 ok 15:48:50 i would think we get em connected and then work on a booking system 15:48:59 There is no bookign system yet 15:48:59 there are lots of OTS stuff (Osource) we can look at 15:49:06 then it means those private labs are not private 15:49:27 What is a private OPNFV lab? 15:49:28 depending on what we want to see / do and how we want to work the "public bookings " (say from a project that wants a specifci run of something) to regular runs / build pipeline 15:49:28 they'll be shown somewhere, up/down/booked 15:49:48 and will be possible to book them when the booking system is in place 15:49:48 Lets define that ... its not clear to me 15:49:51 well - for the ones that re private .we list em and they are just staic on a page until it changes i would think 15:50:01 (booking system could be an etherpad to start with) 15:50:03 Depending on our definition all labs are now private.... 15:50:08 agreed - i think a whole session coule be devoted to booking system 15:50:15 true Uli! 15:50:34 since everyone has the ability to trump / take down / up / no sla / etc at any time 15:50:41 I remember people saying all lab usage should go through jenkins. 15:50:49 so they are private - plus there is no control from central point - maybe these are how we define private? 15:50:52 uli-k: no thery are not ... labs being used for community projects are not private 15:50:55 i took private lab thingy from iben s message 15:51:56 uli-k: putting jenkins into developer purposed labs is not really necessary 15:52:12 i sort fo think as jenkins as a booking system 15:52:28 but if a lab is shared between ci and developers than that's valid 15:53:03 if you need to do a manual task you can “borrow” or book or request some hardware capacity - but the end goal is to get a test running in jenkins in your (my) lab 15:53:23 from there the test can be promoted to the LF core infra 15:55:37 Ok lets get back to miletones for Rls B ... what are next steps? Dan? 15:55:39 BTW - JOID project meeting starts in 5 minutes - there we will discuss mostly MaaS POC for Pharos 15:55:59 Ahh ok 15:56:02 basically the setup in intel and spirent lab with central controller running in LF on a VM 15:56:06 I need to drop off in 4 min 15:56:14 who can get us an ubuntu VM on LF hardware? 15:56:25 i can make the request 15:56:31 sweet - 15:56:35 however, i would like a change to refine the requirements of our Central node 15:56:45 do you have time to join next call in 3 minutes? 15:56:52 since do we know exactly what we want for example - its easy from OS up 15:56:55 but we need to think about networking 15:57:04 we just need a simple machine with 1 network 15:57:07 actually - im home sick and fever - so im gonna logoff after this 15:57:13 well thats not true Ibe 15:57:15 okay - no worries - 15:57:25 we have to think about connecting lots of different machine via a secure method 15:57:44 i may put the POC centrall controller in Spirent to allow it to be open to internet and have ipv6 to start off with 15:57:45 so a single NIC migth not be the way (what happens when we have two remote nets using the same subnet for example - then our node is screwed) 15:57:53 when other labs have ipv6 they can use that then. 15:58:02 anyway - gimme an action to work with iben for next week 15:58:08 to define the "CENTRAL" NODE" in the LF 15:58:11 this is jsut an admin ui server vm 15:58:14 for what we need trevor 15:58:26 it sends jobs to the remote lab machines over the internet 15:58:28 well iben - i think we are talking maybe about two differne things 15:58:36 just like jenkins master machine - it’s a vm - right? 15:58:36 and i dont know if you saw my milestone slides 15:58:39 cause its not that simple 15:58:40 no 15:58:41 its not 15:58:44 that what we have bveen saying 15:58:48 we are going to setup IP level links first 15:58:50 oh wow - ok - that’s nuts 15:58:51 action MAAS PoC ... Dan Smith "define the "CENTRAL" NODE" in the LF" 15:58:55 then youc an run jenkins slaves or something else over it 15:59:01 so that its not a single purpose link to the labs 15:59:09 is there good docs on how the jenkins machine is setup? 15:59:09 anyway - its fresh and new and we need more discussion 15:59:10 :) 15:59:14 #action MAAS PoC ... Dan Smith "define the "CENTRAL" NODE" in the LF" 15:59:25 we might just copy that setup eventually if we like that as a best practice 16:00:00 wait wait 16:00:19 nvm.. we are outo f time 16:00:20 no sweat 16:00:22 we will sort it out 16:00:53 * fdegir thinks we shouldn't mix jenkins with all the maas discussions 16:01:01 I am going to end teh meeting now ... thanks everybosy . Dan ... hope you feel better soon! 16:01:33 #endmeeting