16:03:33 <arturt> #startmeeting JOID weekly 16:03:33 <collabot`> Meeting started Wed Jul 6 16:03:33 2016 UTC. The chair is arturt. Information about MeetBot at http://wiki.debian.org/MeetBot. 16:03:33 <collabot`> Useful Commands: #action #agreed #help #info #idea #link #topic. 16:03:33 <collabot`> The meeting name has been set to 'joid_weekly' 16:03:43 <arturt> #info Artur Tyloch 16:03:50 <durschatz> #info Dave Urschatz 16:03:53 <narinder> #info Narinder Gupta 16:04:10 <arturt> #link https://etherpad.opnfv.org/p/joid 16:04:15 <arturt> #topic agenda 16:04:24 <StuartMackie> #info Stuart Mackie 16:07:32 <arturt> #topic Colorad release status update 16:08:56 <arturt> issues with 1.25 , fix expected in 1.25.6 16:15:34 <arturt> #link https://jira.opnfv.org/browse/JOID-61 16:24:13 <catbus1> http://summit.juju.solutions/ 16:31:32 <arturt> #topic OpNFV Summit Berlin and ODS plans 16:35:45 <arturt> #topic JIRA Issues 16:37:49 <arturt> #link https://jira.opnfv.org/browse/JOID-88 16:40:09 <arturt> #link https://jira.opnfv.org/browse/JOID-80 16:41:14 <arturt> #link https://jira.opnfv.org/browse/JOID-77 16:44:43 <arturt> #link https://jira.opnfv.org/browse/JOID-65 16:52:10 <arturt> #info we will skip next week JOID meeting 16:40:24 <iben_> Hola 19:14:08 <narindergupta> zahra_jahedi, lets do it as we type 19:14:21 <narindergupta> lets change the power parameter of the bootstrap node 19:14:27 <narindergupta> click on bootstrap node 19:51:28 <narindergupta> jmorgan1, whenever you are back pod6 seems to be ok except creating gateway 10.6.15.254 19:51:59 <narindergupta> jmorgan1, but node 6 in pod5 is not pxe booting from admin network. If you can have a look would be great? 14:26:22 <narindergupta> durschatz, zahra_jahedi do we know whether cengen community lab is connected to jenkins or not? 16:03:59 <durschatz> narinder: I believe as of this morning the answer is YES. At least Faith was able to produce https://build.opnfv.org/ci/job/pod_test/95/console 16:04:42 <durschatz> Daniel who did the work on our side will not be back in the office till Monday. 16:11:26 <narindergupta> durschatz, ok do we know which installer will be using this pod. 17:06:46 <durschatz> narinder: it will be joid 17:09:42 <narindergupta> durschatz, ok if everything is ok then we can do a dry run today and how does it perform? 17:11:19 <durschatz> Is this dry run to help Zahra with her work? 17:12:47 <durschatz> The issue with the bootstrap KVM is happening on that POD 18:31:22 <narindergupta> durschatz, we can try using it for C release itself as latest code is more stable specially with nonha mode 18:31:55 <narindergupta> ha mode gets install but ssh into the unit through floating ip have few issues 18:33:33 <durschatz> narinder: Do you have time for a quick call? 19:55:54 <durschatz> narinder: We'll need to wait till Monday to discuss further. 19:57:48 <narindergupta> sure no problem 13:25:56 <rprakash1> #info rprakash 13:52:29 <rprakash1> link https://gerrit.opnfv.org/gerrit/#/settings/ssh-key 01:57:57 <yuanyou_> narindergupta: ping 14:32:28 <fdegir> ci stuff will be voted during infra meeting 14:32:35 <fdegir> feel free to join 14:32:38 <fdegir> https://wiki.opnfv.org/display/INF/CI+Evolution#CIEvolution-WayForward 17:37:07 <bryan_att> narindergupta: ping 15:18:47 <bryan_att> narindergupta: ping 17:04:30 <bryan_att> narindergupta: ping ping! 12:32:23 <narindergupta> yuanyou_: hi 12:32:43 <narindergupta> bryan_att: i was on vacation just rejoined today 12:32:58 <narindergupta> fdegir: sorry i was on vacation last week 12:36:52 <fdegir> narindergupta: welcome back 12:37:02 <fdegir> narindergupta: it was about changes to CI-stuff 12:37:12 <narindergupta> fdegir: thanks ok no problem 12:37:19 <fdegir> narindergupta: and I started doing updates to joid jobs 12:37:20 <narindergupta> how did the vote went? 12:37:20 <fdegir> narindergupta: https://gerrit.opnfv.org/gerrit/#/c/17033/ 12:37:31 <narindergupta> fdegir: yeah i saw the requesy 12:37:46 <fdegir> narindergupta: voting passed but it was just for reference purposes 12:38:02 <narindergupta> fdegir: ok gotch you. 12:38:10 <fdegir> narindergupta: and I basically send changes to installer projects and if you/they accept, they get implemented 12:38:19 <fdegir> narindergupta: if not, then I can't do much 12:38:34 <fdegir> narindergupta: btw, as explained in the patch 12:38:40 <fdegir> narindergupta: nothing changes for joid as of yet 12:38:54 <fdegir> narindergupta: will ping you once we get the basics in place and before activating anything for real 12:39:08 <narindergupta> fdegir: sure i would love to try 12:39:15 <fdegir> narindergupta: happy to heart 12:39:17 <fdegir> hear 12:39:22 <narindergupta> fdegir: :) 12:39:56 <fdegir> narindergupta: please review/comment that patch whenever you finish more important stuff you might have in your mailbox 12:40:42 <narindergupta> fdegir: yeah i have week backlog and working on clearing it one by one 12:41:16 <fdegir> good luck 12:54:18 <virginie___> hi all, I am trying to boot ubuntu VM using iPXE with MaaS without success. The error is "no bootable device" 12:55:55 <virginie___> does anyone already have this issue ? 13:02:19 <narindergupta> virginie___: usually jois take care of creating a VM and adding into MAAS for bootstrap. And we are not observing such issue during deployment. how exactly you are using joid? 13:09:11 <virginie___> Maas created the bootstrap VM, but nothing has been installed 13:09:33 <virginie___> the Vm is blocked at the startup and said that "there is no bootable device" 15:03:12 <narindergupta> virginie___: looks like you MAAS is not setup for pxe boot correctly. 17:13:34 <narindergupta> bryan_att: bryan looks like we are finding issue with congress charm now i am facing this issue. congress/0 error idle 1.25.6 1/lxc/1 10.6.1.83 hook failed: "identity-service-relation-changed" for keystone:identity-service 17:13:51 <narindergupta> bryan_att: can you have a look into it please? 17:16:07 <bryan_att> narindergupta: I guess you were ooo last week. I am having issues with getting JOID installed. Persistent errors with the ceph charm is blocking install. I need your help to address that issue first, so I can get the system deployed to debug the congress issue. 17:16:56 <narindergupta> bryan_att: yes i was OOO to cancun mexico 17:17:06 <narindergupta> has nice vacation 17:18:05 <narindergupta> today i back to work. yeah ceph charm issue is resolved now. I worked with openstack charmers team today and fix is available now at the charm. 17:18:46 <bryan_att> narindergupta: thanks, I'll try again. 17:18:58 <narindergupta> bryan_att: :) 17:20:27 <narindergupta> bryan_att: looks like congress data base sync command is failing. http://paste.ubuntu.com/19922765/ 17:20:48 <narindergupta> bryan_att: i can provide you my intel pod for debug if you are interested. 17:24:43 <bryan_att> sure, send me the login credentials by email and I'll go there to debug 17:25:01 <bryan_att> I have VPN access to the Intel lab 17:25:55 <narindergupta> if you vpn access then ssh into 10.2.117.107 17:26:07 <narindergupta> as jenkins user 18:13:57 <durschatz> narinder bryan_att: I had the same issue with JOID ceph charm. Since I need a quick NFVi I temp switched to a different installer. Please let us know when JOID is working again. 18:14:23 <durschatz> Also welcome back Narinder! 18:14:35 <narinder> durschatz, currently ceph issue have been fixed asif afternoon 18:14:53 <bryan_att> narindergupta: can you send me the jenkins account password? 18:14:54 <narinder> currenly congress is broken and working with Bryan to fix it 18:15:07 <durschatz> Great! OK. 18:15:12 <narinder> give me your public key i will add it to user account 18:15:32 <narinder> i think i disabled the username / password access onyl key based in believe 18:15:52 <narinder> bryan_att, if not try jenkins as password it seld\f 18:17:47 <narinder> bryan_att, looks like automatic build started on that pod let me try pod5 18:18:29 <bryan_att> narinder: ok, just found that out - "juju ssh congress/0 " doesn't work 18:20:05 <narinder> bryan_att, beacsue automatic build started 18:20:17 <narinder> wait for 30-45 minute you should see the error 19:37:33 <narinder> bryan_att, pod5 i am seeing the same issue 19:37:49 <narinder> bryan_att, you can ssh into it using 10.2.117.91 19:38:00 <narinder> same user jenkins and same password 19:40:25 <bryan_att> ok, I'll check it out 19:44:11 <narinder> bryan_att, thanks 20:34:52 <bryan_att> narinder: looks the database connection parameter in congress.conf did not get set correctly. Not sure why or how this gets set in the charm design but I will look into it. Is gnuoy available to help debug? https://www.irccloud.com/pastebin/OdbLSnRS/ 20:35:40 <narinder> bryan_att, please check on #openstack channel someone or other should be available. 20:36:22 <narinder> bryan_att, may be some api got changed in layer might impacting you 20:37:04 <narinder> bryan_att, we can refer other charm how its done there but need to check which is connected to mysql 20:42:54 <bryan_att> narinder: how do I know what charm was used to install congress? 20:44:09 <narinder> bryan_att, i was looking into reactive charm for other charms it seems not there only one used is openvswitch-odl 20:44:47 <narinder> but that charm do not have 20:44:49 <narinder> code 20:45:22 <narinder> in congress charm we have template and template value placed is shared.uri 20:45:31 <narinder> but not getting how charm will get it 20:48:37 <narinder> ongress/templates/parts/section-database has URL string 01:54:53 <yuanyou_> narindergupta: hi 02:52:18 <narindergupta> yuanyou_: hi how r u? 02:52:53 <yuanyou_> narindergupta: hi 02:53:18 <narindergupta> yuanyou_: can u tell me the changes neeeded in joid to integrete nsh 02:53:59 <yuanyou_> narindergupta: yeah, I had add profile named "onos-sfc" in charms openvswitch-onos,neutron-gateay 02:54:51 <yuanyou_> narindergupta: lp:~zhangyuanyou/onosfw/openvswitch-onos 02:54:57 <narindergupta> yuanyou_: neutron-gateway why in neutron gateway? 02:55:04 <yuanyou_> narindergupta: lp:~zhangyuanyou/onosfw/neutron-gateway 02:55:32 <yuanyou_> narindergupta: because neutron-gateway installed openvswitch 02:55:57 <narindergupta> yuanyou_: no neutron-gateway does not install openvswitch 02:56:14 <narindergupta> yuanyou_: openvswitch-onos does 02:56:34 <narindergupta> yuanyou_: but onos is not ovs dependent correct? 02:56:52 <yuanyou_> but i saw it has install-packages include "openvswitch" 02:57:25 <narindergupta> that is only if neutron-openvswitch charm is installed 02:57:39 <narindergupta> which is subordinate charm 02:58:34 <narindergupta> the way it works is netutron-gateway will independent then we can integrate with any SDN 02:59:06 <narindergupta> if gateway is provided by SDN then no need to deploy neutron-gateway charm 02:59:20 <narindergupta> individual SDN gateway can be deployed 02:59:23 <yuanyou_> narindergupta: that's fine ,I can remove it from neutron-gateway 02:59:52 <yuanyou_> narindergupta: so I can only add onos-sfc to openvstich-onos 02:59:57 <narindergupta> yuanyou_: i need to know what package you are replacing it with the new patches and which nodes 03:00:14 <narindergupta> how this will get integreted with onos-controller? 03:00:49 <narindergupta> yuanyou_: currently i am using the following charms and location bzr branch lp:~zhangyuanyou/onosfw/onos-controller $distro/onos-controller 03:00:49 <narindergupta> bzr branch lp:~zhangyuanyou/onosfw/neutron-gateway $distro/neutron-gateway 03:00:50 <narindergupta> bzr branch lp:~zhangyuanyou/onosfw/neutron-api-onos $distro/neutron-api-onos 03:00:50 <narindergupta> bzr branch lp:~zhangyuanyou/onosfw/openvswitch-onos $distro/openvswitch-onos 03:01:54 <yuanyou_> narindergupta: i used openvswitch-onos integrated with onos-controller by set-manager 03:02:38 <narindergupta> yuanyou_: ok so no chamged in onos-controller 03:02:43 <yuanyou_> narindergupta: i should install openvswitch 2.5.9 that included nsh-patch 03:03:09 <yuanyou_> narindergupta: yes,no changed in onos-controller 03:03:29 <narindergupta> ok 03:03:57 <narindergupta> yuanyou_: and how are you installing it? Are you building it or using PPA to install? 03:04:20 <narindergupta> and which nodes need openvswitch 2.5.9 ? 03:04:22 <yuanyou_> narindergupta: i used dpkg 03:04:34 <narindergupta> on trusty? 03:04:51 <narindergupta> and it had issue with xenial correct. 03:05:00 <yuanyou_> narindergupta: compute-nodes and neutron-gateway node 03:05:12 <narindergupta> so basically all nodes 03:05:19 <yuanyou_> narindergupta: yes,sfc should run in trusty 03:05:40 <narindergupta> i was just wondering does onos uses openvswitch like odl? 03:05:44 <yuanyou_> narindergupta: yes, all nodes that ran ovs 03:06:39 <yuanyou_> narindergupta: there is some diff in sfc. 03:06:50 <narindergupta> ok that make sense so profile in openswitch-onos will be installed on all nodes and will have relationship accordingly 03:08:18 <narindergupta> yuanyou_: in current relationship openvswitch-onos is not connected to compute nodes only to neutron-gateway 03:09:07 <narindergupta> yuanyou_: sorry my bad its there as plugin 03:10:01 <yuanyou_> narindergupta: i had test in my local env by the above charms. 03:10:03 <narindergupta> yuanyou_: so i need to just enable the profile option in charm bundle correct and use trusty as default option for deployment this is correct. 03:10:50 <narindergupta> can i send me yopur bundle you tested as that will give me clear picture what changes i need 03:11:30 <yuanyou_> narindergupta: ok, i will send you a email about i changed. 03:13:12 <narindergupta> yuanyou_: you can do pastebinit also? 03:15:26 <yuanyou_> https://www.irccloud.com/pastebin/f5foWod7/ 03:16:04 <yuanyou_> narindergupta: this is i defined profile in openvswitch-onos charm 03:16:38 <narindergupta> ok understood and in bundle just define this option correct 03:16:40 <narindergupta> ? 03:17:04 <yuanyou_> narindergupta: that's right 03:17:13 <narindergupta> ok 03:17:37 <narindergupta> in \jenkins jous we need -d trusty 03:17:55 <narindergupta> parameter for sfc with onos deployment then 03:19:18 <yuanyou_> narindergupta:then we should use sed -i -- 's/#profile: onos-sfc/profile: onos-sfc/g' ./bundles.yaml 03:19:36 <narindergupta> yuanyou_: no thats not needed anymoe 03:19:39 <narindergupta> anymore 03:19:53 <narindergupta> we are creating the bundle dynamically now 03:20:10 <narindergupta> change needed in bundles_tpl/subordinate.yaml 03:21:06 <yuanyou_> narindergupta: ok,another question? 03:21:13 <narindergupta> yuanyou_: yeah 03:21:31 <yuanyou_> narindergupta: what's genBundle.py do? 03:22:07 <yuanyou_> narindergupta: it will gen a new bundles? 03:22:19 <yuanyou_> narindergupta: bundles.yaml 03:22:32 <narindergupta> yuanyou_: that will create the bundles.yaml for deployment with juju-deployer during run time based on inputs providede 03:23:12 <narindergupta> we have template for each charm and modify it based on feature requested etc... 03:23:22 <yuanyou_> narindergupta: but there is some problem such as some config option will disappear 03:23:37 <narindergupta> yuanyou_: tell me which one i will fix it 03:24:03 <narindergupta> yuanyou_: so far i did not find any issues but we will fix it 03:24:08 <narindergupta> if it appears 03:25:09 <yuanyou_> narindergupta: onos-controller: 03:25:09 <yuanyou_> charm: local:trusty/onos-controller 03:25:09 <yuanyou_> options: 03:25:09 <yuanyou_> #ext-port: "eth1" 03:25:47 <yuanyou_> narindergupta: this options not set 03:25:49 <narindergupta> i was not seeing any value in bundle as onos-controller is in container 03:26:07 <narindergupta> and there is no eth1 on containers 03:26:35 <narindergupta> but if it matches the neutron-gateway ext-port then i can fix it right away 03:27:19 <yuanyou_> narindergupta: yes 03:27:30 <narindergupta> so you need it in onos-controller 03:27:52 <yuanyou_> narindergupta:yes, i need this for onos-controller 03:28:17 <yuanyou_> and the ext-port should be corrct ext-port 03:28:44 <narindergupta> of neutron-gateway 03:28:52 <narindergupta> as deifned in neutron-gateway 03:29:18 <yuanyou_> narindergupta: when is use -d trusty to deploy, and the bundles.yaml is still xenial 03:29:38 <narindergupta> did u cleaned up? 03:29:45 <narindergupta> before depoloyment? 03:30:12 <narindergupta> i think i fixed this before going on vacation but will have a look again 03:30:21 <yuanyou_> narindergupta: ok 03:31:37 <narindergupta> yuanyou_: do you need gateway-mac option also in onos-controller? 03:32:00 <yuanyou_> narindergupta: not need now 03:32:04 <narindergupta> ok 03:32:36 <narindergupta> i have fixed both ext-port and profile 03:32:43 <narindergupta> any other option i am missing 03:33:10 <yuanyou_> narindergupta: good 03:33:29 <narindergupta> yuanyou_: i will start the deplyment and send you bundles.yaml created on intel pod and once you okeyed it i will check in into joid 03:34:12 <yuanyou_> narindergupta: ok 03:38:02 <narindergupta> yuanyou_: now bundle file will get created after the juju bootstrap during runtime 03:38:45 <narindergupta> and reason we changed because earlier we used to make changes at 12 place for any change in charm 03:39:00 <narindergupta> now only one place and integration is free of sed now 03:39:22 <yuanyou_> narindergupta: ok ,i will hava a look 03:39:30 <narindergupta> yuanyou_: sure 03:39:44 <narindergupta> all templates are in bundles_tpl 03:39:49 <narindergupta> directory under ci 03:41:01 <yuanyou_> narindergupta: ok, i saw it 03:41:16 <narindergupta> cool 03:42:30 <narindergupta> i used the below command to depploy ./deploy.sh -s onos -d trusty -f sfc -t ha -l intelpod5 03:43:35 <narindergupta> i am making few more changes where using few charm from charm store rather than git 03:43:49 <narindergupta> but it should not affect your deploymen 03:48:04 <yuanyou_> narindergupta: ok ,and the ci time we should reset. 03:56:01 <narindergupta> yuanyou_: give me 15 more minuutes for bundles.yaml as i made a mistake so retrying the fix now 03:57:59 <yuanyou_> narindergupta: ok,and i should have a lunch. 03:58:19 <narindergupta> yuanyou_: ok 04:05:08 <narindergupta> yuanyou_: this is the bundle i have please let me know if i am missing any option here http://paste.ubuntu.com/19997948/ 04:15:38 <narindergupta> yuanyou_: u there? 04:44:36 <yuanyou_> narindergupta:hi,i am there 04:45:03 <narindergupta> please check the bundle http://paste.ubuntu.com/19997948/ it looks good to me so i checked in the changes 04:45:39 <narindergupta> and deployment is in progress 04:45:54 <yuanyou_> narindergupta: yes,so good to me 04:46:14 <narindergupta> yuanyou_: good so looks like joid integratiion is completed then 04:47:01 <yuanyou_> narindergupta: yes 04:47:52 <narindergupta> yuanyou_: cool. we have few congress issue due to that i can not run the scenario but when issue will get fixed i will run all scenarios again 04:48:38 <yuanyou_> narindergupta: ok,but can we create the scenario now. 04:48:49 <narindergupta> yes i saw the patch 04:49:13 <narindergupta> i think you need to add -d trusty in case of onos and sfc then we are good 04:49:41 <narindergupta> you need to work with fdegir for the patch into erleng 05:01:37 <yuanyou_> narindergupta: ok, i will ask for fath to help add -d trusty 05:02:09 <narindergupta> yuanyou_: that i already added but while sfc and onos you need to enable it 05:03:11 <yuanyou_> narindergupta: i don't know how can i enable it? 05:03:27 <narindergupta> that you need to ask fdegir 05:03:39 <narindergupta> how to pass the parameter during jenkins 05:05:16 <yuanyou_> narindergupta: which params we should pass? 05:05:36 <narindergupta> -f sfc -d trusty 05:05:45 <narindergupta> rest of them will be same 05:08:06 <yuanyou_> you mean this in jekens UBUNTU_DISTRO xenial 05:10:08 <narindergupta> i have already defined the variable yes 05:10:57 <narindergupta> but need to modify to trusty based on feature passed. 05:11:44 <narindergupta> 2.5.90-1 is the defalt openvswitch for all nodes currently and i am going to sleep now. It is 12:11 AM already here 05:12:06 <yuanyou_> narindergupta: ok,thanks 05:12:47 <narindergupta> yuanyou_: good newa is deplyment completed so integration is good. 05:12:48 <yuanyou_> narindergupta: have a good night 05:13:30 <narindergupta> Created a new network: 05:13:30 <narindergupta> +---------------------------+--------------------------------------+ 05:13:30 <narindergupta> | Field | Value | 05:13:30 <narindergupta> +---------------------------+--------------------------------------+ 05:13:32 <narindergupta> | admin_state_up | True | 05:13:32 <narindergupta> | availability_zone_hints | | 05:13:35 <narindergupta> | availability_zones | | 05:13:35 <narindergupta> | created_at | 2016-07-19T05:12:59 | 05:13:37 <narindergupta> | description | | 05:13:37 <narindergupta> | id | 38af81d3-7a99-4377-a86d-322755c4b683 | 05:13:39 <narindergupta> | ipv4_address_scope | | 05:13:39 <narindergupta> | ipv6_address_scope | | 05:13:42 <narindergupta> | is_default | False | 05:13:42 <narindergupta> | mtu | 1450 | 05:13:44 <narindergupta> | name | ext-net | 05:13:44 <narindergupta> | provider:network_type | vxlan | 05:13:47 <narindergupta> | provider:physical_network | | 05:13:47 <narindergupta> | provider:segmentation_id | 1026 | 05:13:49 <narindergupta> | router:external | True | 05:13:49 <narindergupta> | shared | False | 05:13:51 <narindergupta> | status | ACTIVE | 05:13:51 <narindergupta> | subnets | | 05:13:54 <narindergupta> | tags | | 05:13:54 <narindergupta> | tenant_id | 0485cb4af2f94cf6ae6516f169080947 | 05:13:56 <narindergupta> | updated_at | 2016-07-19T05:12:59 | 05:13:56 <narindergupta> +---------------------------+--------------------------------------+ 06:16:11 <yuanyou_> fdegir: hi 11:55:37 <narinder> David_Orange, hi David good morning how are you doing? 11:56:20 <narinder> David_Orange, regarding this patch https://gerrit.opnfv.org/gerrit/#/c/17121/1 i have 2-3 comments if you have time we can go through together? 12:45:57 <David_Orange> narinder: hi 12:46:10 <narinder> David_Orange, hi how are you doing? 12:46:12 <David_Orange> narinder: i am fine and you ? 12:47:27 <David_Orange> narinder: i patch those 2 files this morning, hope it is ok for you, this is mainly cosmetic, but we can talk about that when you want 12:47:58 <narinder> David_Orange, yes i saw that and i made a few comments 12:48:13 <David_Orange> of course 12:48:20 <narinder> for example deploy.py 12:48:35 <David_Orange> yes 12:48:37 <narinder> there was extra comma in comparison 12:48:47 <narinder> at line 72 12:49:01 <narinder> i think its not needed 12:49:37 <David_Orange> ok, i check them all 12:49:40 <narinder> in that file only the comment i have 12:49:53 <narinder> in the genbunfdle.yaml 12:50:10 <narinder> line 186 12:50:31 <David_Orange> oh yes 12:50:35 <David_Orange> sorry for elif :) 12:50:38 <narinder> as liberty is supported in trusty only so i am checking trusty in extra if it is there then only support liberty 12:50:52 <narinder> David_Orange, no need to sorry 12:51:34 <David_Orange> my brain is not used to work with the hot here in Brittany ;) 12:52:15 <narinder> is it very hot there? 12:52:58 <David_Orange> in my opinion, the first part of deploy.py (the creation of opnfvcfg[]) should be set from an extra yaml file 12:53:59 <David_Orange> very hot no :) probably really less hot than in texas, but we are not used to that :) 12:55:16 <David_Orange> narinder: globally, are the changes ok for you ? 12:57:52 <narinder> David_Orange, yes i am fine and not seeing any issue 12:58:35 <narinder> David_Orange, did not understand this part the creation of opnfvcfg[]) should be set from an extra yaml file 13:00:21 <David_Orange> narinder: i just think we should load 1 default yaml file or 2 to create opnfvlabcfg and opnfvcfg vars. 13:01:08 <David_Orange> to split default vars and vars modification 13:02:06 <narinder> currently i am reading from labconfig.yaml and converting deployconfig.yaml and deployment.yaml 13:02:18 <narinder> and this happen during MAAS install time 13:02:20 <David_Orange> but there are also a part that shall be loaded from labconfig.yaml (like vips) 13:02:30 <David_Orange> ok 13:02:40 <narinder> no vip i am creating based on network avialable 13:03:05 <narinder> we should not take that input and it is standard like .21 to .30 13:03:39 <narinder> i think more input asked from user always creates confusion and result in more dissatisfaction 13:04:07 <David_Orange> ok, you removed the vip part i had set in labconfig.yaml 13:04:33 <David_Orange> i understand, np. 13:04:44 <narinder> no vip in labocnfig.yaml 13:04:56 <narinder> we are generating it using deploy.py 13:05:15 <narinder> and put into deployconfig.yaml during MAAS install time 13:06:05 <David_Orange> i had set one, you remove it, this is not a problem. this is just that we have only ten vips with this solution 13:06:34 <narinder> David_Orange, no problem we have 11-19 still empty and we can use that if needed 13:06:55 <David_Orange> 11-19 are used on orange pods 13:07:17 <narinder> whats for? 13:07:26 <David_Orange> for ipmi 13:07:39 <narinder> ok no problem in that case 30-40 13:07:50 <David_Orange> lets postone this part, we will see that when we will have no more ip 13:07:51 <narinder> as i have started the dhcp from 50 13:07:59 <David_Orange> np 13:08:15 <narinder> David_Orange, sure we can decide as i kept lot of ips in range for 1-50 13:08:26 <David_Orange> ok 13:09:41 <David_Orange> i have just post a new version of the patch 13:12:56 <narinder> David_Orange, line 186 13:13:05 <narinder> still has issues 13:13:19 <narinder> we need to ident it within if trusty 13:13:40 <narinder> otherwise it will accept liberty with xeinal as well 13:13:50 <narinder> is trusty is not provided which is invalid config 13:14:24 <David_Orange> ok, i did not got that point 13:16:32 <narinder> David those two ifs for liberty and trusty should be inclusive not exclusive 13:17:09 <narinder> means trusty if should follow the liberty so if trusty is not passed then liberty option should not be checked 13:19:03 <narinder> David_Orange, new patch was ok and I have merged it 13:21:07 <bryan_att> narinder: I'm not seeing any reason that the line "connection = {{ shared_db.uri }}" in charm-congress/src/templates/liberty/congress.conf should be rendered as "connection = " in /etc/congress/congress.conf 13:21:52 <bryan_att> narinder: you mentioned that there may be a layer change behind this. How would I find out what changes may have affected the rendering of {{ shared_db.uri }} ? 13:22:03 <narinder> bryan_att, somehow shared_db.uri valus is not observed 13:22:27 <narinder> bryan_att, we need to find out from openstack team 13:22:41 <narinder> bryan_att, will you please consult with them? 13:22:43 <bryan_att> what do you mean by "not observed" 13:23:13 <narinder> bryan_att, means this value is empty so template converted as empty some how 13:23:49 <bryan_att> where is the value supposed to be set? This is AFAICT a charm thing and not a Congress thing 13:25:25 <bryan_att> i.e. in the design of the charm, what part of the charm takes the template and fills in the variables, and where does that get the values for the variables? This is specific to the charm and not congress. 13:31:14 <narinder> bryan_att, i have no idea as I could not find the code who fills it and how. As layer concept is new and only few charms were written based on layers. 13:34:23 <bryan_att> OK I will ask on #juju I guess 13:36:41 <bryan_att> narinder: where do the "layers" get invoked? I suppose these are templates etc that are defined and maintained somewhere else and pulled in as needed by the build. IIUC, this causes a dependency which can break OPNFV deployments - so the dependency and how to address issues needs to be documented. 13:39:26 <narinder> bryan_att, yes brian #juju sorry 14:09:39 <narinder> David_Orange, looks like with public API congress code do not execute 14:10:00 <narinder> David_Orange, so whenever you have time please have a look 14:10:21 <David_Orange> ok, i will reinstall pod1 with latest version 14:10:37 <David_Orange> i only have to specifiy publicapi as feature now, true ? 14:17:40 <bryan_att> narinder: how do I redeploy congress on the POD to test out a charm patch? Can I make a local change or does it need to come from github? 14:17:56 <narinder> bryan_att, yes you can do that 14:18:00 <narinder> modify it 14:18:04 <narinder> then update the charm 14:18:10 <narinder> juju charm-update congress 14:18:18 <narinder> should do 14:18:22 <bryan_att> OK, where is the charm in the file system? 14:18:49 <narinder> bryan_att, in intel pods it seems automatic deployment started 14:19:10 <narinder> but it should be under ./joid/ci/xenial/charm-congress/ 14:19:13 <narinder> has source 14:19:39 <narinder> then you need to build it and move it to joid/ci/xenial/congress/ 14:19:53 <narinder> then juju charm-update congress should work 14:20:28 <bryan_att> there's no xenial folder in joid/ci 14:20:47 <narinder> bryan_att, as i told installations restarted by CI 14:21:01 <narinder> so everything wiped out and reployment started 14:21:11 <bryan_att> OK, hopefully it will pick up the change 14:37:08 <David_Orange> narinder: for publicapi install i just add the param in extrafeatures now, true ? 14:37:25 <narinder> David_Orange, yes 14:37:39 <narinder> David_Orange, everything else works except congress 14:37:54 <David_Orange> ok, i will install pod1 and check 14:46:01 <bryan_att> narinder: how do I know when the deploy is done so I can check it? 14:46:30 <narinder> bryan_att, i will ping you 14:46:48 <bryan_att> ok, is there some web page I can watch also? 14:47:24 <narinder> bryan_att, current deployment may not have the fix but you can watch here https://build.opnfv.org/ci/job/joid-deploy-baremetal-daily-master/263/console 14:47:38 <narinder> i am planning to start one right after that to pick the latest change 14:49:04 <bryan_att> ok, I'll watch 15:08:52 <David_Orange> narinder: i am lost with deployment method, joid-deploy.sh from releng is up to date ? what deploy script shall we use, deploy.sh or .py ? 15:09:09 <narinder> i use deploy.sh 15:09:23 <David_Orange> that use deploy.py ? 15:09:57 <narinder> maas uses deploy.py 15:10:05 <David_Orange> ok 15:10:12 <narinder> and create the requiredfile which i copy in ~/.juju/ 15:10:30 <David_Orange> maybe a file rename can be a good thing to avoid confusion 15:11:01 <narinder> then those will be used in deploy.sh to start the deployment and 01-deploybundle.sh really calls genbundle.py 15:11:12 <David_Orange> i will update joid-deploy.sh to enable extrafeature and remove old things (password....) 15:11:19 <David_Orange> ok 15:14:15 <narinder> sure that will help if uses the joid-deploy.sh 15:14:38 <narinder> also i use deploy.sh and now you can pass mutiple feature "," seperated 15:14:52 <narinder> like -f sfc,ipv6,trusty 15:15:56 <David_Orange> ok so you mix nfvfeature and extrastuff ? 15:16:07 <David_Orange> or extrastruff is another param ? 15:19:04 <narinder> David_Orange, from deploy.sh all feature can be passed using -f 15:19:15 <narinder> and i do not have seperate parmameter for that 15:19:41 <narinder> but while passing argument to genBundle i take care of it based on parameter passed 15:19:52 <narinder> hope it make sense for you 15:22:35 <David_Orange> no offense, but it is confusing for me 15:25:23 <David_Orange> give me 5 minutes 15:25:53 <narinder> David_Orange, ok 15:29:10 <David_Orange> sorry got a phone call 15:30:56 <David_Orange> for me it seems complicated: we give scenario name to jenkins > we split it to give all features (mixing it with extra) to deploy.sh > we recreate a scenario name to give it to genbundle 15:32:09 <David_Orange> i think giving scenario name to all sript would be easier to understand 15:34:18 <David_Orange> for publicapi, you does not get it from scenario name, but you get it from os-domain-name in deployconfig.yaml 15:41:31 <David_Orange> narinder: for features param, we split it with '_' from scenario name and create a new one for deploy.sh with ',' ; from my point of view it is confusing. But again, no offense, i do not have all the scripts history and the job is done 15:42:33 <David_Orange> but if we decide to use deployconfig.yaml for passing params, this is not a problem 15:43:09 <narinder> David_Orange, deploy.sh we already implemented feature using "," and few scenario name has odl_l2 and odl_l3 which is breaking the current deployment 15:43:21 <narinder> so i think it should not be a problem 15:45:48 <David_Orange> i think, to have something more homogeneous, is to get nfvfeatures and extra in joid-deploy.sh, pass all to deploy.sh, generate deployconfig.yaml, and read it in genbundle 15:46:42 <David_Orange> it will minimize changes in deploy script and will only impact joid-deploy.sh and genbundle.py 15:47:34 <David_Orange> narinder: it will just remove scenario name creation before calling genBundle 15:47:56 <David_Orange> so from a joid perspective, scenario name is never used 15:51:02 <narinder> David_Orange, once you submit a patch i will have a look and feature passed to deploy.sh gets converted into scenario to create the bundles using genbundle.py 15:51:15 <narinder> so change has to be done very carefully 15:51:41 <narinder> and reason i did was to have compaitibility in deploy.sh and genbundle.py 15:54:39 <David_Orange> i fully understand 15:55:53 <David_Orange> narinder: i will check if i can change genbundle and check if i can get all params from deployconfig.yaml (it is generated before genbundle exec, true ?) 15:56:26 <bryan_att> narinder: looks like the job finished but congress did not get installed fully. how do we start it again to make sure it gets the latest charm? 16:00:17 <narinder> bryan_att, try this https://build.opnfv.org/ci/job/joid-deploy-baremetal-daily-master/266/console this is just started after redeploy 16:01:06 <narinder> deloyconfig.yaml craeted during MAAS install before the genbundle exec yes 16:01:18 <narinder> and that will be based on labconfig providede 16:01:23 <narinder> for each lab 16:02:10 <David_Orange> so if i can find all informations included in scenario name, we do not need scenario name in genbundle 16:04:50 <narinder> David_Orange, unfrotunatel it is not possible because after maas deployment you can chose any scenarios 16:05:02 <narinder> which can include mutiple or single feature 16:05:27 <narinder> i am fins scenario name in genbundle as i modified by script accordingly 16:05:42 <narinder> you can see in 01-deploybunle.sh i am changin , to _ 16:06:06 <narinder> also appending the scenario accordingly 16:06:34 <David_Orange> true, but for publicapi extra feature, you do it only if the param is present in the deployconfig.yaml, so it will be always, not linked with scenario name 16:06:37 <narinder> i know we can combine feature and extra into one but since we have already codede accoridngly so no need to worry for now 16:06:46 <narinder> correct 16:06:59 <narinder> which is true right and thats how it should work 16:07:42 <David_Orange> why, that way it is not linked with extraparam, but labconfig 16:08:19 <narinder> David_Orange, if lab is defining the publicapi then bundle should use 16:08:26 <narinder> otherwise not 16:08:58 <narinder> extraparam will be passed to genbundle based on labconfig definitions 16:09:15 <narinder> so that everything is automated 16:09:33 <narinder> if you can look into the ornage pod1 labconfig.yaml i have change it accoridngly 16:09:45 <David_Orange> yes i see 16:12:04 <David_Orange> narinder: i understand how it works, that way if we remove publicapi in jenkins scenario name, it has no impact on deployment, except if we redeploy maas, true ? 16:14:05 <narinder> you do not have to reploy maas 16:14:14 <narinder> just change deployconfig.yaml in ~/.juju 16:14:33 <narinder> and the publicpai wont be use after the MAAS deployment 16:14:44 <David_Orange> yes, this is the manual way, but from jenkins, it wont works 16:14:49 <narinder> but not through jenkins though. 16:15:01 <narinder> it can 16:15:11 <narinder> yes you are true it won't 16:15:24 <narinder> i can remove this from my script if you want 16:15:41 <narinder> so that you can control from jenkins 16:16:03 <narinder> but my main worry is if this value is not deifned then we have some random values 16:16:22 <David_Orange> please dont, you probably have more important to do 16:16:42 <David_Orange> which value ? 16:17:15 <narinder> publicapi value 16:17:23 <David_Orange> publicapi is just an example of the problem of rebuilding the scenario name from labconfig 16:18:22 <David_Orange> not labconfig bu deployconfig 16:18:30 <narinder> labconfig i am usign to get the values for automation 16:18:56 <narinder> we need parameters and asking from user is not a good idea 16:19:16 <narinder> its better put the smartness in deployer rather than in jenkins 16:20:01 <narinder> thats the input i got when we review this with MArk S earlier 16:21:32 <narinder> we can add this as feature and pass it using -f but i chose not to because it is lab specific value 16:21:32 <David_Orange> i fully undestand that point and totally agree, but have something that seems enabled from jenkins that will not will be a problem 16:22:27 <narinder> i agree from jenkins it should be modifiable. LEt me see my code and see how can we pass through jenkins 16:22:42 <narinder> as well 16:22:55 <David_Orange> the other solution is not to use extra feature part of the scenario name and modify it in labconfig 16:24:20 <narinder> i am using osdomainname: pod1.opnfv.fr in labconfig 16:24:30 <narinder> if this is not deinfed then i am not using it 16:24:34 <narinder> otherwise yes 16:25:02 <narinder> so question is if we do not want to use this even though it exist 16:25:05 <narinder> correct 16:25:33 <David_Orange> it exist but is optional 16:27:06 <David_Orange> in genbundle i used extra to enable beta features, to fully test a beta feature with all the CI chain 16:27:52 <David_Orange> i though it can be a good thing to do before pushing this feature from extra to nfvfeature 16:31:31 <narinder> David_Orange, currently i am passing as extra feature only to genbundles 16:31:47 <narinder> var=os-$4-$fea-$1"-"$6"_"$2 16:31:56 <narinder> where $4 is sdn 16:32:13 <narinder> $fea is feature requested 16:32:37 <narinder> and $1 is type 16:32:54 <narinder> and $6 is distro 16:33:44 <narinder> and $2 is labname 16:34:05 <narinder> and after that based on osdomname i am adding _publicapi which is extra feature 16:34:10 <David_Orange> so you reuse the jenkins variable and change it 16:34:40 <narinder> my joid is not depend upon jenkins 16:34:47 <narinder> joid code is not 16:35:17 <narinder> for publicapi i uses domname if exist then pass extra feature to genBundle otherwise not 16:35:29 <David_Orange> yes i know, but from a joid user/developper it can be confusing 16:35:41 <narinder> why? 16:36:13 <narinder> joid user should not know about this right. They should know domname of their lab 16:36:24 <narinder> and put into labconfig.yaml thats it 16:36:31 <narinder> rest joid code will do 16:38:03 <David_Orange> joid user does not haer to know that, but joid developpers must. to have more contribution, the way we pass args from scripts to scripts is important 16:38:35 <narinder> David_Orange, yes i agree 16:38:47 <David_Orange> if you are ok, i will rename "scenario" in genBundle to have something different 16:39:00 <narinder> i think i shoudl write more documention or comments on it 16:39:16 <narinder> sure you can 16:40:06 <David_Orange> yes :) and document how to enable features on deployconfig: "To enable public API, please fillup osdomname" 16:41:51 <narinder> i though i need more spare time to do that. sorry for all confusion 16:43:13 <David_Orange> narinder: i will make a workflow diagram if you agree, it will give me more understanding on how the deployment is done, and i will share it to you and all devs 16:44:16 <narinder> please do that if you can 16:45:26 <David_Orange> ok, i will try 16:45:56 <narinder> thanks 16:46:20 <narinder> but for your info 02-maasdeploy.sh will deploy maas and should execute first. 16:46:30 <narinder> then 00-bootstrap.sh 16:46:43 <narinder> then 01-deploybundle.sh 16:46:44 <David_Orange> i have to go, see you tomorrow (i will probably can not attend to joid meeting, i keep you in touch) 16:46:53 <narinder> see you 16:47:53 <David_Orange> 02>00>01 is also confusing, but we will se that later :) 18:36:11 <narinder> bryan_att, looks ilke that fixes the congress issue. I believe you should look now moving this to openstack-charm 18:36:55 <narinder> bryan_att, jamespage mentioned this exmaple to start the work https://review.openstack.org/#/c/339485/ 18:37:13 <narinder> i think you need to modify it and submit a new pull request 19:12:32 <bryan_att> narinder: for some reason the congress charm did not work on my NUC lab. did you see it work somewhere else? 22:38:27 <bryan_att> narinder: I see now you had a patch to comment out the congress relations. You removed this after I cloned this AM. But I have another issue. Why is the region "Canonical" now when in the past (and in many things under the JOID repo) it was "RegionOne". I can't access the congress API now because of the region difference. 22:38:38 <bryan_att> narindergupta: ping 22:39:25 <narindergupta> bryan_att, pong i always had Canonical. 22:39:41 <narindergupta> bryan_att, i never used ReionOne 22:39:46 <bryan_att> why the difference now? 22:40:08 <narindergupta> bryan_att, its passing in my deployment 22:40:33 <narindergupta> bryan_att, https://build.opnfv.org/ci/job/joid-deploy-baremetal-daily-master/268/console 22:48:53 <bryan_att> narindergupta: any idea why it would be different for me? https://www.irccloud.com/pastebin/UwkzmCxE/ 02:21:51 <bryan_att> narindergupta: looks like the RegionOne thing was an side-effect of running the "remove-service congress" and then running "juju-deployer" to redeploy it. I re-cloned and installed from scratch and it's as you said - all endpoints are in the Canonical region. 02:39:01 <yuanyou_> May-meimei: ping 02:52:22 <narindergupta> yuanyou_, hi 02:55:38 <narindergupta> bryan_att, cool and thanks for confirmation 03:05:47 <May-meimei> yuanyou_: ？ 03:17:39 <yuanyou_> narindergupta: hi 03:18:12 <yuanyou_> May-meimei: hi,can you submit releng https://gerrit.opnfv.org/gerrit/#/c/16875/ 03:18:22 <narindergupta> yuanyou_, so whats the news were you able to enable the scenario? 03:19:28 <yuanyou_> narindergupta: I had send an email to fdegir to help add enable the scenario 03:20:06 <narindergupta> yuanyou_, ok 03:20:18 <yuanyou_> narindergupta: i am waiting for him 03:20:47 <narindergupta> yuanyou_, ok let me know once ready. 03:21:23 <yuanyou_> narindergupta: may be May-meimei can do this also, I will notice you first. 03:21:45 <May-meimei> submited 03:21:50 <narindergupta> ok 03:22:04 <yuanyou_> May-meimei: cool 03:22:20 <May-meimei> senario will be availble later 03:22:56 <yuanyou_> May-meimei: but i need params -f sfc -d trusty to pass 03:23:46 <May-meimei> deploy.sh -f sfc -d trusty ? 03:23:51 <yuanyou_> May-meimei: yes 03:25:32 <May-meimei> but default value is mitaka, yes? 03:28:37 <May-meimei> why not add a branch in joid-deploy.sh ? 03:29:43 <yuanyou_> May-meimei: mitaka is -o 03:30:54 <May-meimei> oh, yes, confused 03:33:44 <yuanyou_> May-meimei: when the scenario is joid-os-onos-sfc-ha, run ./deploy.sh -s onos -d trusty -f sfc -t ha -o mitaka 13:55:28 <David_Orange> narinder: hi 14:01:21 <David_Orange> narindergupta: how are you ? 14:01:41 <narindergupta> David_Orange, hi i am fine 14:01:45 <narindergupta> what about you? 14:01:56 <David_Orange> narindergupta: i am fine, thx 14:02:05 <David_Orange> i have a juju question for congress 14:02:52 <David_Orange> is there a way to force juju tu use the default value and not the value given in the top bloc 14:03:56 <David_Orange> os-public-hostname is set for all the bundle, and to make congress works internaly we need to set this value to its default, not the one set at the top, do you follow me ? 14:04:37 <David_Orange> if i can not, i have another way, but it will be a little more longer for the post install script 14:04:46 <narindergupta> David_Orange, yes only way to do is define it for individual charm all option needed 14:04:57 <David_Orange> ok 14:05:21 <narindergupta> need to remove the top values and insert place it for individual charm 14:05:39 <David_Orange> so it is as you want: 14:05:39 <David_Orange> - we set the value for all services, except congress 14:05:39 <David_Orange> - wet change the value in post install 14:05:46 <narindergupta> with the current way we bundle it it is quite possible 14:05:57 <narindergupta> correct 14:06:22 <narindergupta> David_Orange lets do it for individual service 14:06:34 <narindergupta> soecially for public api 14:06:43 <narindergupta> as we have a way to do it now 14:07:22 <David_Orange> ok, so i patch all services with a 'if publicapi: os-public-hostname=xxxx' except for congress 14:07:46 <narindergupta> correct 14:07:53 <narindergupta> and also we do not have to patch all 14:08:00 <narindergupta> only whereever applicable 14:08:11 <narindergupta> for example promise may not need it 14:08:16 <David_Orange> ok , i do it, i hope i wont forget a service 14:08:24 <narindergupta> nova-compute may not need it 14:08:40 <David_Orange> sure all service the have that parameter 14:11:57 <narindergupta> not all 14:12:03 <narindergupta> nova-compute does not have it 14:12:18 <narindergupta> sorry it does 14:12:27 <David_Orange> dont worry i will check 14:12:36 <narindergupta> ok 14:12:41 <narindergupta> no it does not actually 14:12:47 <narindergupta> confress has it 14:12:53 <David_Orange> another point: in ceph.yaml template 14:12:59 <narindergupta> yeah 14:13:11 <David_Orange> line28 14:13:43 <narindergupta> let me open that file 14:14:09 <narindergupta> ok 14:14:22 <narindergupta> its checking the mode ha 14:14:38 <David_Orange> yes, i did not understand, but now it is ok 14:14:50 <David_Orange> for ceph we need a minimum of 2 14:15:01 <David_Orange> but more if in ha mode 14:15:04 <narindergupta> minimum is 3 14:15:27 <narindergupta> but for non ha since we are doing deployment with 2 nodes only so we have only 2 14:17:09 <David_Orange> the idea is to deploy on all available nodes, is it correct ? 14:18:29 <narindergupta> yes 14:18:40 <narindergupta> but some lab has 2 nodes only 14:18:47 <David_Orange> is there a place where the pod size is set, or is it harcoded ? 14:19:05 <narindergupta> no i am setting ti based on nodes defined in labconfig.yaml 14:19:25 <narindergupta> i am counting it and set in deployconfig.yaml 14:19:48 <narindergupta> opnfv: units: 5 14:19:58 <narindergupta> in case of intel pods 14:20:19 <David_Orange> ok, this could be a good thing to get that value here for ceph 14:20:48 <narindergupta> definetely some logic is needed for nonha as we need to have more nova-compute as well in that case 14:21:11 <narindergupta> so that we can utilize all resources 14:21:32 <narindergupta> whether HA or nonha 14:23:45 <David_Orange> i will see later how to get it in genBundle 14:24:23 <David_Orange> 1/ template modify for congress 14:24:23 <David_Orange> 2/ workflow diagramm 14:24:23 <David_Orange> 3/ genBundle modify depending on workflow analysis 14:24:48 <narindergupta> agreed lets create a jira also for same 14:25:00 <narindergupta> so that we wont miss any work item 14:25:07 <David_Orange> ok for me 14:25:12 <narindergupta> ok will do it now 14:25:50 <David_Orange> i let you do that, i have only 30 minutes available for congress, and i have a meeting on another subject 14:26:13 <David_Orange> i can not connect to joid meeting, sorry 14:27:41 <narindergupta> no problem 14:27:58 <narindergupta> yeah send me patch and i will restart the deployment on orange pod1 14:29:21 <David_Orange> please wait before changing pod1, valentin is working on it for public api 14:29:43 <narindergupta> oh ok 14:45:23 <David_Orange> is there a jira for congress ? 14:49:12 <narindergupta> there was to integrete 14:49:23 <David_Orange> ok 14:49:25 <David_Orange> https://gerrit.opnfv.org/gerrit/17235 14:50:50 <narindergupta> do we need use-internal-endpoints: true also for all or that will work? 14:51:02 <narindergupta> as being override 14:53:12 <narindergupta> ok i am +2 it and merging it if still find out issue we will fix it further 15:00:48 <David_Orange> narinder, it will work with interal everytime 15:00:54 <David_Orange> ok 15:01:08 <David_Orange> i have to go, see you tomorrow 15:01:40 <narindergupta> sure 15:01:52 <narindergupta> i have merge the changes 16:04:17 <durschatz> #info Dave Urschatz 16:05:01 <collabot> arturt: Error: Can't start another meeting, one is in progress. Use #endmeeting first. 16:05:19 <arturt> #endmeeting