14:00:08 #startmeeting Archtitecture Committee 14:00:08 Meeting started Thu May 16 14:00:08 2019 UTC. The chair is farheen_cefalu_a. Information about MeetBot at http://wiki.debian.org/MeetBot. 14:00:08 Useful Commands: #action #agreed #help #info #idea #link #topic. 14:00:08 The meeting name has been set to 'archtitecture_committee' 14:11:22 #topic Issues and blockers 14:12:13 #info ML Workbench is blocked. Integration of the nifi jupyter into AIO. Bryan is required on the call. 14:14:30 #info Kazi - there are 8 apis that need to be called to create the flow in registry and they work successfully in unsecured nifi. 7/8 apis are successful with security. Bryan join the call. 14:17:43 #info Bryan I would like the experts to step in but no one is on the call. We have PTLs and team members. Maybe they can jump in and help. Bryan - the harm is that my time is better spent in working on the issues. We can get some kubernetes experts if we escalate. 14:20:40 #info Bryan - Sharing screen Nifi registry having trouble with in store value. The nifi registry has to serve the user and the pipeline service in a secure manner to be used by user, pipeline, and admin services. The method to do the secure mode is to create a key store and trust store and provision the with those. I have experience with key and trust stores. This is a shell output of the component as its runni 14:25:18 #info something that you can help with. Running the script the key tool command was able to decipher and open the key store and verifies that its valid. Once the application comes up its an apache application that does a lot of initialization stuff and at some point it gives key store password incorrect it's a java jeti app server. If anyone has information why this would work. Please raise their hand. Please 14:28:35 #info Bryan send Mukesh the log files. Bryan - Once that registry problem is fixed and we have defined pipeline certificate then we can start testing the admin experience of managing the buckets then test programatically the users. Each of these lines has to be verified. Vaibhav did jupyter work for Docker adopting to kubernetes will require work. I don't know how the notebook service is using the apis. I have 14:30:39 #info tested. I would like help from Vaibhav or anyone else. Another critical path issue. I need the portal to deploy the api. Mukesh - done. It needs to be tested. We dropped deployment of pipeline with the k8 branch. 14:32:46 #info The entire team thought that pipeline was dropped. Deployment under kuberentes is dropped. Bryan sharing the Boreas acumos diagram. We dropped kafka, flink, and pipeline in a private kubernetes. We are not going to be deploying pipelines as running artifacts in the k8 environment. 14:38:21 #info Bryan is slogging security verification. Requires Mukesh's assistance. Making a small change in the jar needs the whole portal. This is not agile. We have to back away from embedding jars. It is a bad architecture decision Mukesh will try to put a debug statement in the package. Willt ry to do it today if possible. 14:42:29 #info Bryan we have a number of things that have to be done including understanding how these artifacts have to be retrieved which is different. We don't have time to figure out another solution. Kazi In the design time the user will be able to all the things. Design time nifi will be available. Will the end user be able to use the nifi pipeline at design time? 14:45:07 #info Bryan it will be useful like jupyter. We can write a user guide of how to use the pipeline manually. The missing pieces are from I want to deploy this to the pipeline component 14:48:50 #info This was envisioned back in January and knew. Once we moved away from kubeflow and moved towards nifi we depended on the CMLP team to assist. 14:54:03 #info Nat suggested working on a call with Steve Polston later this afternoon. Kazi - we want to spend our time testing. 14:54:12 #info endmeeting 14:54:24 #endmeeting