13:00:05 #startmeeting Test&Performance Ops meeting 13:00:06 Meeting started Fri Oct 9 13:00:05 2015 UTC. The chair is anac1. Information about MeetBot at http://wiki.debian.org/MeetBot. 13:00:06 Useful Commands: #action #agreed #help #info #idea #link #topic. 13:00:06 The meeting name has been set to 'test_performance_ops_meeting' 13:00:14 #info Ana Cunha 13:00:29 morgan_orange: ping? 13:00:32 #info Jose Lausuch 13:00:41 #info Morgan richomme 13:00:58 jose_lausuch: pong 13:01:01 I have a question not related to the agenda 13:01:02 but 13:01:11 yes 13:01:11 if we integrate "push results to db" in each test 13:01:18 if there is a non-federated lab running functest 13:01:21 what will happen? 13:01:28 are they allowed to push also to that db? 13:01:35 or only for the pharos labs connected to CI 13:01:49 good question 13:01:57 because they might not have access 13:02:07 (it came to my mind 5 min ago ) 13:02:08 :) 13:02:15 I was about to write a mil related to the security aspects we discussed on wednesday 13:02:26 #topic test result dB 13:02:32 for me anyone whishing to share its results should be able to do it 13:02:38 yes, we have also to make sure that if there are not credentials in the current lab, dont push 13:02:41 or something like that 13:02:45 yes 13:02:52 if credentials 13:02:52 push 13:02:52 otherwise 13:02:52 no push 13:03:04 #info who can push data to opnfv result-dB? 13:03:10 I prefer the basic auth approach rather than IP rules 13:03:38 #info non-members of pharos ? 13:03:46 and currently if we imagiend we had security rules or you run the test from a non connected env 13:04:08 it will work anyway you will just get a tiemout on the push data request 13:04:33 ok 13:04:46 but avoiding that timeout would be nice :) 13:05:03 conclusion? 13:05:18 coudl be a parameter 13:05:34 we could create an option in the config file 13:06:27 #info to be discussed with the testing community => would a basic authent be enough for pushing test resuilts in test result DB 13:06:35 ok 13:06:35 thanks 13:06:41 that also sounds good 13:06:46 #info or shall we restrict the access to DB to Pharos lab 13:07:01 its not critical, but its a design thing that we will face sooner or later 13:07:05 at least, after R2 13:07:33 yes 13:07:41 #topic test dashboard 13:07:56 #info meeting with LF last Wednesday 13:07:59 i couldn't make to the meeting, any news to share? 13:08:25 #info I think that both parts now have the same understanding... 13:08:36 #info on one side a Mongo DB with a rest API to access 13:08:55 #info on the other side LF web team will develop PHP scripts to transform data into graphs 13:09:21 #info what is next step? 13:09:21 #info LF will expect access to the DB and description of graph to be produced 13:09:59 yes 13:10:06 #info LF web team needs to evaluate the resource needs (more code to do) 13:10:21 #info should be included in next Sprints 13:10:30 #info wait for feedback from LF web 13:10:41 meanwhile it is anyway possible for us to fill in the database 13:10:55 Rodrigue updated the APi yesterday 13:11:04 I must document it asap 13:11:14 with yardstick request already? 13:11:20 #info standard steps for a test project 13:11:30 #info test project in CI 13:11:41 #info from test project use the API to push results 13:11:43 but not the final db , right? 13:11:47 the one that you setup 13:12:07 no it is a temp db but as the APi has been updated, I think I could ask aric to integrate the API 13:12:11 then we could use the target one 13:12:19 where is the temp db located right now? 13:12:23 but we need to implement security mecahnism 13:12:36 the temp DB is in a VM in an Orange public Cloud 13:12:43 ok 13:12:53 thanks 13:13:05 we will be able to save the data and reinject them if needed 13:13:13 as the APi was not completed 13:13:26 the results were only associated with a pod, not with the installer and the version 13:13:30 which shall be possible now 13:13:34 I have to update the API... 13:13:39 and send the mail to aric 13:13:47 and document the API 13:13:52 I got a question on that 13:14:10 for the API, would a description on the wiki enough or shall we provide a sagger like API description 13:14:20 ? 13:14:30 anac1: yes you shall be able to push yardstick results 13:14:35 at least the simple ones 13:14:39 thanks ! 13:14:51 I think you ask for a put method in orfer to modify test results 13:14:59 as far as I know it is not implemented yet 13:15:11 but you can declare testcases and push results, get results,... 13:15:31 I planned a demo during Maryam meeting next week 13:15:35 morgan_orange: I think a description on the wiki is ok 13:15:37 we will do the exercice practically 13:15:51 jose_lausuch: if so that is something I can do quickly 13:15:53 i think an API is preferable 13:16:07 sorry... 13:16:35 but for a first step 13:16:36 I will try to do that this aftenoon 13:16:44 so that there is something 13:16:45 so people will be able to use 13:16:53 theoretically the existing page already gives the details 13:16:59 yes 13:17:08 but I gave too many details on the json files and we do not really care 13:17:16 I will try to do something simpler 13:17:21 ok 13:17:38 * fdegir thinks if db sits in lf infra, it might not be possible to open firewall to the whole world 13:17:52 we use a rest API 13:17:53 * fdegir thinks php sucks 13:17:58 we do not connect the DB directly 13:18:06 opening port 80... 13:18:40 ok, anything else? 13:18:49 fdegir: I planned to discuss with aric on the security mehcnaism they want to put in place 13:18:58 #topic cross matrix 13:19:12 despite the 25 C milestone, we got new requests.. 13:19:19 OpenContrail, VPN 13:19:29 I think we can take opencontrail in Functest 13:19:43 vpn is included in yardstick 13:19:48 BGP VPN? 13:20:08 ok 13:20:11 yes 13:20:21 project SDNVPN 13:20:48 ok as far as I understood they planned to support it through ODL, Neutron/Bagpipe, and Nuage? 13:20:58 my colleagues are working on the second scenario 13:21:12 i informed, i think, last week ? sorry if not 13:21:18 but it makes sense to do it in Yardstick 13:21:32 ok 13:21:40 your collegues can become yardstick contributors :) 13:21:46 *colleagues 13:21:56 they are commiting code in Openstack on the backpipe plugin 13:22:02 ok 13:22:12 but would surely become yrdstick contributors for teh test scenario 13:22:30 makes sense to me 13:22:32 so Ana I will update https://wiki.opnfv.org/feature_test_project_matrix 13:22:48 thanks 13:22:50 #info SDNVPN => yardstick 13:22:57 #info OpenContrail => Functest 13:23:10 i got a request from ovs 13:23:31 #info OVS => yardstick 13:24:11 ok it shall be now somehow relatively stable 13:24:17 i hope 13:24:36 main issues will be for all the projects to see if dependencies may be taken into account by the installer 13:24:44 OVS 2.4, patch XYZ,.. 13:25:09 agree, that's the feature project responsibility, right? 13:25:11 ok for this topic 13:25:19 #topic Summit 13:25:39 I wrote 3 lines last week end about the presentation on test dashboard 13:26:01 I created a css for reveal, I do not knwo if you are interested or if you prefer pptx 13:26:19 I submitted the code https://gerrit.opnfv.org/gerrit/#/c/2327/ 13:26:30 the first slides are there :) 13:26:45 the deadline is end of October 13:26:47 thats nice 13:26:49 ok 13:27:11 so anac1 I suggest we could have a first version of Test strategy for end of next week 13:27:31 anac1: you will be in Düsseldorf? 13:27:36 no 13:27:42 ok neither do I 13:27:50 #info dealine End of october 13:27:52 friday ok for a meeting ? 13:28:05 i will book 13:28:11 we may use this slot and do a P2P meeting afterwards 13:28:24 good ide, will check with trevor 13:28:28 idea 13:28:29 we can reused the slide we made to explain the test stratgey and update them 13:28:49 yes, we have the base already 13:29:08 jose_lausuch: we may wait LF feedback but as you say it is a logical progression.. 13:29:18 anac1: if we could have some test results from yardstik 13:29:28 it is to illustrate the heterogeneity of the results 13:30:18 ok 13:30:18 yep 13:30:22 agree 13:30:23 I think we had a third slot on Pharos 13:30:37 #topic misc 13:30:57 I had a question, Yardstick, Qtip and Vsperf are all using pktgen, right? 13:31:09 not sure about qtip 13:31:20 yardstick and vsperf yes 13:31:25 yardstick and Qtip integrated the ability to use heat to perform orchestrated tests 13:31:39 anyone from qtip on the chan? 13:31:51 maybe too early fo California 13:32:42 I had a discussion with another Telco (not part of OPNFV) they would be interested to provide a testcase of a orchestrated VNF running pktgen. 13:32:55 My first reaction was that it was already covered by yardstick 13:33:15 and in the qtip minutes yesterday I had the feeling that a similar scenario was considered 13:33:31 could be, depends on the scenario 13:33:39 yes.. 13:34:03 Ok I will try to get more information 13:34:06 I have a comment about functest 13:34:20 we talked a bit about that yesterday 13:34:44 shall we consider having an offline functest and yardstick? 13:34:51 for now functest needs internet 13:34:57 otherwise, it fails 13:35:03 I saw your commit on urllib2 13:35:27 and your colleague said that Chris wanted to have offline version 13:35:32 we start with internet, but i think long term we should also have offline 13:35:55 morgan_orange: we have to evaluate how much effort that is needed for us 13:36:07 I would say that it is out of scope for R2 13:36:16 its not so complicated though... 13:36:20 we would see for intermediate version 13:36:32 because Chris wanted to run the demo offline 13:36:33 no it is just bigger because you must get all the packages you need 13:36:37 and even fuel is giving problems :) 13:36:46 I am not sure to follow the intereste of an offline demo 13:37:05 offline I mean without internet access 13:37:06 but anyway 13:37:16 we will discuss it some other day 13:37:30 or we may say that we will consider it as an improvement 13:37:36 if we can do it in R2 why not 13:37:44 but we will have lots of testcases 13:37:52 good to have but not mandatory? 13:37:57 yes 13:38:00 agree 13:38:00 for us is now mandatory.. 13:38:15 ah so it was not a question :) 13:38:16 we can include the cirros image inside the docker image 13:38:42 anyway, will see 13:39:04 ok 13:40:07 nothing else from me 13:40:08 #info question on the possibility to run tests without Internet connection (retrieve of disk image, access to git repo,...) 13:40:16 #info could be needed for demo? 13:40:34 #info consensus for a good to have but not mandatory... 13:40:39 yes, for further demos maybe 13:40:48 #info even if it seems mandatory 13:40:48 not for this one :D 13:41:03 try to sell OPNFV in the middle of Australia... 13:41:23 ok any other topic we want to share? 13:41:42 no 13:42:18 #endmeeting