08:29:09 #startmeeting Yardstick work meeting 08:29:09 Meeting started Thu Jul 7 08:29:09 2016 UTC. The chair is kubi. Information about MeetBot at http://wiki.debian.org/MeetBot. 08:29:09 Useful Commands: #action #agreed #help #info #idea #link #topic. 08:29:09 The meeting name has been set to 'yardstick_work_meeting' 08:29:18 #topic call role 08:29:22 #info Kubi 08:30:07 #info Mingjiang 08:30:11 #info Jing 08:30:18 #info lihuan 08:30:22 #info songnon 08:31:12 #info qiujuan 08:31:27 songnon: Hi, nice to see you again, I wonder if you are interested in yardstick. If yes, I 'd like to invite you as a contributor 08:31:38 sure 08:31:55 kubi: Thanks 08:31:56 songnon: great, welcome 08:32:00 #info Kanglin 08:32:26 songnon: could you give me you Name and email address? 08:32:44 songnon: so that I can add you into contributor list 08:33:00 kubi: Songnon Zhang, email is songnon.zhang@ericsson.com 08:33:46 songnon: got it. thanks 08:34:00 #topic New contributor 08:34:02 kubi: :) 08:34:37 #info Songnon Zhang would be a new contributor of yardstick. songnon.zhang@ericsson.com 08:34:55 welcome 08:35:01 welcome 08:35:12 thanks 08:35:24 #action Kubi will add songnon into contributor list 08:35:53 #topic Release Plan 08:37:18 I reorganize the plan to become clear for everyone 08:37:23 #link https://etherpad.opnfv.org/p/yardstick_release_c_feature_freeze 08:38:06 #action All please check the release plan, and give commments 08:39:24 #info Yaoguang 08:40:00 Yaoguang_Wang: hi , please check this link https://etherpad.opnfv.org/p/yardstick_release_c_feature_freeze 08:40:53 any question about this plan? 08:41:13 kubi: yep. i saw it. i am okay for integration storperf and vsperf into yardstick 08:41:29 Yaoguang_Wang: great, thanks 08:41:50 +1 08:42:02 Jing: Thanks 08:42:58 There are some test cases unassigned from TC57 to TC68 08:43:15 kubi: if Junli has no enough time to implement capacity/scale, i would like help him do some storage capacity 08:43:35 please feel free to assign it if some of you are interested in some test cases 08:43:46 Yaoguang_Wang: that's great 08:44:06 please comment it in that etherpad page 08:45:56 goutham: ping 08:46:43 #topic others 08:47:03 Hi, i'd like to someting to make yardstick test base on scenarios 08:47:14 in ci 08:48:02 Mingjiang5: do you mean make yardstick test suite base on scenarios? 08:48:51 for ci, yes 08:48:59 now the ci is using *pod_name*.yaml to decide what to run in one pod. 08:49:32 so all scenarios in one pod are running the same test suite, which doesn't make sense. 08:49:32 Mingjiang5: yes, It is based on POD 08:50:25 Mingjiang5: Yes, you are right, We should run different test case in different secnario 08:50:51 kubi: as we know, each installers deploy different scenarios in a series of ci jobs. test cases are related to the scenario, but not the pod. So it's reasonable to run test cases based on scenarios. 08:51:32 Mingjiang5: And also, community also want yardstick test case run based on scenarios 08:52:01 Mingjiang5: that is a good idea 08:52:32 zhihui_wu: ping 08:53:16 at present, ci use pod_name to call a test suite in yardstick. 08:53:16 to make it run on scenarios, we can simply modify the parameter that pass to yardstick to be a scenario. 08:53:33 we can change it from the pod_name to the scenario_name 08:53:50 hi 08:53:57 hi kubi 08:53:58 then we can create test suite named by the scenario. 08:54:15 i am sorry i was late 08:54:26 please tell 08:54:34 goutham: hi, wait a minutes, we will discuss GUI after Mingjiang's topic 08:54:46 yea sure :) 08:54:48 so each scenario owner would be responsible to maintain the sceanrio.yaml 08:55:12 Mingjiang5: that's what community want 08:56:14 this is my plan for release C, what do you guys think? 08:56:46 sounds good 08:57:17 +1 08:57:45 I suggest you could propose this idea at today testing weekly meeting 08:58:40 kubi: ok, i'll try it. 08:58:51 Mingjiang5: Thanks 08:59:02 #topic Yardstick GUI 08:59:21 hi 08:59:28 can i start kubi?? 08:59:34 goutham: yes 08:59:50 so as of now we can do this way 09:00:07 we are using Releng code to store results in mongodb 09:00:17 which intern uses tornado framework 09:00:27 using that we can develop GUI 09:00:33 but 09:01:05 if we want to generate HTMl pages jus as Rally as a application (Raas) does 09:01:33 i guess we have to use Mako files and generate HTML pages 09:01:56 i mean we have to develop html files using Mako files and 09:02:25 generate HTML for which Tornado is not necessry 09:02:46 i have sent a wire frame a rough one without any colors via Mails 09:02:52 https://etherpad.opnfv.org/p/Yardstick_GUI 09:03:15 and this is the Etherpad link you can provide your comments or suggestion 09:03:17 here 09:04:27 so we should create a web application jus like Rally or should we need a complete dash board (which does execution of test-cases) and shows the result there it self?? 09:05:24 goutham: what rally does is just a test result report or not? 09:05:39 it jus gives a test-report 09:05:45 after the executio 09:05:51 goutham: got it 09:05:53 of test case 09:06:13 goutham: what 's your original idea? 09:06:24 my idea is to the Rally way 09:06:33 to do ** 09:07:14 goutham: Rally way is great for Yardstick in Colorado 09:09:12 goutham: A completed dashboard (which does exection of test case and show the result) will be expected in future Release. 09:09:38 ok 09:09:47 so if that is the case we can acheive it 09:09:51 using tornado 09:09:53 itself 09:10:16 but it will be great if we can have some rest api working for that 09:11:23 goutham: One more question. Rally way is a web application on the Internet? 09:11:44 no 09:11:57 its like you run a test-case 09:11:57 goutham: could the test report be generated in local. 09:12:26 goutham: that's great 09:12:33 you get a command which upon executing we get a html page 09:12:50 a normal .html page 09:13:07 thats it 09:14:16 goutham: sounds good 09:14:25 this is what rally does 09:14:33 so for yardstick 09:15:10 should i generate a page like rally or a complete dash board which 09:15:25 has both execution and display of results 09:15:29 goutham: so execute a command to tornado, then it generate a html for report? 09:16:24 no basically tornado is like a server running on a particular port 09:16:33 @Ming 09:16:33 goutham: Error: "Ming" is not a valid command. 09:17:12 goutham: it can only process the rest api, right? 09:17:28 goutham: a question I have is that, if the .html page is generated locally, how can the user view that page? 09:18:06 yea it works on Rest-api but 09:18:43 the communication but i dont think there something like get or post between Yardstick code and Tornado :| 09:19:14 if it is generated locally user jus clicks that a webpage pops out thats it 09:19:41 Songnon: 09:19:47 goutham: do the gui has function for user to select which test case to run? 09:21:14 Mingjiang5: If we want a full length dash board which contains both execution of test-case and displaying the results then yes it has to be there 09:21:46 this can be done using the releng framework.. 09:22:52 goutham: Mingjiang5: If we want to run test case via GUI, Rest api would be need, yes? 09:24:51 we can do that in another way 09:25:02 but i guess thats a crude way :| 09:25:32 without rest-calls 09:27:36 i think we truely need rest-api to do this. 09:27:42 Like logging the output via cli 09:27:51 using subprocess 09:28:05 it can be done but not a good way to do that 09:28:16 i guess 09:28:29 Mingjiang5 : yes 09:28:40 we need Rest-API support 09:28:56 goutham: I also prefer Rest API 09:29:34 Rest API will be a decent way... 09:32:31 Kubi: 09:32:54 so then i need some help on this 09:33:12 i have used Rest Api but never developed using that 09:33:28 so it will be great if some one helps me on this 09:33:39 Can any one help me on this?? 09:34:24 goutham: Ok, anyone is familiar with Rest api development? 09:35:20 goutham: I will ask Qi liang who did some Rest Api development to provide the support. 09:36:13 goutham: let's discuss more in email, we have to leave the office now. 09:36:17 Kubi :thank 09:36:21 you 09:36:32 goutham: thanks for your great work:) 09:36:32 Kubi: yea sure thanks for the time 09:36:53 goutham: i have no experience on that, but i can do some homework to help 09:36:54 thank you and same to you 09:37:09 thanks all for today. 09:37:19 Mingjiang5: thanks for help 09:37:29 lets make Yardstick a better product :) 09:37:41 goutham: great:) 09:37:49 #endmeeting