15:05:05 #startmeeting TestPerf Weekly Meeting 15:05:05 Meeting started Thu May 25 15:05:05 2017 UTC. The chair is mbeierl. Information about MeetBot at http://wiki.debian.org/MeetBot. 15:05:05 Useful Commands: #action #agreed #help #info #idea #link #topic. 15:05:05 The meeting name has been set to 'testperf_weekly_meeting' 15:05:36 #info Discussion on Big Data for Testing 15:05:39 #info Al Morton 15:05:52 #topic Roll Call 15:05:57 #info Mark Beierl 15:06:06 #info Yujun Zhang 15:06:11 #info Ace Lee 15:06:15 #topic Discussion on Big Data for Testing 15:06:19 #info Jack 15:06:23 #chair yujunz 15:06:23 Current chairs: mbeierl yujunz 15:06:28 #link https://docs.google.com/presentation/d/1GISQICDX3s9Od7eDGO-N9X-czMCcCrL3gxygr3hTePg/edit?usp=sharing 15:08:21 #info many people are on holiday, so we shall discuss just about storperf test data 15:08:47 I guess no one else is seeing "Unable to Process Your Request" errors? https://global.gotomeeting.com/join/305553637 15:09:05 dfarrell07: hang on - the id is different I think 15:09:18 https://global.gotomeeting.com/join/819733085 15:09:21 dfarrell07: $ 15:12:03 mbeierl: cool, that worked, thanks :) 15:24:11 #info mbeierl described the multidimentional storperf raw data and summaries 15:24:24 #chair acm_ 15:24:24 Current chairs: acm_ mbeierl yujunz 15:24:52 #link http://testresults.opnfv.org/test/api/v1/results/590b2ea581fe76000ab366a2 15:24:59 #info bw is in bytes per second 15:25:13 #info an example of all the summary data that is stored in the OPNFV testresults DB from StorPerf 15:25:39 #info Trevor Cooper 15:25:50 #info the "metrics" JSON element is a summary of all the values 15:26:15 #info the "report_data" is the raw numbers used to calculate the "metrics" summary 15:26:36 #info raw data of storperf current kept in storperf container and discarded with daily job 15:27:24 raw data is saved in carbon and visualized in graphite ? 15:27:37 #info bw typically delcines with time as the test runs, the convention is that declining values must reach a certain tolerance before the test is terminated and stable values are declared as achieved 15:28:58 #info there seems to be quite a bit of variation in results reporting for each test project. 15:31:13 #info Mark has to go, thanks! 15:31:43 #topic Big Data 15:32:39 #info Trevor talks about how data processing in vsperf 15:42:39 #info trevor expect a dynamic way of creating comparison calculation and play with the data 15:46:22 #info Bryan described a stress testing tool that will be OS at some point, as an example of mass data collection in a data lake... 15:50:27 #info there is a realtionship to chaos monkey / failure injection testing, examine failure scenarios of interest. 15:50:45 #info data lake becomes an ocean... 15:54:08 #topic AoB 15:54:27 open discussion 15:56:33 #action yujunz provide a travel guide from airport to hotel in Chinese for the taxi driver 15:57:21 #endmeeting