18:15:24 <dfarrell07> #startmeeting cperf
18:15:24 <collabot`> Meeting started Thu May 19 18:15:24 2016 UTC.  The chair is dfarrell07. Information about MeetBot at http://wiki.debian.org/MeetBot.
18:15:24 <collabot`> Useful Commands: #action #agreed #help #info #idea #link #topic.
18:15:24 <collabot`> The meeting name has been set to 'cperf'
18:17:48 <dfarrell07> #info We now have a Docker image with our test tools on DockerHub as opnfv/cperf, so `docker run -it opnfv/cperf` works
18:17:53 <dfarrell07> #link https://hub.docker.com/r/opnfv/cperf/ CPerf test tools Docker container on DockerHub
18:18:31 <dfarrell07> #info jamoluhrsen points out that next TODO is to install NSTAT on this test container
18:18:49 <dfarrell07> #action dfarrell07 or Nikos to install NSTAT on test container
18:22:20 <dfarrell07> #info dfarrell07 and Al talk about Pharos reservation system and changes to how pods are managed
18:22:36 <dfarrell07> #info discussion about if POD 2 status
18:22:48 <dfarrell07> #info we're unsure how much of POD 2 works
18:24:50 <dfarrell07> #info dfarrell07 reports back on testing project progress at plugfest and docs given on this morning's OPNFV test call
18:24:58 <dfarrell07> #link https://wiki.opnfv.org/display/functest/Testing Carbon Functest testing overview wiki, recently updated by plugfest and Morgan
18:25:05 <dfarrell07> #link http://testresults.opnfv.org/testapi/test_projects/cperf API for CPerf's OPNFV tests
18:25:11 <dfarrell07> #link http://testresults.opnfv.org/testapi/test_projects/promise API for CPerf's OPNFV tests
18:30:54 <dfarrell07> #info Nikos has released an updated version of their perf paper https://raw.githubusercontent.com/wiki/intracom-telecom-sdn/nstat/files/ODL_performance_report_v1.2.pdf
18:31:42 <dfarrell07> #info dfarrell07 asks Nikos for overview of interesting results
18:31:55 <dfarrell07> #info Nikos asks for feedback about paper, which metrics and parts we cared about
18:32:06 <dfarrell07> #info Nikos points us at ex summery for highlights
18:32:22 <dfarrell07> #info Soon results are coming via dashboard, in more detail, live
18:32:49 <jamoluhrsen> n_anastop, thanks for the report.  I will read it over the weekend.
18:35:26 <dfarrell07> #info Jamo points out that we can run tests in ODL infra using opnfv/cperf image, maybe more quickly/easily
18:37:00 <dfarrell07> #info Nikos saw OOM fails when running cbench test, but doesn't think it's ODL b/c JVM would limit RAM, not seeing same issues when using mini/multinet
18:37:23 <dfarrell07> #info Note that Nikos has stability tests in this report, which we don't in ODL report, so point people to this
18:37:53 <dfarrell07> #info Luis points out that it's good how they report RAM/CPU/etc info in report, we might start doing that in ODL whitepaper, Luis has intern who will work on similar
18:38:20 <dfarrell07> #action dfarrell07 will work on adding NSTAT install to opnfv/cperf image
18:39:46 <dfarrell07> #info Nikos gives tip about using "flame graphs" in perf reporting and profiling
18:40:47 <dfarrell07> #link http://www.brendangregg.com/flamegraphs.html Flame graph tool Nikos has turned us on to
18:43:41 <dfarrell07> #info Luis is super excited about this Flame Graph thing ;)
18:44:34 <dfarrell07> #info Luis talks about 1.1 of perf whitepaper, which should come out Monday
18:45:01 <dfarrell07> #info There were some minor changes, but the general idea is the same - they perf about the same and work for the usecases being considered
18:45:13 <dfarrell07> #info Much better wording in second report, time to edit/iterate more
18:45:35 <dfarrell07> #info ONOS has reviewed paper, said yesterday they like it and are fine
18:46:20 <dfarrell07> #info Cluster testing and Java API testing are likely still going to be blogged about, not a big deal, flame war avoided
18:47:14 <dfarrell07> #info For future work, we've asked ONOS to join CPerf for collab, not testing them ourselves in our whitepapers
18:51:03 <dfarrell07> #endmeeting