18:12:09 <dfarrell07> #startmeeting cperf
18:12:09 <collabot> Meeting started Thu Sep 15 18:12:09 2016 UTC.  The chair is dfarrell07. Information about MeetBot at http://wiki.debian.org/MeetBot.
18:12:09 <collabot> Useful Commands: #action #agreed #help #info #idea #link #topic.
18:12:09 <collabot> The meeting name has been set to 'cperf'
18:12:22 <dfarrell07> #chair LuisGomez jamoluhrsen mgkwill
18:12:22 <collabot> Current chairs: LuisGomez dfarrell07 jamoluhrsen mgkwill
18:16:02 <dfarrell07> #inf o Yuanwen of ONF testing and interop group will give presentation to CPerf about their activities, discussion about how we can collaborate
18:16:12 <dfarrell07> #undo
18:16:16 <dfarrell07> #info Yuanwen of ONF testing and interop group will give presentation to CPerf about their activities, discussion about how we can collaborate
18:19:33 <LuisGomez> joining now
18:20:23 <dfarrell07> #info Daisy is with Ixia, co-chair of ONF testing and interop group
18:21:21 <dfarrell07> #info Goal is to accelerate testing efforts, current focus is on OpenFlow
18:21:34 <dfarrell07> #info Various parties involved, vendors and users
18:23:32 <dfarrell07> #info Frequent plugfest and appfest to do interop
18:23:49 <dfarrell07> #info Developing and promoting OF benchmarking methods
18:24:08 <dfarrell07> #info OF benchmarks are split into switch and controller
18:25:42 <dfarrell07> #info dfarrell07 asks about this ONF benchmark work vs IETF work we've seen before
18:26:22 <dfarrell07> #info Daisy says IETF is more general, ONF work is really focused on OF
18:27:31 <dfarrell07> #info Al confirms that IETF work is trying to be general on the SB
18:29:10 <dfarrell07> #info mgkwill asks about switch side of benchmarking, Intel has been thinking about that recently, Maracus is wondering status/progress of that work, how best to profile OVS/similar
18:30:25 <dfarrell07> #info Daisy says switch work is in draft format, have test cases contributed from test tool vendors, pretty hard to fix methodology that can apply to many switches but agreement about focus on OF
18:32:30 <dfarrell07> #info ONF work trying to focus on use cases, to get around huge diversity of SBs controllers can support, to fix some factors and get comparisons between implementations
18:33:10 <dfarrell07> #info OF 1.3 is in scope, other SBs and NBs are not
18:34:38 <dfarrell07> #info First big category of bench marking is OF channel, second is flow setup, third is data plan failure recovery
18:35:46 <dfarrell07> #info mgkwill asks about support for these tests with Ixia, they have some 1.0 stuff but 1.3 is under dev, should have some stuff by end of year (mgkwill has Ixia boxes he wants to use for this)
18:36:20 <dfarrell07> #info LuisGomez asks about how they will do proactive programming testing if they don't want to include NB in scope
18:37:32 <dfarrell07> #info Seems like tool itself would need to live in controller (like we do with ODL blaster tests)
18:38:38 <dfarrell07> #info LuisGomez points out that in ODL, OF Plugin doesn't know things about paths, so some of these tests would test app in ODL vs OF Plugin
18:39:08 <dfarrell07> #info Daisy says goal is to fix as much app-stuff as possible, isolate SB factors to compare better
18:40:26 <dfarrell07> #info LuisGomez says that apps that manage paths will have different behaviors, not super clear how to standardize/fix that (deeper dive required to answer imho)
18:40:45 <dfarrell07> #info LuisGomez says metrics make sense overall
18:41:58 <dfarrell07> #info LuisGomez is very interested in how to implement these tests in a cluster, which controller to address, etc
18:49:18 <dfarrell07> #info Lots of good ways to collaborate it seems, both in terms of auditing/feedback about test specs/standards and implementing them in actual running test in OPNFV CI
18:49:51 <dfarrell07> #info Daisy is encouraged to continue joining calls if she wishes, or at least join sometimes to give us updates about this progress
18:50:12 <dfarrell07> #info Daisy will send slides and maybe pre-release paper to dfarrell07 and LuisGomez, who will send to others
18:50:16 <dfarrell07> #endmeeting