14:02:09 <pmikus> #startmeeting FD.io CSIT project meeting 14:02:09 <collabot`> Meeting started Wed Apr 15 14:02:09 2020 UTC. The chair is pmikus. Information about MeetBot at http://wiki.debian.org/MeetBot. 14:02:09 <collabot`> Useful Commands: #action #agreed #help #info #idea #link #topic. 14:02:09 <collabot`> The meeting name has been set to 'fd_io_csit_project_meeting' 14:02:18 <pmikus> #info Peter Mikus 14:02:28 <tifrank> #info Tibor Frank 14:02:37 <pmikus> #chair 14:02:37 <collabot`> Current chairs: pmikus 14:03:48 <pmikus> #topic Agenda bashing 14:05:00 <vrpolak> #info Vratko Polak. 14:05:07 <pmikus> #topic Physical labs, testbed 14:06:04 <pmikus> #info 02.04.2020; s11-t31-sut1; #VON-682079 Primary SSD failure #info 14.04.2020; s11-t31-sut1; #GGH-021065 Secondary SSD failure #info 15.04.2020; s15-t32-sut2; #THO-046454 14:06:57 <pmikus> #info Agreed with Maciek that we should have at least 10x SSD spares available in stock for quick replacement 14:09:27 <pmikus> #info Mail to be sent to TSC/Ray Kinsella/Trishan with current status and plan for spares 14:10:16 <pmikus> #info Functional and driver testing: Xeon Skx, Arm. - no issues. 14:10:56 <pmikus> #topic Inputs from projects 14:11:34 <vrpolak> #link https://wiki.fd.io/view/TSC/Relicensing_Procedure 14:12:01 <pmikus> #info TCS: Vratko reported communication about SSD failures, Licensing issue - procedure established with lawyers link above from Vratko 14:13:16 <pmikus> #info Not clear the order of steps due to running out of time on call. Will follow later. 14:13:21 <dwallacelf> #info Dave Wallace 14:13:54 <pmikus> #info VPP: Nothing new 14:14:04 <pmikus> #info VSAP: Nothing new 14:14:25 <pmikus> #info CNCF CNF Testbed - Nothing new 14:14:40 <pmikus> #topic Releases 14:15:43 <pmikus> #info CSIT-2001 Release, 2n-skx, 3n-skx testing status - Jobs finished, data collected, Tibor processed in PAL to new comparison tables 14:17:30 <pmikus> #info CSIT-1908.x Currently 2n-skx are finished, 3n-skx few jobs finished and rest is blocked due to SSD failures on both 3n-skx, waiting for RMA's (see above). 14:19:26 <pmikus> #info Vratko: 1908.x weekly mrr working, l2patch failing. 14:20:20 <pmikus> #info Currently maintenance releases are released prior testing (unlike stable releases with RCx approach) 14:20:55 <pmikus> #info Plan is to use weekly testing 14:21:09 <pmikus> #info CSIT-2005 Release 15:14:03 <pmikus> #info CSIT-2005 Release - new Virtio VPP native tests, increase coverage of functional tests (ipsec, srv6...), vswtich-less tests 15:15:38 <pmikus> #info VPP-2001.1 release prior RC of stable 2005, Dave asking for capacity. Peter reply that should be possible based on 1908.1 experience and limited amount of tests 15:17:27 <pmikus> #action Finish all work on 1908.1 test lists. Create 2001.1 test list from 1908.1 analogues (in gerrit), add few interesting tests (Load Balancing), review and merge 15:17:38 <pmikus> #topic Operations 15:18:46 <pmikus> #info LFN FD.io CI/CD infra: Jenkins, no outages spotted, one hiccup spotted by Jan when job gets stuck in init phase, closer monitoring not occured anymore yet 15:19:03 <pmikus> #info Jenkins jobs: VPP, CSIT, trending, one failure daily jobs for DNV (did not repeat), vpp-verify-centos one failure with compiling (timestamps issue, NTP related?). 15:19:11 <pmikus> #info Centos CI - currrently not supported in CSIT 15:19:21 <pmikus> #info CSIT committers - PTL will follow and update the list 15:19:27 <pmikus> #topic VPP code performance 15:20:26 <pmikus> #info VHOST test fixed, AVF init - VPP tickets opened VPP-1858, no progress, IPSEC HW failure - investigation in progress, few sporadic failure (ip4, ip6) 15:21:08 <pmikus> #info Regression on IP6 scale tests, tests are passing but performance is low. Issue related to VAT (PAPI SCALE is not affected). Discussion about support of VAT or merge PAPI SCALE. 15:21:14 <pmikus> #topic Developments 15:23:41 <pmikus> #info Framework: PAPI scale in CSIT - CSIT is deeply interacting with VPP backend (PAPI threads), Vratko wants to keep modyfing running VPP code via CSIT. Peter: Would be good to implement the patch/fix also into VPP to benefit for everyone outside CSIT. Vratko: Benefits are that having CSIT code allows us to do bisecting, on the other side implementing fixes in VPP would mean to support multiple code 15:23:47 <pmikus> versions. Discussion opened. 15:24:26 <pmikus> #info Dave proposed to discuss with Ole and to have all the fixes in VPP as well. Peter: Having temporary solution is fine if it will be followed with proper patch. 15:24:58 <pmikus> #info Vratko sees an action plan to split change into 4 parts including current patch, vpp patch and two other to have permanents fix. No other objections. 15:25:05 <pmikus> #topic TRex 15:26:41 <pmikus> #info Peter working on calibrating the mellanox NIC with T-rex. Peter to follow up findings and consult with T-Rex-dev. Peter to implement DPDK testpmd baseline mellanox tests as a start point 15:26:55 <pmikus> #info Vratko reported that tests with randomizing flows are misbehaving - fix proposed with not "fixed" seed 15:27:02 <pmikus> #endmeeting