15:02:29 <mackonstan> #startmeeting FD.io CSIT project meeting
15:02:29 <collabot`> Meeting started Wed Jan  8 15:02:29 2020 UTC.  The chair is mackonstan. Information about MeetBot at http://wiki.debian.org/MeetBot.
15:02:29 <collabot`> Useful Commands: #action #agreed #help #info #idea #link #topic.
15:02:29 <collabot`> The meeting name has been set to 'fd_io_csit_project_meeting'
15:02:35 <vrpolak> #info Vratko Polak.
15:02:35 <mackonstan> #chair
15:02:35 <collabot`> Current chairs: mackonstan
15:02:40 <dwallacelf> #info Dave Wallace
15:02:44 <jgelety> #info Jan Gelety
15:02:46 <tifrank> #info Tibor Frank
15:04:44 <mackonstan> #topic Agenda bashing
15:04:59 <mackonstan> #info Tibor - what are we doing with DMM tests
15:05:53 <mackonstan> #topic Physical labs, testbeds
15:07:17 <mackonstan> #info Peter - SSD drive in t31 failed. Suspecting firmware in Intel SSD driver, making the drives fail after ~1800hrs in operation. Peter taking care of this with Vexxhost contact / Nana.
15:08:12 <mackonstan> #info Ed - open ticket with Vexxhost - 3 new servers for s5ci jobs are on different network, can't reach the main cluster of servers running jobs and tests.
15:08:36 <pmikus> #info Intel SSD 1.92TB and 3.84TB SKUs may become unresponsive at 1700 hrs. of cumulative Idle Power On Hours
15:08:51 <pmikus> #link https://www.intel.ca/content/www/ca/en/support/articles/000038720/memory-and-storage/data-center-ssds.html
15:10:11 <mackonstan> #info Ed - few upgrades over the year's end break, no major breakages.
15:10:35 <mackonstan> #topic Inputs from projects
15:11:15 <mackonstan> #info VPP - no updates, apart from many patches with API changes, creating the backlog for vpp-csit-crc check job.
15:12:34 <mackonstan> #info TSC - new FD.io project voted in - "VASP" - for VPP VCL glue code
15:12:52 <vrpolak> #link https://wiki.fd.io/view/Project_Proposals/VSAP  <-- New project, approved conditionally.
15:12:54 <mackonstan> #info CNCF CNF Testbed - no updates
15:13:11 <mackonstan> #topic Releases
15:15:42 <mackonstan> #info stable/1908 weekly trending jobs - Jan, Maciek - take care of this, aim for a readout to vpp community on the next week call.
15:16:09 <mackonstan> #info vpp plan for next 1908.2 maintenance release - looking at scheduling it after v20.01 ships.
15:17:08 <mackonstan> #info CSIT-2001 - see schedule
15:17:14 <mackonstan> #link https://wiki.fd.io/view/CSIT/csit2001_plan
15:17:36 <mackonstan> #info F0 milestone today, RC1 and branch pull next week Wed 15-Jan
15:20:17 <mackonstan> #info pls update the table in the link above for completed work for CSIT-2001
15:20:21 <mackonstan> #topic Operations
15:22:05 <mackonstan> #info LFN FD.io CI/CD infra: Jenkins, ... - Ed Kern - all in green at the moment, some long outage reported in LFN backend (OpenStack builder) transparent to FD.io as FD.io jobs run on Nomad now.
15:26:35 <mackonstan> #info Peter - planned maintenance as announced by Vanessa on csit-dev for 5-Feb, Maciek to ask to postpone till after 19-Feb.
15:28:15 <mackonstan> #info Jenkins jobs: VPP, CSIT, trending - number of failures due to server failures, kernel updates and such. Peter, Maciek - will send summary report to csit-dev mailer.
15:30:18 <mackonstan> #info kernel updated on all machines from Linux kernel 4.15.0-62 to the latest Ubuntu upstream for 18.04 LTS is -72
15:32:15 <mackonstan> #info introduced new processor ucode on skx and clx Xeon servers with more/new Meltdown/Spectre mitigation code
15:32:29 <mackonstan> #info regression on clx and skx
15:32:37 <mackonstan> #link https://docs.fd.io/csit/master/trending/trending/ip4-2n-clx-xxv710.html
15:34:28 <mackonstan> #info kernel upgrade to be done Xeon hsw, Atom Denverton, Taishan Arm
15:35:29 <mackonstan> #info Govind from Arm team offered to assist with upgrading kernel on Taishan Arm machines
15:37:06 <mackonstan> #info every CSIT test runs spectre-meltdown-checker
15:37:08 <mackonstan> #link https://github.com/speed47/spectre-meltdown-checker
15:38:08 <mackonstan> #info vpp-csit-device tests - re-enable voting - Vratko - still not voting - was failing due to tap tests, now fixed. Before enabling voting we need to fix the process of vpp api changes.
15:38:43 <mackonstan> #info Centos CI - no update
15:38:53 <mackonstan> #topic VPP code performance
15:39:12 <mackonstan> #topic Developments
15:41:12 <mackonstan> #info Deprecated tests: HoneyComb, DMM, NSH_SFC, TLDK, Ligato - all are deprecated before python3 migration, apart from DMM and TLDK.
15:41:27 <mackonstan> #info Tibor sent email to dmm mailer on 21-Nov, no reply so removing.
15:42:37 <mackonstan> #info Tibor already prepared a patch to remove DMM
15:43:04 <mackonstan> #info Vratko already prepared a patch to remove TLDK once DMM is removed. Will ping tldk mailer to check for any sign of life.
15:43:17 <mackonstan> #topic TRex
15:46:01 <mackonstan> #info Peter - finally received a working patch to the firmware to remove the limit of 27Mpps for TRex. TRex provide an updated release v2.73 with this patch, and it got merged into CSIT master. Should be on trending pages next week once oper branch picks it up.
15:53:17 <mackonstan> #info Nithy - API test coverage - should use this files as a reference to complete coverage
15:53:20 <mackonstan> #link https://git.fd.io/csit/tree/resources/api/vpp/supported_crcs.yaml
15:57:48 <vrpolak> #link https://lists.fd.io/g/ci-management-dev/topic/29918440  <-- Example of how Vratko become a committer on ci-management.
16:01:07 <mackonstan> #endmeeting