14:01:18 <mackonstan> #startmeeting FD.io CSIT Project Meeting
14:01:18 <collab-meetbot> Meeting started Wed Jun 10 14:01:18 2020 UTC and is due to finish in 60 minutes.  The chair is mackonstan. Information about MeetBot at http://wiki.debian.org/MeetBot.
14:01:18 <collab-meetbot> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote.
14:01:18 <collab-meetbot> The meeting name has been set to 'fd_io_csit_project_meeting'
14:01:21 <mackonstan> #chair
14:01:21 <collab-meetbot> Current chairs: mackonstan
14:03:08 <dwallacelf> #info Dave Wallace
14:05:23 <tifrank> #info Tibor Frank
14:05:24 <mackonstan> #topic Agenda bashing
14:05:36 <mackonstan> #topic Inputs from projects - VPP
14:06:39 <mackonstan> #info Dave v20.09 schedule approved by VPP community, otherwise business as usual, ongoing cherry picks for stable/1908 and stable/2001.
14:07:33 <mackonstan> #topic Inputs from projects - VSAP
14:07:41 <mackonstan> #topic Inputs from projects - TSC
14:08:09 <mackonstan> #info re VSAP - Dave - first community meeting scheduled for this Friday
14:08:52 <mackonstan> #topic Releases CSIT-2005
14:09:31 <pmikus> #info Peter Mikus
14:10:13 <vrpolak> #info Vratko Polak (better late then never).
14:11:00 <mackonstan> #info Tibor - report test execution progress >50% jobs done, report publish ETA 17-June (with 5 iterative, some coverage)
14:11:58 <mackonstan> #info Tibor - will send finished/total test jobs to csit-dev
14:12:38 <mackonstan> #info Tibor - report, continuously adding test data, and generating report versions in master, rls notes are still to be updated.
14:13:38 <mackonstan> #topic Releases - CSIT-2001
14:14:06 <mackonstan> #info Vratko - final RCA for skx added, for now it is complete, see latest report version
14:14:59 <mackonstan> #link https://docs.fd.io/csit/rls2001/report/_static/vpp/performance-rca-2n-skx-2t1c-pdr.txt
14:15:08 <mackonstan> #link https://docs.fd.io/csit/rls2001/report/vpp_performance_tests/comparisons/current_vs_previous_release.html#pdr-comparison-with-rca
14:15:22 <mackonstan> #topic Releases - CSIT-1908.2
14:15:37 <mackonstan> #topic Physical Infrastructure
14:17:18 <mackonstan> #info Peter - tb23 down due to SSD failure, SSD spare available, ticket open
14:17:21 <mackonstan> #link https://secure.vexxhost.com/billing/viewticket.php?tid=VJF-919439&c=K5H44fLY
14:20:09 <mackonstan> #info Govind - 2 new thunderX2 servers boxed up in the UK, can't ship them to Canada because Arm is not registered in the Canada. Vexxhost needs to pay import taxes.
14:20:31 <dwallacelf> #info server-type-c4-3 (10.32.8.16) is still waiting for removal of bad SSD's
14:20:35 <dwallacelf> #link https://secure.vexxhost.com/billing/viewticket.php?tid=AGA-517631&c=3RxtvTXs
14:21:14 <mackonstan> #info Maciek - pls open the Vexxhost ticket to this regard.
14:24:45 <mackonstan> #topic Virtual Infrastructure, CI/CD
14:26:03 <mackonstan> #info Jenkins master - good
14:26:47 <mackonstan> #info Nomad - Peter - server physical issues - SSDs (see tickets), ECC memory failures (see tickets)
14:27:27 <mackonstan> #info Nomad - Dave - some other Arm server was offline, got resurrected by Juraj, but locked up again, need to be rebuilt
14:27:42 <mackonstan> #info Nomad - Peter - nomad6 being rebuilt, nomad7 running
14:27:58 <mackonstan> #info Nomad - Peter - pixie for Arm running now 100%
14:31:48 <mackonstan> #info Nomad - Peter - added initial monitoring (Prometheus+Grafana), but looking to develop it further to monitor all aspects of Nomad cluster operation (syslog parsing, network operation, custom monitoring scripts e.g. ping_monitors). More updates on Friday TWS call.
14:33:08 <mackonstan> #info Monitoring - Dave - added number of ping_monitor scripts to monitor and report network connectivity
14:37:43 <mackonstan> #info Peter - will add daily (digest) alerting over email to csit-report@lists.fd.io (or similar)
14:41:38 <mackonstan> #info Maciek - job_specs getting updated
14:41:40 <mackonstan> #link https://git.fd.io/csit/tree/docs/job_specs
14:43:08 <mackonstan> #info mapping to gerrit triggers
14:43:11 <mackonstan> #link https://git.fd.io/csit/tree/resources/libraries/bash/function/common.sh
14:44:47 <mackonstan> #info TWS calls on infra - calls continue
14:49:41 <mackonstan> #info Peter, Dave - provided update
14:52:54 <mackonstan> #info Peter and Dave to run the next  TWS call on Friday (Maciek on PTO)
14:53:03 <mackonstan> #topic Environment, Framework
14:53:57 <mackonstan> #info Peter - TRex duration stretching - expecting data from Maros's tests AWS today/tomorrow, will discuss with Vratko, Maciek
14:56:22 <mackonstan> #info Govind - if CSIT is ready in AWS - interested to see Graviton2 based test results
14:57:19 <mackonstan> #info Govind - will start email thread with folks to get this going
14:58:33 <mackonstan> #topic Virtual Infrastructure, CI/CD
14:59:59 <mackonstan> #info re "vpp-csit jobs: vpp-csit-verify-device (not voting), "vppapigen: api crc checker" status" - Vratko, Andrew and Maciek to huddle to address the new process
15:01:39 <mackonstan> #topic Performance Tests
15:02:06 <mackonstan> #info +Dave for new process for API checks
15:02:27 <mackonstan> #topic New tests: NAT44-EI, NAT44-ED
15:02:58 <mackonstan> #info Maciek - lots of things happening, TRex STL, ASTF new profiles being defined for stateful tests
15:03:41 <mackonstan> #endmeeting