========================================= #fdio-meeting: FD.io CSIT Project Meeting ========================================= Meeting started by mackonstan at 15:00:02 UTC. The full logs are available at http://ircbot.wl.linuxfoundation.org/meetings/fdio-meeting/2022/fd_io_csit_project_meeting/fdio-meeting-fd_io_csit_project_meeting.2022-01-12-15.00.log.html . Meeting summary --------------- * Vratko Polak. (vrpolak, 15:00:30) * mackonstan (mackonstan, 15:01:22) * Tibor Frank (tifrank, 15:02:11) * Agenda bashing (mackonstan, 15:06:14) * HNY 2022 ! (mackonstan, 15:06:23) * Maciek: would like to discuss VPP MTU topic, following discussion on VPP call yesterday. (mackonstan, 15:07:33) * Inputs from projects (mackonstan, 15:07:57) * Andrew - VPP rc1 upcoming - 19-jan (mackonstan, 15:08:28) * Dave Wallace (dwallacelf, 15:09:42) * Fan Zhang (fan_zhang, 15:10:10) * New or refactored tests (mackonstan, 15:10:38) * Fan: re flow perf tests, no progress, not started yet. (mackonstan, 15:11:06) * Maciek: vpp-device flow tests kept failing after up'ing DPDK version (mackonstan, 15:16:21) * some failures seem to be related to dpdk offload flag renaming (mackonstan, 15:16:50) * patch-1: 34837: dpdk: new flags format | https://gerrit.fd.io/r/c/vpp/+/34837 (mackonstan, 15:17:06) * failed vpp-device tests (mackonstan, 15:17:15) * LINK: https://jenkins.fd.io/job/vpp-csit-verify-device-master-ubuntu2004-x86_64-1n-skx/4522/ (mackonstan, 15:17:24) * robot log level trace: (mackonstan, 15:17:42) * LINK: https://s3-logs.fd.io/vex-yul-rot-jenkins-1/vpp-csit-verify-device-master-ubuntu2004-x86_64-1n-skx/4522/log.html.gz#s1-s1-s1-s3-s12-t1-k2-k26-k5 (mackonstan, 15:17:44) * Error: "Verify flow mark failed" (mackonstan, 15:17:57) * Traceback: "File "/w/workspace/vpp-csit-verify-device-master-ubuntu2004-x86_64-1n-skx/csit/resources/libraries/python/FlowUtil.py", line 576, in vpp_verify_flow_action" (mackonstan, 15:18:06) * csit src code context (mackonstan, 15:18:38) * LINK: https://git.fd.io/csit/tree/resources/libraries/python/FlowUtil.py#n576 (mackonstan, 15:18:40) * Release - CSIT-2202 (mackonstan, 15:19:37) * csit-2202 rc1 milestone next week (mackonstan, 15:20:29) * LINK: https://wiki.fd.io/view/CSIT/csit2202_plan (mackonstan, 15:20:32) * Fan: running late with dpdk 21.11 due to failed tests (mackonstan, 15:21:13) * Fan: in addition to flow tests, vm vhost are also failing (mackonstan, 15:24:56) * Andrew, Maciek: let's qualify and give it a push (mackonstan, 15:26:13) * All on a CSIT call agree with the recommendation that the very very latest time to merge DPDK ver change is before RC1 milestone (mackonstan, 15:29:21) * Fan: Failed DPDK tests: 64B-0c-ethip4-ip4base-eth-2vhost-1vm-scapy and 64B-0c-ethip4-flow-ip4-gtpu-scapy (fan_zhang, 15:29:50) * Vratko it is important to have enough data points for progressions and regressions before rc2 - 3 weeks should be enough (mackonstan, 15:30:07) * Physical Infrastructure (mackonstan, 15:31:52) * Maciek: 1n-tx2 vpp-device tests - Peter reporting as Juraj not here - it was enabled to run before shutdown, but went down again (mackonstan, 15:32:45) * Peter: 1n-skx vpp-device, only one server is in production; the other one is "misbehaving", requires deep-dive investigation, likely issue with VF drivers/driver bugs e.g. see ticket VPP-1995 that's still open preventing us from touching / upgrading drivers (mackonstan, 15:34:56) * LINK: 34705: dpdk: bump to DPDK v21.11 | https://gerrit.fd.io/r/c/vpp/+/34705 (vrpolak, 15:35:07) * LINK: The VM failure: https://s3-logs.fd.io/vex-yul-rot-jenkins-1/vpp-csit-verify-device-master-ubuntu2004-x86_64-1n-skx/4593/log.html.gz#s1-s1-s1-s13-s1-s1-t1-k2-k9-k6-k1 (vrpolak, 15:37:12) * LINK: https://jira.fd.io/browse/VPP-1995 (mackonstan, 15:37:19) * Maciek, Fan kindly agreed to verify status with AVF vlan stripping driver issue per VPP-1995 (mackonstan, 15:38:03) * Maciek: add vpp-device tests get well plan as a standing topic (mackonstan, 15:39:03) * Andrew would like to discuss integration of DPDK and VPP esp. when upgrading DPDK major version with major changes (mackonstan, 15:42:06) * Andrew, Fan discussion if it's possible to absorb DPDK code more frequently, not per release. Stable tag, or else ? more of a vpp discussion (mackonstan, 15:45:25) * re 5 icx servers onboarding - Peter: still waiting for a management switch to come online (mackonstan, 15:46:17) * Virtual Infrastructure, CI/CD (mackonstan, 15:46:21) * Dave: ci nomad working fine (mackonstan, 15:46:33) * Dave: issue with merge jobs failing, waitign for replication to/from mirror (mackonstan, 15:46:53) * Dave: still working on FD.io storage migration to S3, away from Nexus (mackonstan, 15:47:21) * Dave: pls remove "Failure cause identification with build-failure-analyzer Jenkins plugin." from agenda (mackonstan, 15:47:46) * Trending (mackonstan, 15:48:48) * Viliam: 3 new issues per email to csit-report on monday (mackonstan, 15:49:39) * Viliam: issue 1) already fixed, 2) and 3) are to be t/shooting / inspected (mackonstan, 15:50:29) * LINK: https://lists.fd.io/g/csit-report/message/5271 (mackonstan, 15:51:26) * VPP MTU topic (mackonstan, 15:51:58) * Maciek: discussed the MTU patch from Damjan, and failed vpp-device tests for l2 interface only. ip4 and ip6 tests work fine. (mackonstan, 15:59:36) * Andrew, Maciek let's check the tests and see what MTU values are set using papi, and what VPP returns and what happens in vpp code and take from there (mackonstan, 16:00:19) * 2022 LFN Developer & Testing Forum (mackonstan, 16:04:12) * CSIT talk tomorrow 1-2pm GMT, details in email sent yesterday to csit-dev and vpp-dev (mackonstan, 16:04:36) * LINK: https://lists.fd.io/g/csit-dev/message/4456 (mackonstan, 16:05:01) Meeting ended at 16:05:04 UTC. People present (lines said) --------------------------- * mackonstan (53) * collab-meetbot (3) * vrpolak (3) * fan_zhang (2) * tifrank (1) * dwallacelf (1) Generated by `MeetBot`_ 0.1.4