Thursday, 2022-10-20

*** rajm <rajm!~robert@cpc126990-macc4-2-0-cust43.1-3.cable.virginm.net> has joined #cip00:39
*** prabhakarlad <prabhakarlad!~prabhakar@pc.renesas.eu> has quit IRC (Ping timeout: 244 seconds)04:39
*** prabhakarlad <prabhakarlad!~prabhakar@pc.renesas.eu> has joined #cip07:46
*** prabhakarlad <prabhakarlad!~prabhakar@pc.renesas.eu> has quit IRC (Ping timeout: 244 seconds)10:34
*** uli <uli!~uli@55d4215f.access.ecotel.net> has joined #cip11:13
*** masami <masami!~masami@FL1-125-198-44-131.tky.mesh.ad.jp> has joined #cip11:40
*** jki <jki!~jki@195.145.170.166> has joined #cip12:00
jkiHi all!12:00
masamihello12:00
pave1hi!12:00
alicefhi12:01
*** patersonc <patersonc!~patersonc@pc.renesas.eu> has joined #cip12:02
jkilet's go:12:03
jki#startmeeting CIP IRC weekly meeting12:03
collab-meetbotMeeting started Thu Oct 20 12:03:40 2022 UTC and is due to finish in 60 minutes.  The chair is jki. Information about MeetBot at http://wiki.debian.org/MeetBot.12:03
collab-meetbotUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.12:03
collab-meetbotThe meeting name has been set to 'cip_irc_weekly_meeting'12:03
*** collab-meetbot changes topic to " (Meeting topic: CIP IRC weekly meeting)"12:03
jki#topic AI review12:03
*** collab-meetbot changes topic to "AI review (Meeting topic: CIP IRC weekly meeting)"12:03
jki1. Add qemu-riscv to cip-kernel-config - patersonc12:03
patersonc[m]No updates12:04
jki2. Ask Florian to support with 4.4 kernel-ci reports - jki12:04
jkidone, Florian will look into that soon12:05
jkihe said only one issue was remaining if he was recalling correctly12:05
jkiany other AIs?12:05
pave1If 4.4 reports are useful or close to being useful... should I take another look?12:06
jkiI asked Florian to approach you on that12:06
jkibut you may also give feedback earlier, if you like12:06
pave1Ok :-).12:07
jkiok, moving on in...12:08
jki312:08
jki212:08
jki112:08
jki#topic Kernel maintenance updates12:08
*** collab-meetbot changes topic to "Kernel maintenance updates (Meeting topic: CIP IRC weekly meeting)"12:08
pave1I did reviews on 5.10.149 and .150.12:09
masamiThis week reported 23 new CVEs that three of them are remote code execution vulnerabilities.12:09
masamiThese vulnerabilities have been fixed in stable kernels.12:09
pave1(.150 is huge, still a lot to do).12:09
ulii did 5.10.15012:10
jkianything else for this topic?12:13
jki312:15
jki212:15
jki112:15
jki#topic Kernel testing12:15
*** collab-meetbot changes topic to "Kernel testing (Meeting topic: CIP IRC weekly meeting)"12:15
alicefreplaying to florian issue12:16
patersonc[m]It appears that a lot of our RT tests aren't completing properly. The tests run, but the Python script that collates the results at the end doesn't run.12:16
patersonc[m]Need to investigate further.12:16
patersonc[m]Have you noticed this before Pavel? Do you just check the latency results and not worry about the script at the end?12:17
pave1I just watch for green ticks :-). Have not noticed that before, sorry.12:17
patersonc[m]Does anyone check test results? Or just that the lava job ran until the end?12:18
pave1patersonc: I suspect noone does.12:19
patersonc[m]So how are we confirming that we don't see regressions? If we don't look at the results it's just a load of boot tests12:20
alicefmost of the issues that Florian pointed out about 4.4 looks solved upstream by the way12:20
alicefhttps://github.com/kernelci/kernelci-core/issues/1053#issuecomment-128543361712:20
pave1Yeah, and a bunch of compile tests :-). A lot of kernel issues manifest by kernel not booting.12:21
alicefwe have no more errors on 4.4 only some warnings12:22
pave1alicef: Ok, thanks.12:22
jkipavel: do we need/want to resolve those as well?12:22
alicefpave1: sorry I couldn't find not booting kernel on the last 4.412:22
pave1alicef: So I can just ignore the warnings, and only care if errors appear?12:22
alicefI'm currently looking a some strange smc regression on 4.4 qemu12:22
pave1jki: Ignoring warnings should be simple enough. Getting rid of warnings would be nice, but is not high priority.12:23
*** patersonc <patersonc!~patersonc@pc.renesas.eu> has quit IRC (Quit: Connection closed)12:24
alicefpave1: I also don't know about that. Depend from the warnings and errors. I will give a shallow look if there is any warning that is interesting12:24
pave1patersonc: ?12:25
pave1alicef: Thanks.12:26
alicefpave1: actually you can just give a look at the end of this page and looks if there is something that is interesting. but I don't think there is https://linux.kernelci.org/build/cip/branch/linux-4.4.y-cip/kernel/v4.4.302-cip70-98-g7f7838c92740f/12:26
alicefI will look if something as been not inserted that12:27
aliceflike I cannot find the smc regression on that list12:27
pave1alicef: Ok, let me do that over the week.12:27
alicefthey are really few warning. they are mostly like suggest parentesis and similar. thanks12:28
patersonc[m]Great12:29
jkicool!12:29
pave1patersonc: Could we get three results in the gitlab-ci?12:29
pave1patersonc: Green -- nothing to see, noone needs to look here.12:29
pave1Red -- something is wrong in the kernel, either it failed to boot or some test failed.12:30
pave1Yellow or something -- something is wrong in the labs. Power failed, docker stuff is acting funny, ...12:30
patersonc[m]GitLab CI doesn't support this, sorry12:31
pave1Its important that we dont get green when theres some problem hidden in the logs.12:31
alicefpave1: following is the strange smc regression12:31
pave1Ok, next best thing: can we get last line of the log saying what is it?12:31
jkiwhy should gitlab not support this?12:32
jkiLava runs can be translated into pipeline states - if they return clear results12:32
patersonc[m]pave1: We could trawl the test case results and make the whole thing a red cross if there is a single error?12:32
alicefon v4.4.302-cip70 all cve pass https://storage.kernelci.org/cip/linux-4.4.y-cip/v4.4.302-cip70/x86_64/x86_64_defconfig/gcc-10/lab-collabora/smc-qemu_x86_64.html12:33
jkior did you mean the yellow state?12:33
alicefon v4.4.302-cip70-98-g7f7838c92740f we have a CVE-2020-0543: fail https://storage.kernelci.org/cip/linux-4.4.y-cip/v4.4.302-cip70-98-g7f7838c92740f/x86_64/x86_64_defconfig/gcc-10/lab-collabora/smc-qemu_x86_64.html12:33
alicefCVE-2020-0543: VULN (Your CPU microcode may need to be updated to mitigate the vulnerability) but is same board12:34
patersonc[m]Let me look into it. But last time I looked it wasn't something we can control, other then pass (green tick) or fail (red cross)12:34
pave1patersonc: Can we have two phases? We currently have build, test.12:35
pave1Have build, tests finish, tests report passing result?12:35
aliceflooks like same board some toolchain but different smc test results O_o12:36
patersonc[m]pave1: Yea we could do something like this. And then just have to look into the collated test results in the last job12:37
pave1alicef: If it is spectre/meltdown checker on Qemu.. then I suggest we don't have to care much.12:38
alicefpave1: ok thanks. than we have only the warning I pointed you12:39
pave1alicef: Ok, let me look into that and report via email.12:40
alicefok12:40
patersonc[m]It looks like we can set some exit codes now in GitLab CI: https://docs.gitlab.com/ee/ci/yaml/#allow_failureexit_codes12:41
jkigreat to see this progress!12:42
patersonc[m]Although actually, that looks like it's used to determine if a job fails or passes based on return codes from scripts. It's not controlling whether we can set a yellow warning in the pipelines view.12:43
patersonc[m]So not so useful12:43
jkiyeah, a yellow state is not known to me either12:44
jkifail or pass, that's it12:44
patersonc[m]Bit annoying.12:46
jkiwell, open an issue with gitlab.com ;)12:47
patersonc[m]We can create some scripts to parse the results better, but at some point we may as well just use KernelCI as it is better for this kind of thing12:47
pave1Is it possible to not finish, or finish without returning the result?12:47
patersonc[m]This was the main drive for using KernelCI - much more advanced than our gitlab CI setup12:47
patersonc[m]pave1: Not finishing would eventually lead to a timeout, which would be a red cross12:48
jkiif you don't finish a job, you will empty out pockets with AWS bills ;)12:48
patersonc[m]The only option really is to fail the whole job if a single test case didn't pass12:49
patersonc[m]jki: That too :D12:49
pave1patersonc: That is good option. And add a line at the end of log explaining "test returned failure" so that we know it is different from "lab does not have power".12:50
patersonc[m]We pretty much have this already12:52
patersonc[m]e.g. https://gitlab.com/cip-project/cip-kernel/linux-cip/-/jobs/318469936012:52
patersonc[m]Test case results are all there12:52
patersonc[m]We just don't have a overall fail if a single test case fails - only if the entire lava job failed12:52
patersonc[m]Example with some fails:12:53
patersonc[m]https://gitlab.com/cip-project/cip-kernel/linux-cip/-/jobs/314100385812:53
patersonc[m]But then, in the case of SMC, some of those test cases are expected to fail.12:54
patersonc[m]So we'd need to have a way of knowing when failures are expected...12:54
patersonc[m]Or whether they are regressions12:54
pave1Drop SMC for now :-).12:55
pave1Or blacklist SMC from qemu targets.12:56
patersonc[m]I'm sure that all the LTP test cases don't pass..12:56
patersonc[m]e.g. https://lava.ciplatform.org/results/76346112:57
jkiwe've reached the top of the hour - anything else on testing?13:01
jki313:02
jki213:02
jki113:02
jki#topic AOB13:02
*** collab-meetbot changes topic to "AOB (Meeting topic: CIP IRC weekly meeting)"13:02
jkianyone anything?13:03
jki313:04
jki213:04
jki113:04
jki#endmeeting13:04
collab-meetbotMeeting ended Thu Oct 20 13:04:11 2022 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)13:04
collab-meetbotMinutes:        http://ircbot.wl.linuxfoundation.org/meetings/cip/2022/10/cip.2022-10-20-12.03.html13:04
collab-meetbotMinutes (text): http://ircbot.wl.linuxfoundation.org/meetings/cip/2022/10/cip.2022-10-20-12.03.txt13:04
collab-meetbotLog:            http://ircbot.wl.linuxfoundation.org/meetings/cip/2022/10/cip.2022-10-20-12.03.log.html13:04
*** collab-meetbot changes topic to "Civil Infrastructure Platform Project. CIP mailing list at https://lists.cip-project.org/g/cip-dev | CIP kernel meeting every Thursday at 12:00 UTC | Find the meeting logs at https://ircbot.wl.linuxfoundation.org/meetings/cip/ and chat logs at https://ircbot.wl.linuxfoundation.org/logs/%23cip/""13:04
pave1Thank you!13:04
ulithanks13:04
jkithanks, folks!13:04
masamithanks13:04
patersonc[m]Nope13:04
jkienjoy the rest of today!13:04
patersonc[m]Cheers all13:04
*** masami <masami!~masami@FL1-125-198-44-131.tky.mesh.ad.jp> has quit IRC (Quit: Leaving)13:04
pave1Let me take a look at the test results and report over the email.13:04
alicefthanks you13:05
alicefpave1: thanks you13:05
alicefI'm asking about some problem on asus-C523NA-A20057-coral that affect 4.4 even few builds on kernelci13:05
*** jki <jki!~jki@195.145.170.166> has quit IRC (Remote host closed the connection)13:05
aliceflooks broken for almost every kernel ... :/13:06
*** jki <jki!~jki@195.145.170.147> has joined #cip13:06
alicefevery few test that board is going in panic13:06
pave1I don't know what asus-coral is.13:06
alicefI think is asus chromebook c523na13:07
alicefanyway probably we can just filter it out13:07
pave1Chromebook not having good support in 4.4 or crashing randomly would not be surprising.13:08
alicefmmm is not only 4.413:08
pave1Chromebooks often have vendor kernels... and are not well (or at all) supported with mainline.13:08
pave1Lets do the rest over email?13:09
alicefI see13:09
alicefsure :)13:09
pave1Thank you, bye!13:09
alicefsee you13:09
*** pave1 <pave1!~pavel@jabberwock.ucw.cz> has quit IRC (Quit: Leaving)13:09
*** jki <jki!~jki@195.145.170.147> has quit IRC (Remote host closed the connection)13:09
*** prabhakarlad <prabhakarlad!~prabhakar@pc.renesas.eu> has joined #cip21:14
*** rajm <rajm!~robert@cpc126990-macc4-2-0-cust43.1-3.cable.virginm.net> has quit IRC (Ping timeout: 252 seconds)21:59

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!