dustymabe changed the topic of #fedora-coreos to: Fedora CoreOS :: Find out more at https://getfedora.org/coreos/ :: Logs at https://libera.irclog.whitequark.org/fedora-coreos
sentenza_ has quit [Ping timeout: 250 seconds]
sentenza has joined #fedora-coreos
dustymabe has joined #fedora-coreos
misuto7 has quit [Remote host closed the connection]
misuto7 has joined #fedora-coreos
Betal has quit [Quit: WeeChat 3.8]
sentenza has quit [Remote host closed the connection]
jpn has joined #fedora-coreos
jpn has quit [Ping timeout: 240 seconds]
gursewak_ has joined #fedora-coreos
admin1 has quit [Quit: The Lounge - https://thelounge.chat]
admin1 has joined #fedora-coreos
jpn has joined #fedora-coreos
admin1 has quit [Read error: Connection reset by peer]
admin1 has joined #fedora-coreos
chrish136 has quit [Quit: WeeChat 3.6]
jpn has quit [Ping timeout: 265 seconds]
jpn has joined #fedora-coreos
jpn has quit [Ping timeout: 265 seconds]
vgoyal has joined #fedora-coreos
jpn has joined #fedora-coreos
jpn has quit [Ping timeout: 240 seconds]
nalind has joined #fedora-coreos
nalind has quit [Client Quit]
nalind has joined #fedora-coreos
baude has joined #fedora-coreos
<baude> dustymabe: walters: others ... anyone have some early speculation here? -> https://github.com/coreos/coreos-assembler/issues/3443
jlebon has joined #fedora-coreos
<baude> walters: on your comment, so ... pop into a cosa shell, then execute the command?
<walters> Yep
<walters> May also try “perf trace”, or in general any tool or technique one would use to debug a stuck process
<walters> Could also try bumping the log level for kola for example
<baude> walters: i attached the strace fwiw
<baude> i also noticed runvm-console.txt had two Synchronous Exceptions in it. That normal ?
<baude> and fwiw, seems like on more generic aarch64, this all works fine. so this is maybe a apple silicon qemu thing ?
<dustymabe> baude: maybe :)
<baude> i assume you folks use something like an aws aarch64 node for this
<dustymabe> correct
<dustymabe> bare metal node
<dustymabe> in AWS
<baude> i am also willing to set up a tmate if anyone wants to take a peek
<dustymabe> assuming there is a bug I doubt the issue is actually in COSA itself.. more likely that it's in qemu, which means our screenshare would probably be of limited value without someone with qemu expertise online
<dustymabe> baude: if you run libguestfs-test-tool inside the COSA container it might give some clues
<baude> i suspect we might need to add something to the qemu command actually (maybe?)
<baude> anyone know offhand where that command is assembled in case I want to fool with it ?
<baude> actually dustymabe ... i see that the qemu in the cosa image is quite old ... is there a way I could use f38 inside the image?
<baude> and i know quite a bit of stuff went into qemu for apple silicon right around the 7.0x time period which is the version being used ... but in f38, it is 7.2
<walters> sure, could rebuild the container with f38 userspace, or try just pulling in newer qemu
<dustymabe> baude: you'd have to build it from scratch after updating https://github.com/coreos/coreos-assembler/blob/main/Dockerfile#L3
<dustymabe> it might work, but usually there are some things that need to be fixed up when we do that bump
<baude> doing ...
<baude> any hints?
<dustymabe> we'll probably be moving it over to F38 this week or next
<baude> schedules ...
<baude> btw
<baude> you guys really set quite the booby-trap for me
<baude> you updated the required cosa alias (so to speak) or else strange permissions and linking errors would get exposed ...
<baude> did i miss a memo? :)
<dustymabe> baude: i'm not sure I follow
<dustymabe> the last update to the documented function was in https://github.com/coreos/coreos-assembler/pull/3417
<baude> yeah that is whaty i am talking about
<baude> i had the previous cosa alias set up
<baude> maybe you guys know that you always update that ?
<dustymabe> should still work fine
<baude> does .
<baude> not.
<baude> maybe you always use source ~/path/to/git/alias ?
<dustymabe> `COREOS_ASSEMBLER_ADD_CERTS` is really only needed for building RHCOS IIUC
<baude> this was fcos
<dustymabe> hmm maybe I'm missing something then
<dustymabe> what am I supposed to focus on in that paste?
<jlebon> baude: what error related to the alias are you seeing? the recent tweak is transparent to the rest of cosa, so latest cosa should work fine with the old alias
<baude> i was seeing an issue with incorrect ownership of sudo as well as ld errors
jpn has joined #fedora-coreos
<baude> jlebon: want me to recreate it ?
<dustymabe> baude: that's good news
jpn has quit [Ping timeout: 268 seconds]
<jlebon> baude: sure
<baude> dustymabe: well, sort of, i need a raw image .. so i guess for now i can use qemu-image convert ?
jpn has joined #fedora-coreos
jpn has quit [Ping timeout: 276 seconds]
<dustymabe> baude: probably.. but maybe you'll also need to change the platform ID?
fifofonix has joined #fedora-coreos
neonum6 has joined #fedora-coreos
neonum6 has quit [Remote host closed the connection]
Betal has joined #fedora-coreos
sentenza has joined #fedora-coreos
sentenza has quit [Remote host closed the connection]
jpn has joined #fedora-coreos
jpn has quit [Ping timeout: 268 seconds]
<dustymabe> pipeline folks.. mind a review on https://github.com/coreos/fedora-coreos-pipeline/pull/867 ?
<spresti[m]> dustymabe: Just saw it, was offline for longer then expected after lunch
<dustymabe> np
<spresti[m]> For refrence is that extra step always true every fedora bump?
<dustymabe> spresti[m]: no, just this one :)
<dustymabe> this is the major version rebase
<dustymabe> so it will be 6 months before we have to change the number from 38 to 39
<spresti[m]> So when we have a major bump I.E f38 to f39 in 6 months the fcos release needs to cherrypick for stable only. (as it naturally flows into testing?)
<spresti[m]> s/cherrypick/cherry-pick/
<dustymabe> no.. this is one thing that never gets synced so for every branch we cherry-pick
<dustymabe> but it doesn't happen that often so it's not too painful (or at least it hasn't been)
bgilbert has joined #fedora-coreos
<spresti[m]> I went ahead and cherry-picked the manifest change into the stable rebase pr and it's diff check is failing with the warning of an unexpected change?
<bgilbert> dustymabe: re bootupd RAID: oof
<bgilbert> spresti[m]: unexpected change is expected. that CI test isn't blocking; it's just trying to flag anything in the diff that needs manual review
<spresti[m]> Ah ok sweet thank you :)
<bgilbert> usually we add a comment explaining why any flagged changes are okay
klaas has quit [Quit: ZNC 1.8.2 - https://znc.in]
klaas has joined #fedora-coreos
<dustymabe> bgilbert: yeah. definitely a gap
<dustymabe> and definitely something we would have hit downstream (considering we want to enable bootupd more in the future)
jpn has joined #fedora-coreos
<bgilbert> yup
gursewak_ has quit [Ping timeout: 246 seconds]
jpn has quit [Ping timeout: 268 seconds]
gursewak has joined #fedora-coreos
mheon has joined #fedora-coreos
fifofonix has quit [Read error: Connection reset by peer]
<spresti[m]> Did we intentionally downgrade nm-state? nmstate 2.2.9-2.fc37 -> 2.2.9-1.fc38
<spresti[m]> * So in this case nmstate 2.2.9-2.fc37 -> 2.2.9-1.fc38, the CI thinks this is a downgrade
<dustymabe> right
<dustymabe> strictly speaking by RPM versioning semantics - it is a downgrade
<dustymabe> but the actual software (bits on the disk) are the same
<spresti[m]> Ah, ok but in reality this is just build attempt 1 vs 2
<dustymabe> yeah
<dustymabe> one branch had an extra git commit in it versus the other
<dustymabe> and %autorelease doesn't handle that well
<spresti[m]> So since thats a required check how can I just "ignore it" as the warning suggests?
<spresti[m]> * warning suggests? (sorry novice question)
<dustymabe> I usually add a comment in the PR saying we can ignore it and why
sentenza has joined #fedora-coreos
<dustymabe> then I merge it anyway
<dustymabe> do you see the `Merge without waiting for requirements to be met (bypass branch protections) ` option?
<spresti[m]> Nope :( (though, thats prob good lol)
<dustymabe> Merged!
<dustymabe> sorry about that
<spresti[m]> No worries :) thank you.
<dustymabe> gursewak: mind a review on https://github.com/coreos/fedora-coreos-pipeline/pull/860
<bgilbert> dustymabe: the "Merge without waiting" checkbox is for repo admins only
<bgilbert> dustymabe: if we want to make the promotion diff check overridable by non-admins, we'd need to move it into a separate CI job from GH's perspective
<dustymabe> +1 - I think it's fine like it is
<dustymabe> we don't often have a need for the exceptions
<bgilbert> +1
<spresti[m]> https://jenkins-fedora-coreos-pipeline.apps.ocp.fedoraproject.org/ is giving me a "application is not available"
<spresti[m]> 🙃
<nirik> oof... I meant to note here that I was updating our cluster.
<nirik> but it really shouldn't make things unavailable. ;(
<spresti[m]> no worries :)
<spresti[m]> I am glad it was intentional lol
<nirik> that app is back... I guess it must have been moving it to another node?
<spresti[m]> +1
<dustymabe> spresti[m]: looks like you'll have to re-kickoff the build
<spresti[m]> Yeah, I am in the process of doing that, the app is being a bit slugish atm
<nirik> it's almost done with the cluster update. it's just rebooting worker nodes now.
travisghansen has joined #fedora-coreos
nalind has quit [Quit: bye for now]
chrish136 has joined #fedora-coreos
mheon has quit [Ping timeout: 268 seconds]
jpn has joined #fedora-coreos
jpn has quit [Ping timeout: 246 seconds]
gursewak has quit [Remote host closed the connection]
gursewak has joined #fedora-coreos
gursewak has quit [Ping timeout: 252 seconds]