dustymabe changed the topic of #fedora-coreos to: Fedora CoreOS :: Find out more at https://getfedora.org/coreos/ :: Logs at https://libera.irclog.whitequark.org/fedora-coreos
misuto7 has quit [Remote host closed the connection]
misuto7 has joined #fedora-coreos
misuto7 has quit [Remote host closed the connection]
misuto7 has joined #fedora-coreos
jpn has joined #fedora-coreos
jpn has quit [Ping timeout: 240 seconds]
bgilbert has quit [Ping timeout: 240 seconds]
misuto7 has quit [Remote host closed the connection]
misuto7 has joined #fedora-coreos
jlebon has quit [Quit: leaving]
ikonia has quit [Ping timeout: 246 seconds]
ikonia_ has quit [Ping timeout: 256 seconds]
ravanelli has quit [Remote host closed the connection]
sentenza_ has joined #fedora-coreos
sentenza has quit [Ping timeout: 265 seconds]
paragan has joined #fedora-coreos
jpn has joined #fedora-coreos
jpn has quit [Ping timeout: 240 seconds]
daMaestro has quit [Quit: Leaving]
misuto7 has quit [Remote host closed the connection]
misuto7 has joined #fedora-coreos
jpn has joined #fedora-coreos
jpn has quit [Ping timeout: 265 seconds]
sentenza_ has quit [Remote host closed the connection]
jpn has joined #fedora-coreos
jpn has quit [Ping timeout: 256 seconds]
jpn has joined #fedora-coreos
saschagrunert has joined #fedora-coreos
jpn has quit [Ping timeout: 248 seconds]
jpn has joined #fedora-coreos
jpn has quit [Ping timeout: 240 seconds]
zodbot has quit [Remote host closed the connection]
zodbot has joined #fedora-coreos
<travier[m]> Let's document that they are for the copr repos. It's convenient that we have those
<travier[m]> & meeting ACLs
oo has joined #fedora-coreos
zodbot has quit [Remote host closed the connection]
zodbot has joined #fedora-coreos
apiaseck has joined #fedora-coreos
jpn has joined #fedora-coreos
misuto7 has quit [Remote host closed the connection]
misuto7 has joined #fedora-coreos
misuto7 has quit [Remote host closed the connection]
misuto7 has joined #fedora-coreos
apiaseck has quit [Remote host closed the connection]
misuto7 has quit [Remote host closed the connection]
apiaseck has joined #fedora-coreos
misuto7 has joined #fedora-coreos
oo has quit [Ping timeout: 264 seconds]
Betal has quit [Quit: WeeChat 3.8]
apiaseck has quit [Remote host closed the connection]
apiaseck has joined #fedora-coreos
apiaseck has quit [Remote host closed the connection]
apiaseck has joined #fedora-coreos
jpn has quit [Read error: Connection reset by peer]
jpn has joined #fedora-coreos
jcajka has joined #fedora-coreos
mheon has joined #fedora-coreos
nalind has joined #fedora-coreos
ravanelli has joined #fedora-coreos
ravanelli has quit [Read error: Connection reset by peer]
ravanelli has joined #fedora-coreos
paragan has quit [Ping timeout: 248 seconds]
paragan has joined #fedora-coreos
paragan has quit [Max SendQ exceeded]
paragan has joined #fedora-coreos
jlebon has joined #fedora-coreos
plarsen has joined #fedora-coreos
ravanelli has quit [Remote host closed the connection]
ravanelli has joined #fedora-coreos
bgilbert has joined #fedora-coreos
saschagrunert has quit [Remote host closed the connection]
misuto7 is now known as misuto
misuto has quit [Quit: Leaving]
misuto has joined #fedora-coreos
jcajka has quit [Quit: Leaving]
<adamw> so, uh, looks like a recent change to rpm has broken rpm-ostree
<adamw> i think not the 4.19 bump itself, but 4.18.90-7...imbw though
<adamw> pyanaconda.modules.common.errors.general.AnacondaError: g-io-error-quark: Failed to invoke rpm-ostree shlib-backend: rpm-ostree: symbol lookup error: rpm-ostree: undefined symbol: pgpFreeDig
paragan has quit [Quit: Leaving]
<adamw> let's see if just a rebuild fixes it...
<adamw> nope, rebuild fails for the same missing thing :(
<adamw> ok, looks like we need a newer rpm-ostree with a newer libdnf in it
<adamw> Colin Walters: around? this would be neater if we could tag a new rpm-ostree upstream, I think. basically it seems like we need rpm-ostree's internal libdnf to be a newer version, you have already updated it upstream but not tagged since then
<bgilbert> adamw: Colin is out this week
<adamw> can anyone else tag/release rpm-ostree?
<adamw> well, hmm, i can probably do this with a patch...
<bgilbert> ^ jlebon jmarrero
<adamw> i'll bodge it with backported libdnf patches for now (hopefully that'll do the trick), but would be nice to have a tagged release.
<travier[m]> adamw: Can open an issue upstream and link to your changes / the patches you're backporting? Note that we're still using the libdnf4 branch
<dustymabe> adamw: did the change land in a rawhide build? if so we should have maybe seen the issue in the FCOS pipeline
Betal has joined #fedora-coreos
<adamw> travier: rpm-ostree upstream is already updated to a new-enough libdnf snapshot, but there isn't a release of rpm-ostree with that in it
<adamw> dustymabe: the problem shows up with rpm-4.18.90-7.fc39
<adamw> which landed in rawhide a few hours ago
<dustymabe> got ya.
<dustymabe> adamw: this is a case where that meeting we had a week back would help us (i.e. would have gated the rpm update probably)
<dustymabe> what's frustrating is that it would have blocked the rpm update because another component needed to be updated, but nonetheless would have been useful
<adamw> yeah
<jlebon> adamw: unless you're already deep in backporting, i can do a git main snapshot build in rawhide if you'd like
<adamw> i have a scratch build running with the backports applied
<adamw> was just gonna test that then send an official build
vgoyal has joined #fedora-coreos
<adamw> jlebon: yup
<adamw> ok, looks like it works
<jlebon> adamw: ok cool. thanks for taking care of that. we can probably cut a release soon too; would have to check if some of the recent changes are ready
<adamw> official build is running
jpn has quit [Ping timeout: 248 seconds]
<adamw> oh, also, all ostree-based installer image builds in rawhide are failing for the last couple of days
<adamw> when we get to lorax-embed-repo.tmpl , one of the commands it runs fails with a 502 , for some reason
misuto has quit [Remote host closed the connection]
misuto has joined #fedora-coreos
misuto has quit [Remote host closed the connection]
misuto has joined #fedora-coreos
<dustymabe> adamw: when did it start failing?
<dustymabe> if it started approx last friday this may be related to the ostree pruning we ran
<dustymabe> though.. we never were able to actually prune the compose repo so I'd think that's probably not the problem
<nirik> it might be the weird caching thing, but that was iot only I thought?
<dustymabe> nirik: but we don't use any caching for the compose repo do we?
ravanelli has quit [Remote host closed the connection]
ravanelli has joined #fedora-coreos
<nirik> and that too.
<nirik> yes, we don't. at least we dont intend to
<adamw> it started in 0524.n.0
<adamw> 0523.n.1 was ok
<dustymabe> adamw: if you start that same task over again right now does it fail?
<adamw> i can't do that
<adamw> nirik could fire a new compose, but i don't know if we want to just for this
<dustymabe> no no - i thought we could start single tasks - definitely don't want a whole new compose
<adamw> nirik might be able to run a scratch task
<nirik> perhaps, but I am heading out to the airport. ;) talk to you all in 4-5hours.
<adamw> roger roger
<dustymabe> have a good trip nirik
<adamw> we can just see what happens with the next nightly, i guess. did you change something, dusty?
<dustymabe> nope I haven't changed anything but I did just pull from that ref in the compose repo and didn't have any trouble
<dustymabe> adamw: do you have a silverblue system? you can try it too
<dustymabe> cat /etc/ostree/remotes.d/fedora-compose.conf && sudo rpm-ostree rebase fedora-compose:fedora/rawhide/x86_64/silverblue
<adamw> i think it's using a local 'repo' at that point, isn't it?
<adamw> note the command has --repo=/var/tmp/lorax/lorax.xsb2zkxh/installtree/ostree/repo
<dustymabe> correct
<dustymabe> and not correct :)
<adamw> ambiguously correct! my favorite kind of correct
<dustymabe> lorax-embed-repo.tmpl is pulling from a remote to make a local copy of the repo (this is so you can do installs offline)
<adamw> i know what it does, yeah
<dustymabe> oh, sorry :(
<dustymabe> either way IIUC the failure is it's trying to pull from the remote and getting a 502 somehow
<dustymabe> ostree --repo=/var/tmp/lorax/lorax.n6wf9xgl/installtree/ostree/repo pull --mirror fedora fedora/rawhide/x86_64/silverblue
<adamw> well, the odd thing is that it happened on every image, in two composes
<adamw> which makes it seem like not a mirror blup
<adamw> it may be something to do with infra's internal networking...
<dustymabe> well there's no mirror here
<adamw> note openqa is not failing on this
<adamw> server blip, you know what i mean :D
<dustymabe> :) - yeah, just wanted to clarify in case it was important
<dustymabe> could be kind of nice to see what the server side is saying (if we could track down that failure)
<dustymabe> adamw: can you get a shell on one of these builder machines?
<adamw> i can't, no
<adamw> the answer to any question along those lines is going to be 'ask nirik' more or less :D
<dustymabe> ahh. was going to say you can run a few commands to see if it is reproducible
<dustymabe> I actually think I (in a round about way) have access to a machine that is on a builder
<dustymabe> let me try it on that machine
<dustymabe> yeah it works there too
<adamw> anyhoo, now i think i've fixed up most of the rpm fires, i'm heading out for a while too
<adamw> back this afternoon
daMaestro has joined #fedora-coreos
daMaestro has quit [Remote host closed the connection]
daMaestro has joined #fedora-coreos
apiaseck has quit [Quit: Konversation terminated!]
apiaseck has joined #fedora-coreos
<dustymabe> bgilbert: i think I'm hitting a limitation of my knowledge here.. do you recall how this works? https://github.com/coreos/fedora-coreos-config/pull/2434#discussion_r1205811537
jpn has joined #fedora-coreos
<dustymabe> maybe what we really wanted was a Wants=nmstate.service in the NetworkManager.service unit
<bgilbert> dustymabe: we still need that line. https://src.fedoraproject.org/rpms/fedora-release/pull-request/255 hasn't merged yet
<bgilbert> https://github.com/nmstate/nmstate/pull/2285/files just changes what install does, not whether we need it
<dustymabe> ok yeah I was thinking the desired effect was just have it get pulled in anytime NetworkManager.service started if nmstate.service existed
<dustymabe> which is not what the nmstate PR that I linked does
<dustymabe> I was confused
misuto has quit [Remote host closed the connection]
misuto has joined #fedora-coreos
<bgilbert> +1
<dustymabe> bgilbert: thanks!
chrish136 has quit [Quit: WeeChat 3.6]
jpn has quit [Ping timeout: 240 seconds]
daMaestro has quit [Quit: Leaving]
apiaseck has quit [Ping timeout: 240 seconds]
apiaseck has joined #fedora-coreos
jpn has joined #fedora-coreos
jpn has quit [Ping timeout: 240 seconds]
apiaseck has quit [Quit: Konversation terminated!]
apiaseck has joined #fedora-coreos
<dustymabe> jlebon got a few things for you if you have a moment
<jlebon> dustymabe: sure
apiaseck has quit [Ping timeout: 246 seconds]
apiaseck has joined #fedora-coreos
<jlebon> i replied to the second one. first one will take longer :)
apiaseck has quit [Quit: Konversation terminated!]
apiaseck has joined #fedora-coreos
apiaseck has quit [Ping timeout: 268 seconds]
jpn has joined #fedora-coreos
mboddu_ has joined #fedora-coreos
nalind has quit [Quit: bye for now]
gursewak has quit [*.net *.split]
mboddu has quit [*.net *.split]
gursewak has joined #fedora-coreos
jpn has quit [Ping timeout: 264 seconds]
sentenza has joined #fedora-coreos
misuto has quit [Remote host closed the connection]
misuto has joined #fedora-coreos
misuto has quit [Remote host closed the connection]
misuto has joined #fedora-coreos
plarsen has quit [Remote host closed the connection]
mheon has quit [Ping timeout: 240 seconds]
jpn has joined #fedora-coreos
jpn has quit [Ping timeout: 240 seconds]
jpn has joined #fedora-coreos
jpn has quit [Ping timeout: 240 seconds]
nb has quit [Quit: The Lounge - https://thelounge.chat]
nb has joined #fedora-coreos