dustymabe changed the topic of #fedora-coreos to: Fedora CoreOS :: Find out more at https://getfedora.org/coreos/ :: Logs at https://libera.irclog.whitequark.org/fedora-coreos
<anthr76[m]> <dustymabe> "anthr76: they are not, but I..." <- Ping
<anthr76[m]> A little past ~30 mins :)
Betal has joined #fedora-coreos
daMaestro has joined #fedora-coreos
plarsen has quit [Remote host closed the connection]
paragan has joined #fedora-coreos
<dustymabe> anthr76[m]: yeah :)
jlebon has quit [Ping timeout: 272 seconds]
poppajarv has quit [Quit: The Lounge - https://thelounge.chat]
jpn has joined #fedora-coreos
jpn has quit [Ping timeout: 240 seconds]
jpn has joined #fedora-coreos
jpn has quit [Ping timeout: 246 seconds]
jpn has joined #fedora-coreos
jpn has quit [Ping timeout: 252 seconds]
bytehackr has joined #fedora-coreos
Betal has quit [Quit: WeeChat 3.7.1]
daMaestro has quit [Quit: Leaving]
jpn has joined #fedora-coreos
bgilbert has quit [Ping timeout: 255 seconds]
aaradhak[m] has quit [Quit: You have been kicked for being idle]
travisghansen has quit [Quit: The Lounge - https://thelounge.github.io]
travisghansen has joined #fedora-coreos
travisghansen has quit [Client Quit]
travisghansen has joined #fedora-coreos
c4rt0 has joined #fedora-coreos
jbrooks has quit [Ping timeout: 250 seconds]
jbrooks has joined #fedora-coreos
crobinso has joined #fedora-coreos
Arkanterian has joined #fedora-coreos
jlebon has joined #fedora-coreos
mheon has joined #fedora-coreos
zodbot has quit [Ping timeout: 240 seconds]
<jlebon> dustymabe: hmm, i can't reach the FCOS pipeline
<jlebon> actually, can't reach the cluster console either
jpn has quit [Ping timeout: 250 seconds]
zodbot has joined #fedora-coreos
<jlebon> known infra issue according to #fedora-admin
bytehackr has quit [Quit: Leaving]
vgoyal has joined #fedora-coreos
<dustymabe> jlebon: I just accessed it - try again?
<jlebon> yup, seems to have been restored
jpn has joined #fedora-coreos
poppajarv has joined #fedora-coreos
gursewak has joined #fedora-coreos
nalind has joined #fedora-coreos
fifofonix has quit [Quit: Textual IRC Client: www.textualapp.com]
plarsen has joined #fedora-coreos
<dustymabe> jlebon: anything waiting on my review that you know of? link me to it
<jlebon> dustymabe: not yet, will try to circle back on the cosa PR today. just trying to diagnose that podman push issue first
<dustymabe> 👍
<dustymabe> jlebon: since you are close to it right now (my memory fails me) - right now if we run the release job multiple times does the push container stuff properly do nothing if a container already exists in a remote registry at that version or does it blindly push?
<jlebon> dustymabe: it will blindly push but be like a no-op since all the layers will already exist
<dustymabe> but will the manifest that gets created have the same hash and everything? i.e. will anything change?
<dustymabe> Maybe we should update the code to look at the meta.json and not push if an entry for that container (with digest and all) already exists
<jlebon> ouhhh, that's a good question. i'm not sure.
<jlebon> i just tested this locally and did `podman manifest create` twice for the same image and got different hashes, so yeah it would change the hash
<jlebon> likely there's timestamps in there
<dustymabe> likely
<jlebon> SGTM re. meta.json check
<jlebon> maybe with a --force to override
<dustymabe> yeah, i'm not sure how we would plumb that through in the job though
<jlebon> the `--force` would be for local dev
<dustymabe> yeah, I could see wanting it in the pipeline, but I think we'd need a force knob for each piece of the release job (aws replication, aliyun replication, push container) and that would be a lot of knobs
<jlebon> actually, interesting you brought that up. i've been thinking of adding that check to `podman manifest create` for a different reason (while reading https://issues.redhat.com/browse/MCO-392)
<dustymabe> we could use a global knob but i'd rather not force push over things that already existted
<jlebon> yup, agreed
<dustymabe> jlebon: can you elaborate on how that issue relates?
gursewak has quit [Ping timeout: 252 seconds]
<jlebon> it seems like the latest approach is to not ship both the legacy and modern in 4.12 and we want to use the same `oscontainer` top-level key.
<jlebon> legacy and modern *oscontainer
<jlebon> i'll add checks in the pipeline that we don't try to push both, but we should also add safety checks in cosa proper
<jlebon> for local devs hacking on this stuff
<dustymabe> i.e drop the `base-oscontainer` top level entry?
<jlebon> walters' idea was to have them be the same, but i'd like to propose dropping it from the schema after we branch cosa for 4.12, yeah
<dustymabe> so for the "check" I'm thinking we'd add something here that just looks at the container in the registry (the manifest listed one) and says "does the targets of this container match the digests of what we'd push?" If so then no-op.
Arkanterian has quit [Ping timeout: 244 seconds]
aaradhak[m] has joined #fedora-coreos
<jlebon> hmm, i think we'd need to compare the arch-level digests though and not the manifest-listed one
<dustymabe> right - hence my wording of `targets` and `digests` above
<jlebon> ahhh ok, i got confused
<dustymabe> I don't know if we can reliably get the information
<dustymabe> but the idea is "pull remote manifest that already exists in registy -> get target arch containe digests -> compare with what we are about to push -> no-op if no change"
<jlebon> yup, makes sense. you should be able to get it from `skopeo inspect --raw` (see `cmd-copy-container`)
<jlebon> get them*
<dustymabe> ok i'll create an issue for this and see if jmarrero wants to tackle it
<jlebon> try locally e.g.: skopeo inspect --raw docker://quay.io/fedora/fedora-coreos:stable | jq .
<dustymabe> jlebon: regarding the file locking for the extensions container.. did you want to tackle that or do you want me to create an issue for it and see if someone else wants to pick it up?
<jlebon> dustymabe: let's create an issue, thanks!
<dustymabe> ok /me writes issues
<jdoss> walters: I spent the evening trying to reproduce the rpm-ostree lockup when switching container versions with exact steps with workflow that was not my production stuff and I can't get it to reproduce. I burned down my production stuff and started over and I can't reproduce there either anymore, so I am not going to open the issue unless you want to see my writeup.
cyberpear has joined #fedora-coreos
<dustymabe> jmarrero: would you want to look at https://github.com/coreos/coreos-assembler/issues/3149
<dustymabe> ravanelli: would you want to look at https://github.com/coreos/coreos-assembler/issues/3150 when you get caught up?
jpn has quit [Ping timeout: 272 seconds]
jpn has joined #fedora-coreos
Anonymous[m]1 has quit [Quit: You have been kicked for being idle]
gursewak has joined #fedora-coreos
paragan has quit [Quit: Leaving]
ravanelli has joined #fedora-coreos
<jmarrero> dustymabe: I will work on it
gursewak has quit [Ping timeout: 264 seconds]
<ravanelli> dustymabe: About https://github.com/coreos/coreos-assembler/issues/3150. Yes, I can take a look on that
bgilbert has joined #fedora-coreos
plarsen has quit [Remote host closed the connection]
<jlebon> jmarrero++ ravanelli++
<zodbot> jlebon: Karma for jmarrero changed to 1 (for the current release cycle): https://badges.fedoraproject.org/tags/cookie/any
<zodbot> jlebon: Karma for ravanelli changed to 1 (for the current release cycle): https://badges.fedoraproject.org/tags/cookie/any
<davdunc[m> dustymabe: did your team build the promote-coreps branch or did that happen in the website team?
<dustymabe> davdunc[m: are you talking about https://pagure.io/fedora-web/websites/pull-request/272 ?
<dustymabe> it was a trivial change since our site is bespoke and fully fleshed out already (we built it custom to display our stream model) so all we had to do was just move the tile on the main page up to the next level
c4rt0 has quit [Quit: Leaving]
<davdunc[m> Got it.
<davdunc[m> Alright. Thanks dustymabe
<jlebon> walters: when you have a sec, can you sanity-check https://github.com/coreos/fedora-coreos-pipeline/pull/724 matches the plan?
<jlebon> dustymabe: are you using stg?
<dustymabe> jlebon: not right now, no
<jlebon> k cool, taking it :)
<dustymabe> jlebon: after you merge https://github.com/coreos/fedora-coreos-pipeline/pull/719#pullrequestreview-1160588037 do you want to rebase `rhcos` and drop the commit that we no longer need that adds the cosa_img hack (and also update the config.yaml)
<jlebon> dustymabe: yup, will do!
poppajarv has quit [Quit: The Lounge - https://thelounge.chat]
cyberpear has quit [Quit: Connection closed for inactivity]
crobinso has quit [Remote host closed the connection]
<dustymabe> jlebon: this is prep for switching the release job to use a mArch builder: https://github.com/coreos/fedora-coreos-pipeline/pull/726
<dustymabe> still needs to be tested
<dustymabe> jlebon: any in cluster modifications that need to be done for https://github.com/coreos/fedora-coreos-pipeline/pull/719 to our existing clusters?
<jlebon> dustymabe: yes, i've already updated both FCOS and RHCOS
nalind has quit [Quit: bye for now]
<bgilbert> when we promote `next` to `testing`, we should remember to make sure platforms.yaml doesn't come along
<dustymabe> jlebon++
<jlebon> bgilbert: good thought. let's put that in... https://github.com/coreos/fedora-coreos-tracker/issues/1223 ?
<jlebon> actually, the rebase checklist doesn't call for doing a git-level sync, which I thought it did
<bgilbert> yeah, I've now added a checklist entry, but it's not clear to me that whoever's doing the promotion will be looking at the checklist at the time
<jlebon> dustymabe: shouldn't the section "Preparing for Fedora (N) GA" say to take at least e.g. the lockfile from next rather than doing `--update-lockfile`?
<dustymabe> i've got some local notes/updates for the instructions
<dustymabe> let me post them up somewhere and see if that addresses open questions
<dustymabe> ok here's what I had locally: https://github.com/coreos/fedora-coreos-tracker/pull/1331
<dustymabe> jlebon: it looks like I had indeed picked up on the change you were suggesting
<jlebon> dustymabe: +1
<dustymabe> at least in the `Update fedora-coreos-config testing-devel` section
<jlebon> yup, that's the bit i was looking at
<dustymabe> jlebon: are done with staging pipeline?
<dustymabe> I migth run some tests over the weekend
<jlebon> dustymabe: yup, done
mheon has quit [Ping timeout: 250 seconds]
<dustymabe> k - see you on Monday!
<jlebon> have a good weekend!
<dustymabe> jlebon: actually - we should probably implement a freeze on pipeline changes until we clear our releases next week
<dustymabe> to be safe
<jlebon> dustymabe: sounds reasonable yeah
vgoyal has quit [Quit: Leaving]