dustymabe changed the topic of #fedora-coreos to: Fedora CoreOS :: Find out more at https://getfedora.org/coreos/ :: Logs at https://libera.irclog.whitequark.org/fedora-coreos
plarsen has quit [Remote host closed the connection]
ravanelli has quit [Remote host closed the connection]
arnulfo_7 has joined #fedora-coreos
arnulfo_7 has quit [Changing host]
arnulfo_7 has joined #fedora-coreos
ravanelli has joined #fedora-coreos
ravanelli has quit [Ping timeout: 264 seconds]
ravanelli has joined #fedora-coreos
ravanelli has quit [Ping timeout: 244 seconds]
ravanelli has joined #fedora-coreos
ravanelli has quit [Ping timeout: 268 seconds]
arnulfo_7 has quit [Ping timeout: 260 seconds]
bgilbert has joined #fedora-coreos
mosen has quit [Quit: Textual IRC Client: www.textualapp.com]
arnulfo_7 has joined #fedora-coreos
arnulfo_7 has quit [Changing host]
arnulfo_7 has joined #fedora-coreos
mosen has joined #fedora-coreos
c4rt0 has quit [Ping timeout: 268 seconds]
ravanelli has joined #fedora-coreos
paragan has joined #fedora-coreos
bgilbert has quit [Ping timeout: 244 seconds]
poppajarv has quit [Ping timeout: 268 seconds]
poppajarv has joined #fedora-coreos
c4rt0 has joined #fedora-coreos
c4rt0_ has joined #fedora-coreos
mosen has quit [Quit: Textual IRC Client: www.textualapp.com]
saschagrunert has joined #fedora-coreos
Betal has quit [Quit: WeeChat 3.6]
travisghansen has quit [Quit: The Lounge - https://thelounge.github.io]
travisghansen has joined #fedora-coreos
jpn has joined #fedora-coreos
c4rt0_ has quit [Quit: Leaving]
azukku has joined #fedora-coreos
gursewak has joined #fedora-coreos
crobinso has joined #fedora-coreos
vgoyal has joined #fedora-coreos
ravanelli has quit [Remote host closed the connection]
ravanelli has joined #fedora-coreos
mosen has joined #fedora-coreos
crobinso has quit [Ping timeout: 268 seconds]
jpn has quit [Ping timeout: 265 seconds]
gursewak has quit [Ping timeout: 244 seconds]
jpn has joined #fedora-coreos
jpn has quit [Ping timeout: 252 seconds]
jpn has joined #fedora-coreos
plarsen has joined #fedora-coreos
jlebon has joined #fedora-coreos
mheon has joined #fedora-coreos
marmijo has joined #fedora-coreos
nalind has joined #fedora-coreos
c4rt0 has quit [Ping timeout: 268 seconds]
c4rt0 has joined #fedora-coreos
<dustymabe> jlebon: ravanelli: looks like the memory limit PR has exposed that we're not requesting enough memory for some of our jobs: https://github.com/coreos/fedora-coreos-pipeline/pull/687
<dustymabe> cc marmijo ^^ if that merges it probably means we won't need to carry any patches for RHCOS since the amount of memory requested should be enough there too
<marmijo> Perfect, thanks for the cc!
<marmijo> dustymabe: the rollout PR is up now
<dustymabe> marmijo: looking
crobinso has joined #fedora-coreos
gursewak has joined #fedora-coreos
<dustymabe> ravanelli: do you want to merge https://github.com/coreos/fedora-coreos-pipeline/pull/685 and then rebase the RHCOS pipeline and add a commit that updates the config.yaml to use skip_artifacts ?
<ravanelli> dustymabe: looking
vgoyal has quit [Quit: Leaving]
cverna has joined #fedora-coreos
gursewak has quit [Ping timeout: 265 seconds]
saschagrunert has quit [Remote host closed the connection]
vgoyal has joined #fedora-coreos
bgilbert has joined #fedora-coreos
azukku has quit [Quit: Leaving.]
gursewak has joined #fedora-coreos
paragan has quit [Ping timeout: 265 seconds]
paragan has joined #fedora-coreos
<ravanelli> dustymabe: jlebon The rhcos branch is updated with the last changes + config.yaml updates to reflect it
<jlebon> ravanelli: +1
paragan has quit [Quit: Leaving]
Betal has joined #fedora-coreos
jpn has quit [Ping timeout: 260 seconds]
azukku has joined #fedora-coreos
azukku has quit [Client Quit]
gursewak has quit [Ping timeout: 268 seconds]
dustymabe has quit [Quit: WeeChat 3.5]
dustymabe has joined #fedora-coreos
c4rt0 has quit [Ping timeout: 265 seconds]
Arkanterian has joined #fedora-coreos
<dustymabe> jmarrero: let's circle on your PR
Arkanterian has quit [Quit: Client closed]
<ravanelli> dustymabe: jlebon I pushed a new version to https://github.com/coreos/fedora-coreos-pipeline/pull/672
<ravanelli> let me know if it is good now ;)
<dustymabe> jlebon: I also updated https://github.com/coreos/fedora-coreos-pipeline/pull/687 now
<dustymabe> ravanelli: can you rebase that on latest `main` ?
<jmarrero> dustymabe: I am very confused, let have a google meet meeting?
<dustymabe> jmarrero: :)
<dustymabe> ravanelli: I'll pick up https://github.com/coreos/fedora-coreos-pipeline/pull/672 and push it over the finish line. Enjoy your time off!
<jmarrero> dustymabe: https://meet.google.com/fnj-tuay-ecw if you are up for it.
gursewak has joined #fedora-coreos
marmijo has quit [Quit: Client closed]
<dustymabe> jlebon: do you think we need to update anything in CI based on the update from https://github.com/coreos/coreos-ci-lib/pull/116
<dustymabe> jmarrero: is seeing some test failures that might be explained by hitting memory limits
crobinso has quit [Remote host closed the connection]
<jlebon> other pods that compile lots of code will likely also need to be adjusted
<jlebon> we weren't sure yet that was the issue, but CI went passed the RPM build stage now where it previously broke
<jlebon> /cc bgilbert since you might see it in e.g. coreos-installer too
<jlebon> tempting to just default to e.g. 4Gi in buildPod
<jmarrero> jlebon: yeah I am seeing : ```Oct 11 20:04:34.299637 systemd[1]: rpm-ostreed.service: Failed with result 'oom-kill'.```
jpn has joined #fedora-coreos
<jlebon> jmarrero: within a test VM? that wouldn't be caused by the coreos-ci-lib change
jpn has quit [Ping timeout: 244 seconds]
<jlebon> jmarrero: that's more likely to be https://bugzilla.redhat.com/show_bug.cgi?id=1907030
<jlebon> i guess we need to bump memory requirements on tests that fetch repodata temporarily
<jlebon> though that then gets into the assumptions we make in the pipeline that every non-provisioning kola test requires 1G only
<dustymabe> hmm. I thought we made an update
<dustymabe> to work around that problem
<dustymabe> otherwise we'd have been seeing it this whole time?
<jlebon> that probably happened while i was out. do you have a link?
<dustymabe> hmm. I see where I commented in the bug, usually we link back to a coreos-tracker issue
jpn has joined #fedora-coreos
<jlebon> dustymabe: yeah, we basically need that for all the tests that fetch repodata
<jlebon> like ext.config.extensions.module
<dustymabe> so it looks like to me we first hit the issue at the "dnf inside a container" level and now we're hitting it at the `rpm-ostree` level
<jlebon> and we should tweak our ncpus heuristic in the pipeline to adjust for this
<dustymabe> what is sad about this is that we are quickly approaching not being able to update a package layered FCOS if it's resource strapped
<jlebon> e.g. / 1536 instead of 1024
<jlebon> indeed
<jlebon> have to go afk, but can help with this tomorrow!
<jlebon> ttyl
<walters> this also relates to https://github.com/coreos/coreos-assembler/issues/1160 - what we want is to provide the max resources to kola and have it do this calculates itself instead of duplicating the RAM requests across the pipeline and cosa
<walters> dustymabe: yeah, though I think ostree-native-container/layering/dnf-image is going to heavily cut into usage of that
<walters> that said I think specifically for FCOS our usage of the archive repo may have finally eaten into the RAM that we saved by not running a python interpreter
vgoyal has quit [Quit: Leaving]
* jmarrero keeps trying
<walters> ok right we already discussed this in https://github.com/coreos/coreos-assembler/issues/1438
<walters> (Be sure to look back at https://github.com/coreos/coreos-assembler/pull/1436 which talks about how we could actually drop down to 512MB for most tests, or at least we could then)
jpn has quit [Ping timeout: 244 seconds]
nalind has quit [Quit: bye]
mheon has quit [Ping timeout: 244 seconds]
gursewak has quit [Ping timeout: 252 seconds]
mnguyen__ has joined #fedora-coreos
mnguyen_ has quit [Ping timeout: 265 seconds]
cyberpear has quit [Quit: Connection closed for inactivity]
jpn has joined #fedora-coreos
jpn has quit [Ping timeout: 244 seconds]
mnguyen_ has joined #fedora-coreos
mnguyen__ has quit [Ping timeout: 265 seconds]
mgrundmann has quit [Ping timeout: 268 seconds]
mgrundmann has joined #fedora-coreos