dustymabe changed the topic of #fedora-coreos to: Fedora CoreOS :: Find out more at https://getfedora.org/coreos/ :: Logs at https://libera.irclog.whitequark.org/fedora-coreos
crobinso has quit [Remote host closed the connection]
vgoyal has quit [Quit: Leaving]
jpn has joined #fedora-coreos
jpn has quit [Ping timeout: 252 seconds]
jlebon has quit [Ping timeout: 268 seconds]
Karuboniru has joined #fedora-coreos
Karuboniru has quit [Remote host closed the connection]
jpn has joined #fedora-coreos
jpn has quit [Ping timeout: 252 seconds]
Betal has quit [Quit: WeeChat 3.6]
bgilbert has quit [Ping timeout: 252 seconds]
paragan has joined #fedora-coreos
plundra has quit [Remote host closed the connection]
plundra has joined #fedora-coreos
saschagrunert has joined #fedora-coreos
saschagrunert has quit [Remote host closed the connection]
saschagrunert has joined #fedora-coreos
jcajka has joined #fedora-coreos
misuto has quit [Remote host closed the connection]
misuto has joined #fedora-coreos
jpn has joined #fedora-coreos
jpn has quit [Ping timeout: 268 seconds]
c4rt0 has joined #fedora-coreos
bgilbert has joined #fedora-coreos
jpn has joined #fedora-coreos
boudinie[m] has quit [Quit: You have been kicked for being idle]
jpn has quit [Ping timeout: 268 seconds]
jpn has joined #fedora-coreos
jpn has quit [Ping timeout: 265 seconds]
jpn has joined #fedora-coreos
jpn has quit [Ping timeout: 250 seconds]
vgoyal has joined #fedora-coreos
Betal has joined #fedora-coreos
jpn has joined #fedora-coreos
jpn has quit [Ping timeout: 268 seconds]
jlebon has joined #fedora-coreos
jpn has joined #fedora-coreos
jpn has quit [Ping timeout: 265 seconds]
mheon has joined #fedora-coreos
jpn has joined #fedora-coreos
nalind has joined #fedora-coreos
crobinso has joined #fedora-coreos
jpn has quit [Ping timeout: 250 seconds]
plarsen has joined #fedora-coreos
jpn has joined #fedora-coreos
<jlebon> o/
jpn has quit [Ping timeout: 268 seconds]
crobinso has quit [Remote host closed the connection]
jpn has joined #fedora-coreos
jcajka has quit [Quit: Leaving]
<dustymabe> \o
<dustymabe> bgilbert: I had an idea for the promote-config automation to "freeze" the kola denylist denials (i.e. remove any snooze lines). Sometimes we hit issues where after two weeks the snooze has expired but should still apply
marmijo has joined #fedora-coreos
<jlebon> dustymabe: we could also have a mode in kola where it ignores snooze times given a switch
<jlebon> that way we don't add unnecessary noise to the promotion diff
c4rt0_ has joined #fedora-coreos
c4rt0_ has quit [Remote host closed the connection]
<dustymabe> yeah, but then we have to plumb that through
<dustymabe> but yeah, that's an option too
<dustymabe> Interesting tid bit from the new git release: --update-refs for a rebase can help when you have a lot of commits and break them out into smaller PRs but you test everything together: https://github.blog/2022-10-03-highlights-from-git-2-38/
saschagrunert has quit [Remote host closed the connection]
<jlebon> dustymabe: heh, was looking at the same thing
<dustymabe> beat you!
<dustymabe> that's one section of code I didn't quite test in stage
<marmijo> dustymabe: jlebon beat me to it
<marmijo> Should I re-run these release jobs now that 667 was merged?
jpn has quit [Ping timeout: 264 seconds]
<dustymabe> yes, bot don't "replay"
<dustymabe> but*
<dustymabe> start the jobs fresh
<marmijo> sounds good, just run a new job with the same params, go it
<marmijo> got it*
<dustymabe> +1
paragan has quit [Quit: Leaving]
jpn has joined #fedora-coreos
<dustymabe> jlebon: does coreos-ci use an image stream for COSA?
<jlebon> it does not
crobinso has joined #fedora-coreos
fifofonix has quit [*.net *.split]
dustymabe has quit [*.net *.split]
rishi`` has quit [*.net *.split]
shoragan has quit [*.net *.split]
queeup[m] has quit [*.net *.split]
M0xMRTT[m] has quit [*.net *.split]
walters has quit [*.net *.split]
travier[m] has quit [*.net *.split]
shoragan[m] has quit [*.net *.split]
bgilbert has quit [*.net *.split]
misuto has quit [*.net *.split]
darknao has quit [*.net *.split]
hotbox has quit [*.net *.split]
Anonymous[m]12 has quit [*.net *.split]
Guest9887 has quit [*.net *.split]
bowsers[m] has quit [*.net *.split]
go4godvin has quit [*.net *.split]
ravanelli has quit [*.net *.split]
ScottEdlund[m] has quit [*.net *.split]
aaradhak[m] has quit [*.net *.split]
MHamzahKhan[m] has quit [*.net *.split]
decfi[m] has quit [*.net *.split]
vladan[m] has quit [*.net *.split]
GingerGeek has quit [*.net *.split]
jbaublitzzz has quit [*.net *.split]
Sheogorath[m] has quit [*.net *.split]
lorbus has quit [*.net *.split]
thomasfedb has quit [*.net *.split]
Whoop has quit [*.net *.split]
ccha has quit [*.net *.split]
klaas has quit [*.net *.split]
llamma has quit [*.net *.split]
crobinso has quit [*.net *.split]
nalind has quit [*.net *.split]
jmarrero has quit [*.net *.split]
mikeru has quit [*.net *.split]
JosephGayoso[m] has quit [*.net *.split]
alebastr[m] has quit [*.net *.split]
SumantroMukherje has quit [*.net *.split]
Kan-RuChen[m] has quit [*.net *.split]
Eighth_Doctor has quit [*.net *.split]
mboddu has quit [*.net *.split]
jpn has quit [*.net *.split]
lvrabec has quit [*.net *.split]
enilflah_ has quit [*.net *.split]
npcomp has quit [*.net *.split]
sayan has quit [*.net *.split]
jaimelm has quit [*.net *.split]
bumperboat[m] has quit [*.net *.split]
MatthieuSaulnier has quit [*.net *.split]
cmagina has quit [*.net *.split]
u1106 has quit [*.net *.split]
kklimonda has quit [*.net *.split]
justJanne has quit [*.net *.split]
jzelinskie has quit [*.net *.split]
mgrundmann has quit [*.net *.split]
mheon has quit [*.net *.split]
c4rt0 has quit [*.net *.split]
nb has quit [*.net *.split]
siodor has quit [*.net *.split]
jdieter has quit [*.net *.split]
kieren has quit [*.net *.split]
strigazi has quit [*.net *.split]
baaash[m] has quit [*.net *.split]
mock has quit [*.net *.split]
AlexanderMiroshn has quit [*.net *.split]
gotmax[m] has quit [*.net *.split]
hank has quit [*.net *.split]
JayDoubleu__ has quit [*.net *.split]
d10n_ has quit [*.net *.split]
nnewton has quit [*.net *.split]
flokli has quit [*.net *.split]
gursewak has quit [*.net *.split]
HappyMan has quit [*.net *.split]
Orotheyshe[m] has quit [*.net *.split]
killefiz[m] has quit [*.net *.split]
miabbott[m] has quit [*.net *.split]
travisghansen has quit [*.net *.split]
spresti[m] has quit [*.net *.split]
hartan[m] has quit [*.net *.split]
sgallagh has quit [*.net *.split]
hiroshi[m] has quit [*.net *.split]
davdunc[m has quit [*.net *.split]
aleskandro[m] has quit [*.net *.split]
raatti[m] has quit [*.net *.split]
cverna has quit [*.net *.split]
anthr76[m] has quit [*.net *.split]
lucab has quit [*.net *.split]
adamw has quit [*.net *.split]
defolos has quit [*.net *.split]
jdoss has quit [*.net *.split]
pbrobinson has quit [*.net *.split]
pwhalen has quit [*.net *.split]
TimotheRavierus4 has quit [*.net *.split]
ykadev[m] has quit [*.net *.split]
LakshmiRavichand has quit [*.net *.split]
OnuralpSezer[m]1 has quit [*.net *.split]
gotmax has quit [*.net *.split]
hiredman has quit [*.net *.split]
guesswhat has quit [*.net *.split]
michele has quit [*.net *.split]
davdunc has quit [*.net *.split]
plarsen has quit [*.net *.split]
jlebon has quit [*.net *.split]
vgoyal has quit [*.net *.split]
rsalveti has quit [*.net *.split]
cyberpear has quit [*.net *.split]
ebbex has quit [*.net *.split]
hjst has quit [*.net *.split]
marmijo has quit [*.net *.split]
ChanServ has quit [*.net *.split]
mheon has joined #fedora-coreos
misuto has joined #fedora-coreos
rsalveti has joined #fedora-coreos
dustymabe has joined #fedora-coreos
cyberpear has joined #fedora-coreos
bumperboat[m] has joined #fedora-coreos
fifofonix has joined #fedora-coreos
TimotheRavierus4 has joined #fedora-coreos
ravanelli has joined #fedora-coreos
darknao has joined #fedora-coreos
gursewak has joined #fedora-coreos
HappyMan has joined #fedora-coreos
hotbox has joined #fedora-coreos
ScottEdlund[m] has joined #fedora-coreos
shoragan has joined #fedora-coreos
Orotheyshe[m] has joined #fedora-coreos
lvrabec has joined #fedora-coreos
raatti[m] has joined #fedora-coreos
AlexanderMiroshn has joined #fedora-coreos
Anonymous[m]12 has joined #fedora-coreos
decfi[m] has joined #fedora-coreos
M0xMRTT[m] has joined #fedora-coreos
MHamzahKhan[m] has joined #fedora-coreos
JosephGayoso[m] has joined #fedora-coreos
LakshmiRavichand has joined #fedora-coreos
cverna has joined #fedora-coreos
OnuralpSezer[m]1 has joined #fedora-coreos
aaradhak[m] has joined #fedora-coreos
Guest9887 has joined #fedora-coreos
miabbott[m] has joined #fedora-coreos
MatthieuSaulnier has joined #fedora-coreos
hartan[m] has joined #fedora-coreos
Eighth_Doctor has joined #fedora-coreos
bowsers[m] has joined #fedora-coreos
mikeru has joined #fedora-coreos
alebastr[m] has joined #fedora-coreos
cmagina has joined #fedora-coreos
spresti[m] has joined #fedora-coreos
ykadev[m] has joined #fedora-coreos
lucab has joined #fedora-coreos
queeup[m] has joined #fedora-coreos
davdunc[m has joined #fedora-coreos
gotmax[m] has joined #fedora-coreos
lorbus has joined #fedora-coreos
go4godvin has joined #fedora-coreos
hiroshi[m] has joined #fedora-coreos
travier[m] has joined #fedora-coreos
walters has joined #fedora-coreos
sgallagh has joined #fedora-coreos
adamw has joined #fedora-coreos
Sheogorath[m] has joined #fedora-coreos
jmarrero has joined #fedora-coreos
anthr76[m] has joined #fedora-coreos
baaash[m] has joined #fedora-coreos
vladan[m] has joined #fedora-coreos
shoragan[m] has joined #fedora-coreos
defolos has joined #fedora-coreos
GingerGeek has joined #fedora-coreos
hank has joined #fedora-coreos
jbaublitzzz has joined #fedora-coreos
thomasfedb has joined #fedora-coreos
enilflah_ has joined #fedora-coreos
ebbex has joined #fedora-coreos
Whoop has joined #fedora-coreos
ccha has joined #fedora-coreos
klaas has joined #fedora-coreos
gotmax has joined #fedora-coreos
mboddu has joined #fedora-coreos
nb has joined #fedora-coreos
npcomp has joined #fedora-coreos
llamma has joined #fedora-coreos
JayDoubleu__ has joined #fedora-coreos
guesswhat has joined #fedora-coreos
jaimelm has joined #fedora-coreos
sayan has joined #fedora-coreos
strigazi has joined #fedora-coreos
kieren has joined #fedora-coreos
jdieter has joined #fedora-coreos
mock has joined #fedora-coreos
siodor has joined #fedora-coreos
mgrundmann has joined #fedora-coreos
jzelinskie has joined #fedora-coreos
kklimonda has joined #fedora-coreos
justJanne has joined #fedora-coreos
u1106 has joined #fedora-coreos
flokli has joined #fedora-coreos
d10n_ has joined #fedora-coreos
nnewton has joined #fedora-coreos
michele has joined #fedora-coreos
pbrobinson has joined #fedora-coreos
jdoss has joined #fedora-coreos
hiredman has joined #fedora-coreos
davdunc has joined #fedora-coreos
pwhalen has joined #fedora-coreos
hjst has joined #fedora-coreos
ChanServ has joined #fedora-coreos
nalind has joined #fedora-coreos
plarsen has joined #fedora-coreos
jpn has joined #fedora-coreos
marmijo has joined #fedora-coreos
crobinso has joined #fedora-coreos
vgoyal has joined #fedora-coreos
jlebon has joined #fedora-coreos
c4rt0 has joined #fedora-coreos
bgilbert has joined #fedora-coreos
travisghansen has joined #fedora-coreos
killefiz[m] has joined #fedora-coreos
aleskandro[m] has joined #fedora-coreos
SumantroMukherje has joined #fedora-coreos
rishi`` has joined #fedora-coreos
Kan-RuChen[m] has joined #fedora-coreos
wolfshappen has quit [Max SendQ exceeded]
wolfshappen has joined #fedora-coreos
zodbot has quit [Remote host closed the connection]
zodbot has joined #fedora-coreos
<jlebon> anyone using the stg jenkins? dustymabe ravanelli
<ravanelli> jlebon: not me
<dustymabe> me
<dustymabe> ✋🏻
<jlebon> dustymabe: ack. let me know when you're done. want to test something with the agent
<dustymabe> trying to give one final test to this plugin update
<dustymabe> though.. not working out so great
<dustymabe> Timed out waiting for websocket connection. You should increase the value of system property org.csanchez.jenkins.plugins.kubernetes.pipeline.ContainerExecDecorator.websocketConnectionTimeout currently set at 30 seconds
<dustymabe> is this the thing where you have to go into the admin interface and click "Save" on something?
<dustymabe> I just deployed jenkins from scratch
<jlebon> hmm, can you link to the job?
<marmijo> dustymabe: Could I please get a review on the roll-out PR? https://github.com/coreos/fedora-coreos-streams/pull/569
ravanelli has quit [Quit: Leaving...]
<dustymabe> jlebon: do you see the timeout?
<jlebon> dustymabe: can you try fast-tracking the kubernetes plugin to 1.31.2 ?
<dustymabe> 👀
<dustymabe> jlebon: looking
<dustymabe> where does that plugin get pulled in?
<jlebon> those are toplevel plugins. there's a depsolve involved
<jlebon> this applies to our added plugins as well, they probably bring in other ones
<dustymabe> right. I'm just trying to figure out what's pulling it in
<dustymabe> probably `kubernetes-credentials-provider` ?
<jlebon> i think the kubernetes plugin
<jlebon> are you asking about the kubernets plugin, or
<jlebon> kubernetes-client-api-plugin
<dustymabe> so if I look at that list and the list of plugins in base-plugins.txt the only one that has kubernetes in the name is kubernetes-credentials-provider
<jlebon> the kubernetes plugin is likely pulled in by one or more of the openshift plugins
<dustymabe> ahh - cool
<dustymabe> ok let me get this updated
<dustymabe> That file was last update on Apr 21
<jlebon> ok i'm misunderstanding. are you asking what's pulling in the new version specifically?
<dustymabe> i was originally asking "what's pulling in that dependency" - now we know
<dustymabe> but also we know that that plugin names a super old version
<jlebon> i'm not a maven expert, but I think the pom just lists minimum versions
<dustymabe> 1.31.0 released Released: Dec 8, 2021
<dustymabe> yeah, but then why do we get such an old version installed?
<dustymabe> there's been like 15 releases since then
<jlebon> likely the base jenkins version
<dustymabe> ok let's check that
<jlebon> checking
<dustymabe> Jenkins 2.346.3
<dustymabe> latest version of kubernetes plugin - released on Sep 30, 2022 - "Requires Jenkins 2.332.1"
<jlebon> according to https://plugins.jenkins.io/kubernetes/ the latest version requires 2.332.1
<jlebon> yeah
<dustymabe> and we are at 2.346.3
<jlebon> IIRC, the image build prints depsolve details, so might be worth checking that
<jlebon> but we'd need the depsolve from the base image, not our layered one
<dustymabe> exactly
<dustymabe> ok I'll try to update to a newer version
<jlebon> hmm, let's just do the point upgrade
<dustymabe> but I think there's an issue that needs to be filed somewhere
<dustymabe> point upgrade?
<jlebon> i'd file against https://github.com/openshift/jenkins
<jlebon> 1.31.2
jpn has quit [Ping timeout: 252 seconds]
<dustymabe> what's the point?
<dustymabe> :)
<dustymabe> just to see if it works
<jlebon> turns out there's two plugin lists :)
<dustymabe> oh fun
<jlebon> i'd rather not stray far from what OCP ships
<dustymabe> ok
<jlebon> let's file an issue to see if there's a good reason it's held back. i can pick that up if you'd like.
<dustymabe> yeah, if you don't mind :)
<jlebon> ack
<dustymabe> i'll link to it in a comment as well in my commit
<dustymabe> thanks for helping me track this down
jpn has joined #fedora-coreos
<dustymabe> btw for the documentation/comments - what's the difference between base-plugins.txt and bundle-plugins.txt ?
<jlebon> i'm not sure. i hadn't noticed the latter before today
* jlebon does a quick git grep
<jlebon> it seems like bundle-plugins.txt is the fully depsolved list
<dustymabe> good to know
<dustymabe> i feel like our understanding of all of this will be much better after this exercise
jpn has quit [Ping timeout: 252 seconds]
c4rt0 has quit [Remote host closed the connection]
<jlebon> dustymabe: btw when testing plugin updates, make sure to also check the jenkins logs too for incompatibilities
c4rt0 has joined #fedora-coreos
c4rt0_ has joined #fedora-coreos
c4rt0_ has quit [Remote host closed the connection]
c4rt0 has quit [Remote host closed the connection]
<dustymabe> should be good to go now I think
<dustymabe> jlebon: in the future two things we should consider:
<dustymabe> pulling the openshift image by hash and periodically bumping that in git
<dustymabe> fully depsolving our plugin list too
<jlebon> dustymabe: agreed, though it has an overhead cost
<jlebon> a `bump-jenkins` job that bumps the base and plugins would help a lot
<jlebon> and links to instructions on how to test in stg
<dustymabe> the reason I think it becomes more important is that we'll have multiple versions of the pipeline running and we want to ensure consistency across those
<dustymabe> you don't want one to see different behavior because it got brought up on a tuesday versus a saturday
<jlebon> yup, agreed
<jlebon> it's one of those things where it hasn't been too painful to deal with so far to be worth it, but maybe it is now
<jlebon> dustymabe: let's reuse that pipeline issue to track this?
<jlebon> suggested rename: "Lock base version and all plugins and add `bump-jenkins` job"
<dustymabe> WFM - want to change the name and add context or you want me to?
<jlebon> i can
<dustymabe> TY
<bgilbert> dustymabe: freezing the denylist wfm. we'd need to update the promotion-diff.yml job to avoid alerting on the denylist change
travisghansen has quit [Read error: Connection reset by peer]
travisghansen has joined #fedora-coreos
<jmarrero> dustymabe: https://github.com/coreos/coreos-assembler/pull/3111 did I understand your comment correctly?
<dustymabe> jmarrero: responded
jpn has joined #fedora-coreos
<jmarrero> dustymabe: thanks, makes sense to me.
<dustymabe> jlebon: want to circle on the few pipeline PRs?
jpn has quit [Ping timeout: 264 seconds]
tempus_fol has quit [Ping timeout: 244 seconds]
tempora has joined #fedora-coreos
<jlebon> dustymabe: testing out some agent rework patches
<walters> OK please feel free to add your name to https://fedoraproject.org/wiki/Changes/OstreeNativeContainerStable if you're on board!
<walters> if we can get some consensus around rebranding, then this would be /Changes/DnfImage
jpn has joined #fedora-coreos
jpn has quit [Ping timeout: 265 seconds]
nalind has quit [Quit: until next time]
vgoyal has quit [Quit: Leaving]
crobinso has quit [Remote host closed the connection]
mheon has quit [Ping timeout: 268 seconds]
<bgilbert> have there been changes to runner resource allocations in CoreOS CI?
<bgilbert> we're seeing consistent coreos-installer CI failures in testiso pxe-offline-install, which appear to be timeouts due to very slow installs