LetoThe2nd changed the topic of #yocto to: Welcome to the Yocto Project | Learn more: https://www.yoctoproject.org | Community: https://www.yoctoproject.org/community | IRC logs: http://irc.yoctoproject.org/irc/ | Having difficulty on the list, with someone on the list or on IRC, contact Yocto Project Community Manager Letothe2nd | CoC: https://www.yoctoproject.org/community/code-of-conduct
goliath has quit [Quit: SIGSEGV]
Saur_Home has quit [Quit: Client closed]
Saur_Home has joined #yocto
dkl has quit [Ping timeout: 245 seconds]
dkl has joined #yocto
Abp has joined #yocto
Abp has quit [Ping timeout: 255 seconds]
sakman has joined #yocto
davidinux has quit [Ping timeout: 252 seconds]
davidinux has joined #yocto
starblue has quit [Ping timeout: 252 seconds]
starblue has joined #yocto
Xagen has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
sotaoverride has quit [Killed (molybdenum.libera.chat (Nickname regained by services))]
sotaover1ide is now known as sotaoverride
jclsn has quit [Ping timeout: 245 seconds]
jclsn has joined #yocto
ctraven has joined #yocto
Saur_Home has quit [Quit: Client closed]
Saur_Home has joined #yocto
starblue has quit [Ping timeout: 245 seconds]
starblue has joined #yocto
amitk_ has joined #yocto
amitk_ has quit [Remote host closed the connection]
amitk has quit [Remote host closed the connection]
enok has joined #yocto
schtobia has quit [Quit: Bye!]
schtobia has joined #yocto
jmd has joined #yocto
Abp has joined #yocto
Abp has quit [Ping timeout: 256 seconds]
Abp has joined #yocto
enok has quit [Ping timeout: 268 seconds]
Raman has joined #yocto
Raman has quit [Client Quit]
florian has joined #yocto
Abp has quit [Ping timeout: 260 seconds]
Abp has joined #yocto
leon-anavi has joined #yocto
alperak has joined #yocto
michael_e has joined #yocto
Abp has quit [Read error: Connection reset by peer]
Abp has joined #yocto
geoffhp has quit [Remote host closed the connection]
enok has joined #yocto
zpfvo has joined #yocto
goliath has joined #yocto
rfuentess has joined #yocto
Kubu_work has joined #yocto
altru has joined #yocto
mvlad has joined #yocto
wmills_ has quit [Remote host closed the connection]
wmills_ has joined #yocto
xmn has quit [Quit: ZZZzzz…]
xmn has joined #yocto
c-thaler has joined #yocto
enok has quit [Ping timeout: 255 seconds]
<LetoThe2nd> yo dudX
enok has joined #yocto
nickwhitlock has quit [Quit: Client closed]
<landgraf> https://dpaste.org/ynFzV looks really bad (note inc and inc~ difference in the filename)
<landgraf> why bitbake includes inc~ while recipe has `require *inc` ? o_O
jsandman has joined #yocto
enok has quit [Ping timeout: 240 seconds]
enok has joined #yocto
enok has quit [Ping timeout: 256 seconds]
michael_e has quit [Ping timeout: 250 seconds]
ehussain has joined #yocto
ahussain has joined #yocto
rber|res has quit [Remote host closed the connection]
ehussain has quit [Ping timeout: 256 seconds]
ahussain is now known as ehussain
altru has quit [Quit: Client closed]
jmd has quit [Remote host closed the connection]
ehussain has quit [Ping timeout: 255 seconds]
ehussain has joined #yocto
ehussain has quit [Ping timeout: 245 seconds]
ehussain has joined #yocto
<rburton> landgraf: have you verified that its actually reading the ~ file by changing the value in it?
dkl has quit [Quit: %quit%]
dkl has joined #yocto
enok has joined #yocto
goliath has quit [Quit: SIGSEGV]
<landgraf> rburton: nope. I've removed it right away :(
enok has quit [Ping timeout: 255 seconds]
ptsneves has joined #yocto
<RP> landgraf: it nearly sounds like the cache invalidation didn;t work
<landgraf> RP: I thought so but the SRCREV bitbake used was really old one and I rebuild this recipe few times per hour.
<RP> landgraf: does it reproduce at will?
<landgraf> RP: Nope. At least at the first try
<landgraf> RP: It's really my bad (good for QE) karma or cache issue :)
<landgraf> or birthday gift from bitbake :-D
ablu has quit [Ping timeout: 252 seconds]
ablu has joined #yocto
ptsneves has quit [Ping timeout: 272 seconds]
amurray_tgp has joined #yocto
altru has joined #yocto
<amurray_tgp> I've just starting my first build of Scarthgap, following instructions from https://docs.yoctoproject.org/brief-yoctoprojectqs/index.html and using sstate mirrors, however i'm seeing lots of do_fetch's and it looks like its going to build gcc from source - in previous releases the sstate has been pretty good allowing a build to be completed in 15
<amurray_tgp> mins (with mickledore at least). I thought I'd flag it up in case this wasn't expected. "Wanted 4699 Local 0 Mirrors 1925 Missed 2774 Current 0 (40% match, 0% complete)"
<rburton> that matches what LetoThe2nd saw. i wonder why the sstate isn't matching in the cdn.
<rburton> 40% match smells like its grabbing the license files but not the actual binaries
<RP> amurray_tgp: did you enable the hash equivalence server as well?
<LetoThe2nd> rburton: oh the joy of live sessions!
<amurray_tgp> RP: It's set to auto as per instructions, i.e.
<amurray_tgp> BB_HASHSERVE_UPSTREAM = "hashserv.yocto.io:8687"
<amurray_tgp> BB_HASHSERVE = "auto"
<amurray_tgp> BB_SIGNATURE_HANDLER = "OEEquivHash"
<amurray_tgp> not auto, OEEquivHash
<RP> oh, I know what happened :(
<RP> amurray_tgp: could you try replacing hashserv.yocto.io:8687 with wss://hashserv.yoctoproject.org/ws ?
<amurray_tgp> sure...
<amurray_tgp> It's not happy with that.
<amurray_tgp> WARNING: BB_HASHSERVE_UPSTREAM is not valid, unable to connect hash equivalence server at 'wss://hashserv.yoctoproject.org/ws': gaierror(-8, 'Servname not supported for ai_socktype')
<amurray_tgp> followed by exceptions
crazy_imp has quit [Ping timeout: 245 seconds]
<RP> amurray_tgp: do you have the python websockets module available? It sounds like we'll have to look into this a bit more :/
<RP> amurray_tgp: I see that error too so it isn't you :/
<RP> amurray_tgp: BB_HASHSERVE_UPSTREAM = 'hashserv.yoctoproject.org:443' might work
* RP wonders if JPEW happens to know the right thing to do here offhand
<landgraf> doesn't work for me either. Same warning followed by exceptions (python-websockets installed)
<amurray_tgp> Using :443 results in connection error exception "ConenctionError: Connection Closed".
<amurray_tgp> I didn't have websockets installed (on my Ubuntu 22.04 machine) - installing python3-websockets has no effect (same ai_socktype error and exceptions).
<amurray_tgp> However, pip3 install websockets gives something different... still get ai_socktype error, but 'Initialising tasks' seems to get stuck
enok has joined #yocto
Abp has quit [Remote host closed the connection]
Abp has joined #yocto
ehussain has quit [Remote host closed the connection]
ehussain has joined #yocto
enok has quit [Ping timeout: 260 seconds]
Saur_Home has quit [Quit: Client closed]
enok has joined #yocto
Saur_Home has joined #yocto
Saur_Home has quit [Quit: Client closed]
Saur_Home has joined #yocto
enok has quit [Ping timeout: 245 seconds]
amurray_tgp has quit [Ping timeout: 250 seconds]
amurray_tgp73 has joined #yocto
jmd has joined #yocto
ehussain has quit [Ping timeout: 260 seconds]
amitk has joined #yocto
<JPEW> amurray_tgp73: Hmm, that is actually an error from libc, not python. Can you see if `curl -v https://hashserv.yoctoproject.org:443/ws` works?
gvmeson has joined #yocto
yamelino has joined #yocto
vmeson has quit [Ping timeout: 260 seconds]
<RP> JPEW: I think we may be processing the /ws in there incorrectly in the _UPSTREAM variable
<RP> JPEW: that curl line works for me but it doesn't work in the variable
<JPEW> RP: mmm, OK. Let me look
<JPEW> Ok, the connection check
goliath has joined #yocto
yamelino has left #yocto [#yocto]
<amurray_tgp73> The curl command works to some degree:
<amurray_tgp73> ...
<amurray_tgp73> >
<amurray_tgp73> * TLSv1.2 (IN), TLS header, Supplemental data (23):
<amurray_tgp73> * TLSv1.3 (IN), TLS handshake, Newsession Ticket (4):
<amurray_tgp73> * TLSv1.2 (IN), TLS header, Supplemental data (23):
<amurray_tgp73> * TLSv1.3 (IN), TLS handshake, Newsession Ticket (4):
<amurray_tgp73> * old SSL session ID is stale, removing
<amurray_tgp73> * TLSv1.2 (IN), TLS header, Supplemental data (23):
<amurray_tgp73> * Mark bundle as not supporting multiuse
<amurray_tgp73> < HTTP/1.1 426 Upgrade Required
<amurray_tgp73> < Server: nginx/1.24.0
<amurray_tgp73> < Date: Thu, 02 May 2024 14:00:08 GMT
<amurray_tgp73> < Content-Type: text/plain
<amurray_tgp73> < Content-Length: 153
<amurray_tgp73> < Connection: keep-alive
<amurray_tgp73> < Upgrade: websocket
<amurray_tgp73> <
<JPEW> amurray_tgp73: Ya, that's working as expected
<JPEW> curl doesn't speak websockets, so it fails when it get to that point :)
<ldywicki> err, try using pastebin for anything longer than 2 lines ;-)
<amurray_tgp73> ah yeah, will do ldywicki
Xagen has joined #yocto
amitk has quit [Ping timeout: 264 seconds]
enok has joined #yocto
<JPEW> amurray_tgp73: There is a patch on the ML that I think will fix it if you want to give it a try
<JPEW> Oops wrong ML
ehussain has joined #yocto
<RP> JPEW: I've queued it on master-next regardless
<RP> JPEW: thanks!
<JPEW> RP: Ya, it's the same patch on both
<RP> sakoman: this may speed up the need for a point release
locutusofborg has quit [Read error: Connection reset by peer]
locutusofborg has joined #yocto
altru has quit [Ping timeout: 250 seconds]
<amurray_tgp73> JPEW I'll give it a test
enok has quit [Ping timeout: 260 seconds]
jmiehe has joined #yocto
mattsm has joined #yocto
<RP> amurray_tgp73: I've merged fixes for the hashequiv issues to the scarthgap branches
enok has joined #yocto
rfuentess has quit [Remote host closed the connection]
ehussain has quit [Quit: ehussain]
<amurray_tgp73> RP JPEW - I applied the single patch (cooker: Use hash client...) though I'm still seeing it fetch gcc, trying to rule out anything on my side. Are any changes needed to update doc to reflect package requirements for websockets, and/or changes to BB_HASHSERVE_UPSTREAM ?
<RP> amurray_tgp73: did you change the local.conf BB_HASHSERVE_UPSTREAM address too?
<amurray_tgp73> I tried all three (original, wss and :443)
<RP> amurray_tgp73: you might need to clean out the build directory to force it to go back to the servers too
<JPEW> amurray_tgp73: Pretty sure you need the wss:// one
<RP> amurray_tgp73: the tmp/cache and cache/ directories
<amurray_tgp73> yeah i've been getting rid of the build directory each time. It takes a while to test as it seems to spend an eternity at the 44% of the "Initialising tasks" state without any feedback, have no idea what its doing
<rburton> that's it hitting the hashserv
joggee-fr has joined #yocto
<RP> and sstate
<amurray_tgp73> right, so with the wss:// upstream with fresh build/ I get this https://pastebin.com/9cX0HmMn
amitk has joined #yocto
<RP> that looks like an old websockets version :(
<amurray_tgp73> Also its the information on https://docs.yoctoproject.org/brief-yoctoprojectqs/index.html that needs to be updated to reflect use of websockets version of BB_HASHSERVE_UPSTREAM - not sure if anything already in pipeline (rather than sample.conf version)
<RP> michaelo: around? ^^^
<RP> amurray_tgp73: we do need to fix that, yes
<amurray_tgp73> So on my Ubuntu 22.04.2 LTS,  the error i just pastebin'd happens when you apt-get install python3-websockets, however if i uninstall that and pip3 install websockets - then it doesn't error. It's at the 44% stage, I'll let you know how far it goes
joggee-fr has quit [Quit: Client closed]
<JPEW> amurray_tgp73: pip is usually way ahead of the distro version of a python module; and the recommendation from python is to use pip instead of the distro packages. The distro packages are more or less _just_ for distro installed software
xmn has quit [Quit: xmn]
<amurray_tgp73> JPEW show the docs be updated to reflect this dependency? Someone may not have websockets installed, update their local.conf in hope of faster builds, but not see that improvement or an error?
<JPEW> Yes
<JPEW> I think if your websockets are old/not-installed you _should_ see the error though
xmn has joined #yocto
<amurray_tgp73> I'm happy with those patches, I now get 99% match with sstate on core-image-sato. I'd give my acked-by but i'm not currently subscribed or setup my email to do mailing list stuff. But thanks for all the support today :)
<amurray_tgp73> JPEW with no websockets installed you get a module not found python error - https://pastebin.com/PqsSBGFf
<JPEW> amurray_tgp73: Ok, we can improve that I think
<JPEW> At least improve the error message; if you don't want to install websockets, you need to change BB_HASHSERVE_UPSTREAM
florian has quit [Quit: Ex-Chat]
<RP> JPEW: I suspect we need a version check too, older websockets versions seem problematic
<JPEW> RP: Ya, I'll have to see what we can do there
<RP> amurray_tgp73: sorry you ran into issues and thanks for reporting them. I'm a bit embarrassed we shipped with this issue :/
<amurray_tgp73> RP not a problem at all, i'm super happy to have helped.
<amurray_tgp73> RP JPEW if you can't ping the hashserv then you should def throw an error, otherwise you end up in the situation where people are saying sstate is unreliable where there isn't really much visibility in what's happening. At least with an error someone can see that the configuration they've specified (i.e. BB_HASHSERVE_UPSTREAM) isn't going to work
<amurray_tgp73> for some reason (i.e. server not there, local tools not suitable)
enok has quit [Quit: enok]
enok has joined #yocto
<RP> amurray_tgp73: I've just pushed some changes to that manual page too, it should updated after it runs through the various build processes
<JPEW> Ya, it should probably also not keep trying to use the upstream hash server if it can't be pinged
<amurray_tgp73> excellent!
Xagen has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
Xagen has joined #yocto
zpfvo has quit [Remote host closed the connection]
<JPEW> RP: Do you happen to know the minimum websockets version?
<JPEW> Looks like 9.1
<khem> this is with master-next today, did not see it before, rings any bells ?
<JPEW> Looks like a `sync()` call was missed. michaelo ^^
<RP> JPEW: I wasn't sure which versions work/don't
<JPEW> RP: Reading the e-mail, it looks like 9.1 is the oldest version in use on the AB; unless those workers aren't using websockets
<RP> JPEW: they all should be. I did see https://autobuilder.yoctoproject.org/typhoon/#/builders/127/builds/3269 earlier which puzzled me a bit though
<khem> JPEW: yeah it seems one of prserv: patches from michaelo
<khem> I removed the series locally and it works
applepi has joined #yocto
<RP> khem: it is good data to have thanks. I'll hold off merging. Could you reply on list please?
* RP 's head is spinning from too many patches and directions today
wmills_ has quit [Remote host closed the connection]
<khem> RP:yeah, I will try to narrow it down to a patch if I can if not I will reply soon
wmills_ has joined #yocto
<khem> my builds keep breaking for one reason or other
<applepi> I've got a weird issue that I'm not even sure what to google... I've got a git repo that uses git-lfs, and a recipe that uses this git repo.  When it is pointing to my most up to date commit, everything works normally, it clones and checks out and builds, etc..   but if I change the recipe to use an earlier source rev, I get errors about git-lfs
<applepi> is not found.  I'm not sure how just changing the SRCREV is changing whether git-lfs works or not
<RP> applepi: which version of the project? We've seen various git lfs patches/changes in the fetcher
<applepi> RP: which version of yocto?
<applepi> I can't remember..  let me dig.  This is a vendor's yocto and I just add stuff onto it
<RP> applepi: basically I'm saying there are changes in bitbake/lib/fetch2/ related to lfs you may want/need
<RP> I don't use lfs so I don't know more
<applepi> Their yocto is on sumo
<RP> applepi: things have changed a lot, that is a very old and out of date release
<applepi> Yeah, it's a vendor distro
<applepi> I just don't understand why I can git clone it myself and checkout the srcrev manually, or set the srcrev="newer commit" and bitbake it, but srcrev="old commit" dies
goliath has quit [Quit: SIGSEGV]
jmiehe has quit [Quit: jmiehe]
leon-anavi has quit [Remote host closed the connection]
enok has quit [Ping timeout: 268 seconds]
enok has joined #yocto
vladest has quit [Remote host closed the connection]
Haxxa has quit [Ping timeout: 264 seconds]
enok has quit [Ping timeout: 256 seconds]
florian_kc has joined #yocto
<khem> sometimes repos get rebased etc. have you checked that manually cloning the concerned repo and checking our the sha in question works ok ?
sakoman has quit [Ping timeout: 256 seconds]
<applepi> khem: yeah that works
<khem> so I guess, it might be something in fetcher that got fixed. I would suggest to try master branch of poky and see if that helps if it does then trace it back from there where it got fixed. If it is still broken with master then file a bugzilla entry would be good
sakoman has joined #yocto
vladest has joined #yocto
Haxxa has joined #yocto
amitk has quit [Ping timeout: 245 seconds]
sakoman has quit [Ping timeout: 260 seconds]
dmoseley has quit [Quit: ZNC 1.9.0 - https://znc.in]
dmoseley has joined #yocto
goliath has joined #yocto
enok has joined #yocto
Beartama has joined #yocto
Beartama has quit [Client Quit]
Beartama has joined #yocto
<Beartama> is there a plan for supporting Ubuntu 24.04?
sakoman has joined #yocto
Vonter has quit [Ping timeout: 264 seconds]
c-thaler has quit [Quit: Client closed]
jmd has quit [Remote host closed the connection]
goliath has quit [Quit: SIGSEGV]
mvlad has quit [Remote host closed the connection]
xmn has quit [Ping timeout: 264 seconds]
<RP> Beartama: we will, just a question of fitting it around other infrastructure changes that are more pressing
<Beartama> cool, is there some where i can track the progress?
<RP> You could see when we add such a worker to the autobuilder I guess
ernstp has quit [Quit: Updating details, brb]
ernstp has joined #yocto
<moto-timo> With the new USERADD_DEPENDS that landed in scarthgap, and the removal of the (bad idea) -P plain text password hack to useradd that we used to have... I am now working on a method to make it easier to generate passwords with "openssl passwd -6 -salt $SALT $PASSWD $USER | sed 's/\$/\\$/g'" (the sed is probably not good enough).
<moto-timo> Now I'm trying to decide between a shell function and a python function... and some way to make this a someone generalized universal contribution (e.g. classes-recipe/safe_passwd_hash.bbclass or something like that)
<moto-timo> I've been doing this for customers for two years now, so it's about time to figure out a generalized solution.
khem has quit [Quit: WeeChat 4.2.2]
khem has joined #yocto
<moto-timo> I should add that the solution needs to be variable safe in bitbake space, hence the escaping of $
<RP> moto-timo: could we have an external script to do it?
<RP> i.e. some tool in scripts ?
<moto-timo> RP: perhaps yes.
<moto-timo> I am definitely into finding the most universal solution so I can contribute it and use it
<RP> moto-timo: I'm just making drive by suggestions :)
<moto-timo> (more security authentication stuff to come based on conversations at EOSS Seattle)
<moto-timo> RP: yes, I appreciate that
<moto-timo> maybe I should use tr instead of sed
applepi has quit [Ping timeout: 250 seconds]
enok has quit [Ping timeout: 272 seconds]
Xagen has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
Kubu_work has quit [Quit: Leaving.]
<JaMa> Beartama: ubuntu 24.04 works fine for me, it just isn't marked as sanity tested by Poky until there is autobuilder node doing the regular testing, do you see any issue with 24.04 or why are you asking?
Abp has quit [Ping timeout: 260 seconds]
florian_kc has quit [Ping timeout: 252 seconds]
Beartama has quit [Ping timeout: 250 seconds]
Xagen has joined #yocto
alperak has quit [Quit: Connection closed for inactivity]
nerdboy has quit [Ping timeout: 240 seconds]
Abp has joined #yocto
nerdboy has joined #yocto
nerdboy has quit [Changing host]
nerdboy has joined #yocto
Abp has quit [Ping timeout: 255 seconds]