fancer has quit [Quit: Konversation terminated!]
naoki has quit [Quit: naoki]
naoki has joined #riscv
fuwei has quit [Quit: Konversation terminated!]
vagrantc has quit [Quit: leaving]
drmpeg has quit [Ping timeout: 260 seconds]
drmpeg has joined #riscv
Tenkawa has quit [Quit: Was I really ever here?]
mlw has joined #riscv
JanC_ has joined #riscv
JanC is now known as Guest5680
Guest5680 has quit [Killed (lead.libera.chat (Nickname regained by services))]
JanC_ is now known as JanC
fuwei has joined #riscv
BootLayer has joined #riscv
fuwei has quit [Quit: Konversation terminated!]
naoki has quit [Remote host closed the connection]
naoki has joined #riscv
hexdump0815 has quit [Ping timeout: 246 seconds]
hexdump0815 has joined #riscv
squelch22 has joined #riscv
BootLayer has quit [Quit: Leaving]
squelch21 has quit [Ping timeout: 252 seconds]
squelch22 is now known as squelch21
beber_ has joined #riscv
agentcasey has joined #riscv
heat has quit [Ping timeout: 264 seconds]
coldfeet has joined #riscv
JanC_ has joined #riscv
JanC is now known as Guest3759
Guest3759 has quit [Killed (tantalum.libera.chat (Nickname regained by services))]
JanC_ is now known as JanC
coldfeet has quit [Quit: Lost terminal]
JRepin has quit [Quit: Konversation terminated!]
JRepin has joined #riscv
naoki has quit [Quit: naoki]
naoki has joined #riscv
fancer has joined #riscv
pecastro has joined #riscv
mlw has quit [Ping timeout: 246 seconds]
cleger has joined #riscv
agentcasey has quit [Ping timeout: 276 seconds]
jfsimon1981 has quit [Ping timeout: 265 seconds]
prabhakalad has quit [Quit: Konversation terminated!]
prabhakalad has joined #riscv
jfsimon1981 has joined #riscv
rvalles has quit [Quit: rvalles]
naoki has quit [Quit: naoki]
naoki has joined #riscv
agentcasey has joined #riscv
hexdump0815 has quit [Quit: WeeChat 3.8]
hexdump0815 has joined #riscv
fuwei has joined #riscv
JRepin has quit [Quit: Konversation terminated!]
JRepin has joined #riscv
nexR has quit [Ping timeout: 248 seconds]
nexR has joined #riscv
craigo has joined #riscv
naoki has quit [Quit: naoki]
naoki has joined #riscv
TMM has joined #riscv
danilogondolfo has joined #riscv
craigo has quit [Quit: Leaving]
Tenkawa has joined #riscv
stolen has joined #riscv
fancer has quit [Quit: Konversation terminated!]
naoki has quit [Quit: naoki]
mlw has joined #riscv
<
stolen>
hi I was trying to compile gem5 on my wsl, how long should it take?
<
stolen>
i couldn't compile within 5 hours even...
Armand|X13s has joined #riscv
getz- has joined #riscv
getz has quit [Ping timeout: 244 seconds]
<
Tenkawa>
stolen: whats your wsl host machine specs?
<
Tenkawa>
cross compiling does take a while
<
stolen>
i5 4 cores 8 threads
<
stolen>
what are the specs required? I can use some cloud computing power then ig
pbsds3 has joined #riscv
<
Tenkawa>
Not sure (never compiled it by hand)... let me try it natively and see how long it takes
<
stolen>
I was shocked there was no community at #gem5 !
<
stolen>
Apparently they operate entirely out of slack
<
Armand|X13s>
Eeewww
<
Tenkawa>
do you know if there is a debian/ubuntu package for it?
<
Tenkawa>
(trying to find a source package I can pull and compile direct on my risc-v server)
<
stolen>
I don't think they have one Tenkawa , all tutorials I saw said you gotta build it from source cause that's the way about it
<
Tenkawa>
got a url?
<
stolen>
sure just a moment
<
Tenkawa>
I'm up for trying it
<
stolen>
thanks Tenkawa :)
<
Tenkawa>
I've been out in 1F this morning.. I'm avoiding that for the rest of the day lol
<
stolen>
I don't know if I should be compiling on a cloud server, don't think jupyter notebooks would support building gem5 lol
<
Tenkawa>
their clone instruction needs tweaking too
<
Tenkawa>
unless you are submitting changes to them they should really have people using --depth=1
<
stolen>
really? why is that?
<
Tenkawa>
without that it pulls every revision to a file ever made in the repo
<
stolen>
I think a lot of their tutorials need a revision
<
Tenkawa>
if they are bringing in remore repos.. it might be needed.. however I havent seen any yet
getz- is now known as getz
<
Tenkawa>
odd... its trying to build x86 objects
<
Tenkawa>
did it do that on yours?
<
stolen>
how did you understand that?
<
Tenkawa>
more applicably... I'm not sure they have this "ported" to risc-v yet
<
stolen>
I mean the final thing it's trying to build is a x86.opt
<
Tenkawa>
[ CXX] X86/python/gem5/utils/multisim/__init__.py.cc -> .pyo
<
stolen>
does it give a capstone libary warning on yours?
<
stolen>
and also that hdf5 library is not found right?
<
stolen>
I really don't know how people on windows would build stuff without the cross compilation though
<
Tenkawa>
stolen: vms
<
Tenkawa>
That's how I do it on my Mac
<
stolen>
doesn't mac have homebrew that saves all the effort?
<
Tenkawa>
somewhat.. but its uglier and not as complete
<
stolen>
vms is for openVMS right?
<
Tenkawa>
no.. virtual machie
<
Tenkawa>
er machine
Armand|X13s has quit [Ping timeout: 252 seconds]
<
stolen>
but that's an overhead too I think, overhead on the actual resources available
<
Tenkawa>
No.. paravirtualization removes over 95% of the overhead
<
stolen>
virtualbox and VMware have paravirtualization?
<
Tenkawa>
Not sure... but Kernel KVM does
<
Tenkawa>
and windows has drivers I think
<
Tenkawa>
I see one of the things slowing this down a lot.... python
<
stolen>
really? I think in the repo readme they did it just using scons without much python ig
<
Tenkawa>
watching the resource usage.. python is switching out a lot of resources doing t he build instad of letting it actually build
<
Tenkawa>
32528 root 20 0 640932 104780 9472 S 13.0 2.6 0:44.68 python3
<
Tenkawa>
thats a fairly heavy resource usage
<
Tenkawa>
using more memory than the compiler threads are
<
stolen>
nothing we can do about that i think
<
Tenkawa>
no not really sadly
<
stolen>
I let this thing run for 5-6 hours at a stretch on my 4 core i5, still didn't finish
<
Tenkawa>
looks like it could use a generator rewrite to optimize the build routines (what I did for a living)
<
Tenkawa>
It is building up but not releasing any resources as it goes.
<
stolen>
wow that's super inefficient
<
stolen>
and gem5 is a pretty popular tool now-a-days
<
stolen>
lot of people are using this
<
Tenkawa>
I imagine if I moved this to my powerhouse computer it would finish in a few minutes... but I wanted to emulate more what you saw
mlw has quit [Ping timeout: 252 seconds]
<
stolen>
right, thanks!
<
stolen>
powerhouse... I'm curious, what's the power? haha
<
Tenkawa>
I think I will run both as a test
<
Tenkawa>
doh... wonder if it will build on freebsd
<
Tenkawa>
my other machine is running freebsd
<
Tenkawa>
just started my fast box build
<
stolen>
I reckon 5 minutes on that?
<
Tenkawa>
its already passed the other one
<
stolen>
how did you undestand that? it's all giberish to me, the logs from scons
<
Tenkawa>
I've been doing this type of development since the 90's.. thats how .... It changes daily
<
Tenkawa>
These logs should be their own language
<
stolen>
so you have been on risc V for quite some time then :)
<
Tenkawa>
Yes... I started when the JH7110 first got released
<
Tenkawa>
I have 4 of those now and a Spacemit-K1
<
stolen>
Do you know someone, Bart Stuck? apparently he had organized some seminar at our uni on risc V
<
Tenkawa>
No.. Only people I've met here on irc or Discord
Armand|X13s has joined #riscv
<
Tenkawa>
(and my memory is shot so I might and just not remember lol)
<
stolen>
I see, how do i know that I am progressing or moving towards completion from the logs?
<
Tenkawa>
you just kinda wait and make sure it keeps moving...
<
Tenkawa>
my slow machine bombed with an asdsembly error
<
Tenkawa>
er assembly
<
stolen>
whats the specs on your slow machine?
<
Tenkawa>
(not actually surprised... its got a lot of experimental software)
<
Tenkawa>
stolen: I was using an emulated os inside a risc-v bpi spacemit-k1 machine
<
Tenkawa>
It was missing an assembly call though
<
Tenkawa>
thus the "experimental" nature
<
stolen>
maybe you can try with : scons build/X86/gem5.opt -j <NUMBER OF CPUs ON YOUR PLATFORM> after this to see if this one is faster
<
Tenkawa>
oh I did bump it up :)
<
stolen>
so is the python still hogging resources?
<
Tenkawa>
oh yeah....
<
Tenkawa>
I just used up all 8gb of my v's ram almost instantly with the compiles & it
<
stolen>
I am using all 12 GBs though some of it is for google chrome
<
Tenkawa>
addig swap now
<
stolen>
i think the build time is more like 4-5 hours minimum, for servers maybe 1 hr
<
Armand|X13s>
Needs moar Ryzen.. :P
<
Tenkawa>
Armand|X13s: did you hear about my new one?
<
Armand|X13s>
Narp.
<
Tenkawa>
I got a nice new mini ryzen
<
Armand|X13s>
Sweet. :)
<
Tenkawa>
Yeah my Omen finally fell apart
<
Armand|X13s>
Is Legion Go S ? :D
<
stolen>
are you past the SOPARAM stage?
<
Tenkawa>
stolen: still recovering from hanging it due to ram...
<
Armand|X13s>
I don't actually do any compile myself, but I imagine my 5800x (8c/16t) with 64GB RAM would be pretty good.
<
Tenkawa>
adding stuff to avoid that again
<
Tenkawa>
Armand|X13s: CPU: AMD Ryzen 7 PRO 5850U with Radeon Graphics with 64gb ram
<
Armand|X13s>
Dayum, son.. ^_^
<
Tenkawa>
not huge but hey... whole server fits in my hand
<
Tenkawa>
with 1tb drive
<
Armand|X13s>
Mine doesn't.. It's a Poweredge T410. :P
<
Tenkawa>
its a FreeBSD box atm
<
Armand|X13s>
Never touched BSD myself.
<
Tenkawa>
stolen: ok now its started up again
<
Tenkawa>
oh I see another reason its taking so long
<
stolen>
whats that?
<
Tenkawa>
build mode
<
Tenkawa>
its building in debug
<
stolen>
ooh what should we build it on generally?
<
Tenkawa>
yeah see this is what they said for default:
<
Tenkawa>
This binary is build with most optimizations on (e.g., -O3), but with debug symbols included.
<
Tenkawa>
Built with all optimizations on (including link-time optimizations on supported platforms) and with no debug symbols.
<
Tenkawa>
that is what will make it build faster
<
Tenkawa>
so change it to
Armand|5800x has joined #riscv
<
Tenkawa>
python3 `which scons` build/X86/gem5.fast
<
stolen>
oh thanks, let me try
Armand|X13s has quit [Quit: Leaving]
<
Tenkawa>
I just restarted too
<
Tenkawa>
debug is always a gotcha...
<
Tenkawa>
and it seems to hide itself well sometimes lol
<
Tenkawa>
If you need it.. its not there... if you do.... its missing haahaa
<
Tenkawa>
and and when you don't need it... there it is....
<
stolen>
what does debug do to take so much time dho?
<
Tenkawa>
It reads and does a lot of cross referencing of files/symbols
<
Tenkawa>
Needs to make it where debuggers have reference points to memory addresses and hooks/calls to these when needed
<
Tenkawa>
for more detailed analysis
<
Tenkawa>
That's definitely running faster here and using less memory
rvalles has joined #riscv
<
Tenkawa>
stolen: scons: done building targets.
<
stolen>
wow that was fast!!
<
stolen>
10-15 mins huh?
<
Armand|5800x>
That's what she said...
<
Armand|5800x>
..sorry
<
stolen>
was that on the server?
<
Tenkawa>
ls -ltr build/X86/gem5.fast
<
Tenkawa>
-rwxr-xr-x 1 root root 51737032 Jan 21 15:16 build/X86/gem5.fast
<
stolen>
Haha Armand|5800x we need this humor to keep us sane
<
Tenkawa>
this was a MBP M1
<
Armand|5800x>
stolen, are you attempting to assert that I'm sane??? :P
<
Tenkawa>
running a virtualized Ubuntu VM
<
Tenkawa>
this thing is a behemoth
<
stolen>
what was your parameter for -j option?
<
Tenkawa>
that was a -j12
<
stolen>
haha I am on a -j5 with 4 cores lol
<
Tenkawa>
this machine has 12 cores
<
Tenkawa>
(might be 6 cores 12 threads.. never sure how they do the splits on the Apple machines)
<
stolen>
m1 was a octa core ig
TMM has joined #riscv
<
stolen>
hey if you can, can you bpa.st the logs so that I can know where I am at Tenkawa ?
<
Tenkawa>
stolen: remember it aborted on me so I had to restart
<
Tenkawa>
so my logs are mangled
<
stolen>
just a rough snapshot would do I guess...
<
Tenkawa>
there we go,, btw : Total Number of Cores:10 (8 performance and 2 efficiency)
<
stolen>
aah, that makes sense
<
stolen>
to have -j12
<
Tenkawa>
it could easily do -j15 but I sized the vm too small to add enough swap to accomdate it
<
Tenkawa>
er accomodate
<
stolen>
i think it would run out out threads then
<
stolen>
the processor would have a bottleneck too right?
<
Tenkawa>
arm is extremely efficient
<
Tenkawa>
I think I'm going to try running it again after adjusting my vm here and see something
<
stolen>
I am at x86 kvmcpu, how far do you think I am?
<
Tenkawa>
lol.. I even had a setting on that slowed my vm down
<
Tenkawa>
lets see if turning that off helps
<
stolen>
is all that for cross-compilation then? I'll try on my ubuntu machine then but it's a dual core i3
<
Tenkawa>
yeah... I'm on an arm64 compiling that x86 code
<
stolen>
so I am generating the .fo files now
<
Tenkawa>
btw you can use these to get rid of the first 2 dependency problems
<
Tenkawa>
apt install libcapstone-dev libpng-dev
<
Tenkawa>
haven't found the 3rd one yet
heat has joined #riscv
squelch21 has quit [Ping timeout: 248 seconds]
squelch21 has joined #riscv
BootLayer has joined #riscv
cleger has quit [Ping timeout: 248 seconds]
<
Tenkawa>
cat build_time
<
Tenkawa>
Tue Jan 21 04:50:32 PM UTC 2025
<
Tenkawa>
Tue Jan 21 05:01:18 PM UTC 2025
<
Tenkawa>
thats with -j15
<
stolen>
wow wow wow
<
Armand|5800x>
Noice
balrog has quit [Ping timeout: 252 seconds]
BootLayer_ has joined #riscv
m5zs7k_ has joined #riscv
agraf has quit [Ping timeout: 248 seconds]
nukelet9 has joined #riscv
mpe has quit [Ping timeout: 252 seconds]
mpe_ has joined #riscv
JTL has quit [Ping timeout: 248 seconds]
carefish has quit [Ping timeout: 248 seconds]
cp- has quit [Ping timeout: 272 seconds]
mpe_ is now known as mpe
nukelet has quit [Read error: Connection reset by peer]
nukelet9 is now known as nukelet
BootLayer has quit [Ping timeout: 248 seconds]
s1b1 has quit [Read error: Connection reset by peer]
m5zs7k has quit [Read error: Connection reset by peer]
JRepin has quit [Ping timeout: 252 seconds]
courmisch has quit [Ping timeout: 252 seconds]
JRepinc has joined #riscv
courmisch has joined #riscv
hexdump0815 has quit [Ping timeout: 248 seconds]
gordonDrogon has quit [Ping timeout: 252 seconds]
flatmush has quit [Quit: No Ping reply in 180 seconds.]
flatmush has joined #riscv
gordonDrogon has joined #riscv
hexdump0815 has joined #riscv
balrog has joined #riscv
aredridel has quit [Ping timeout: 265 seconds]
cp- has joined #riscv
carefish has joined #riscv
JTL has joined #riscv
agraf has joined #riscv
psydroid2 has joined #riscv
khem has quit [Quit: WeeChat 4.5.1]
m5zs7k_ is now known as m5zs7k
aredridel has joined #riscv
<
Tenkawa>
Want to see somethig funnier?
<
Tenkawa>
Here's the second run of 2 ccache runs with it
<
Tenkawa>
cat build_time
<
Tenkawa>
Tue Jan 21 05:59:43 PM UTC 2025
<
Tenkawa>
Tue Jan 21 06:00:27 PM UTC 2025
heat has quit [Ping timeout: 246 seconds]
heat has joined #riscv
JRepinc has quit [Quit: Konversation terminated!]
JRepinc has joined #riscv
<
stolen>
wait whats 2 cache?
<
stolen>
how can you optimize it so much on the mac? which software are you using to host the vm dho?
<
Tenkawa>
this isn't a mac thing
<
stolen>
oh i thought you were on the mbp m1
s1b1 has joined #riscv
<
Tenkawa>
but ccache isn't a mac specific thing
balrog has quit [Quit: Bye]
balrog has joined #riscv
KombuchaKip has quit [Read error: Connection reset by peer]
KombuchaKip has joined #riscv
jfsimon1981 has quit [Remote host closed the connection]
JanC has quit [Quit: 'k zien d'r mee weh zi]
JanC has joined #riscv
ilyas has joined #riscv
BootLayer_ has quit [Quit: Leaving]
cleger has joined #riscv
cleger has quit [Quit: Leaving]
JRepinc has quit [Quit: Konversation terminated!]
JRepinc has joined #riscv
naoki has joined #riscv
hexdump0815 has quit [Quit: WeeChat 3.8]
hexdump0815 has joined #riscv
danilogondolfo has quit [Quit: Leaving]
peepsalot has quit [Remote host closed the connection]
peepsalot has joined #riscv
fancer has joined #riscv
JRepinc has quit [Quit: Konversation terminated!]
JRepinc has joined #riscv
ilyas has quit [Ping timeout: 248 seconds]
<
stolen>
hey Tenkawa whats the kvm option for windows?
<
stolen>
I have hyperV but that is what runs WSL and the cross compilation had very poor performance tbh
<
stolen>
I compiled on my ubuntu machine with i3 dual core but used -j15 and it compiled within 3 hours, maybe less
<
Tenkawa>
Not really sure there is one... other than VM solutions like Vmware/Virtualbox etc
<
Tenkawa>
dot use anything above 2x 2.5*cpus
<
stolen>
yep windows is really not good for this stuff then
<
Tenkawa>
especially with cross compiling
<
Tenkawa>
it will drag those cpus down quickly
<
stolen>
I don't think cross compiling would have ever finished, maybe i'll run it tomorrow with j10 then for the quad core
<
stolen>
how can i record the time it takes?
<
Tenkawa>
use date > file ; process ; date >> file
<
stolen>
but thanks a lot for being my partner in the pain today lol
<
Tenkawa>
np at all :)
<
stolen>
well time for me to sleep, goodnight
vagrantc has joined #riscv
fancer has quit [Quit: Konversation terminated!]
Armand|5800x has quit [Ping timeout: 264 seconds]
naoki has quit [Quit: naoki]
naoki has joined #riscv
DragonMaus has joined #riscv
paulk-bis has joined #riscv
paulk has quit [Read error: Connection reset by peer]
stolen has quit [Quit: Connection closed for inactivity]
LainExperiments has joined #riscv
LainExperiments6 has joined #riscv
LainExperiments has quit [Ping timeout: 240 seconds]
heat has quit [Remote host closed the connection]
heat has joined #riscv