lanefu changed the topic of #armbian-rockchip to: Armbian - Linux for ARM development boards | Rockchip SoC | www.armbian.com | This channel is relayed to the equivalent Discord channel | this channel is logged
DC-IRC has quit [Remote host closed the connection]
DC-IRC has joined #armbian-rockchip
<DC-IRC> [Discord] <mecoblock> meanwhile there’s really good ones available on AliExpress with low power consumption for ~60€ and 2 10GbE/SFP+ ports and 5x 2.5GbE
<DC-IRC> [Discord] <narga_64> Yeah this list is nice 👍
<DC-IRC> [Discord] <narga_64> But those chinese devices can be hit and miss really. Especially if they suddenly use other parts than what ServeTheHome reviewed.
<DC-IRC> [Discord] <narga_64> MokerLink 2G08110GS for example, they measured 1.6W idle but someone else measured 2.4W. That's 50% more. Yeah, 2.4W is still not a lot, but this adds up if you have lots of 24/7 devices 😅
<DC-IRC> [Discord] <narga_64> Also, these don't have EEE unfortunately.
<DC-IRC> [Discord] <narga_64> Some math: If you populate all 8 ports, assume you save at least 0.5W per port if EEE is enabled. That's 4W.
<DC-IRC> [Discord] <narga_64> 4W*365*24h = 35kwh
<DC-IRC> [Discord] <narga_64> Now, the following depends a lot on your energy prices. But in Europe you often pay 0.4 or 0.5€ per kwh.
<DC-IRC> [Discord] <narga_64> So let's say you save about 15€ per year if you are all EEE enabled.
<DC-IRC> [Discord] <narga_64> A good 120€ switch will have amortized itself in 4 years.
<DC-IRC> [Discord] <narga_64> Compared to a 60€ switch without EEE.
<DC-IRC> [Discord] <narga_64> That can vary a lot though depending on your circumstances.
<DC-IRC> [Discord] <narga_64> In the end, those chinese switches are still a good deal 👍
<DC-IRC> [Discord] <narga_64> At least if you can actually get them at this price and don't have to pay lots of income taxes and so on 😅
<DC-IRC> [Discord] <mecoblock> AliExpress covers all expenses for orders up to 150€ in Europe
<DC-IRC> [Discord] <amazingfate> Ahh this shit aic8800 driver, usb/pcie/sdio drivers are splitted while sharing the same kernel module name `aic8800_fdrv`.
<DC-IRC> [Discord] <amazingfate> https://github.com/radxa-pkg/aic8800
<DC-IRC> [Discord] <narga_64> That's nice! In this case, these switches would be a great deal.
<DC-IRC> [Discord] <narga_64> If something is not like you expected though, I guess there's no real chance you can just send it back to China. Or can you?
<DC-IRC> [Discord] <mecoblock> Most sellers have „free returns“ to a warehouse from Aliexpress available. Never tried it but it should work
<DC-IRC> [Discord] <mecoblock> @narga_64 also many have EEE but it’s deactivated by default.
<DC-IRC> [Discord] <mecoblock> Does anybody know what the current status is for either DDK g21 on 6.1 BSP or Panthor backport?
<DC-IRC> [Discord] <rpardini> Today I tried; Armbian Jammy CLI image + `vendor` 6.1-rkr1 kernel + Amazingfate's PPA + KDE Neon `testing` repos and got an awesome KDE 6 desktop.
<DC-IRC> [Discord] <efectn> Is kde plasma 6 buggy?
<DC-IRC> [Discord] <efectn> I have 4gigs of updates for my pc. If it's not i will go library to update my Pc 😅
<DC-IRC> [Discord] <rpardini> The `user` repos have some troubles. I moved to `testing` and couldn't find any
<DC-IRC> [Discord] <efectn> Then let me give a chance
<DC-IRC> [Discord] <rpardini> It's... `deb http://archive.neon.kde.org/testing jammy main` and then install `neon-desktop` (and sddm etc)
<DC-IRC> [Discord] <narga_64> Oh, how do you activate it if it's an unmanaged switch?
<DC-IRC> [Discord] <narga_64> I am trying and testing `Bcachefs` today 🤓
<DC-IRC> [Discord] <narga_64> Well, my tests end with "can I move files to and from this formatted partition" ✅
<DC-IRC> [Discord] <narga_64> But I guess the more important tests are, do the kernels compile with `Bcachefs` enabled. Please correct me if I'm wrong.
<DC-IRC> [Discord] <lanefu> I played with it a while back on rk3588 edge.... Wasn't enabled in our config.. I enabled in my own and tinkered, but didn't send a PR.
<DC-IRC> [Discord] <lanefu> Arch wiki had best example for creating tiered bcaches filesystem
<DC-IRC> [Discord] <narga_64> Awesome! Did you run into any problems?
<DC-IRC> [Discord] <narga_64> Bcachefs only came to my attention since @rpardini mentioned that it should/could receive the same treatment as NVMe over TCP. Which is why I'm trying it right now and will compile some kernels with it later, to send a PR if everything goes well. `rockchip64-edge` has it enabled already btw.
<DC-IRC> [Discord] <narga_64> I'm now debating if I should use Bcachfs over BTRFS when I build my NAS. The wiser option would likely be BTRFS, since I only use SSDs anyway and don't need tiered storage.
<DC-IRC> [Discord] <narga_64> Yeah that's what I'm using, too! Arch wiki often has great documentation
<DC-IRC> [Discord] <rpardini> If you're all-flash I don't think bcachefs makes sense, my guess the typical use case is a large spinning rust disk sped up by a small local ssd/nvme
<DC-IRC> [Discord] <narga_64> Yeah probably. I'll probably have to do some more research on its use cases and also its ease of use.
<DC-IRC> [Discord] <narga_64> I'll also try out F2FS for my root partition. Should be nice for eMMC/SD cards, compared to ext4
<DC-IRC> [Discord] <narga_64> My Android phones use F2FS for about 8 years now, so should be good to use.
<DC-IRC> [Discord] <narga_64> On that note, does anyone have insights into file systems kernel config, built-in vs module?
<DC-IRC> [Discord] <narga_64> I'm doing lots of `kernel-config` recently and the Armbian configs for different boards seem to be all over the place 😅
<DC-IRC> [Discord] <narga_64> So I'm wondering what's the better default, have it as module or built-in 🤔
<DC-IRC> [Discord] <lanefu> Counter argument it's still meant to be a 3rd gen filesystem with bit rot protection and intended to replicate data natively across devices
<DC-IRC> [Discord] <lanefu> However it's superpower is tiering without the complexities and rigidity of zfs
<DC-IRC> [Discord] <spooky8086> i have a working aic8800 driver for the 6.1 bsp kernel, i can send a pr later today
<DC-IRC> [Discord] <amazingfate> I just made it work
<DC-IRC> [Discord] <spooky8086> ahh cool
<DC-IRC> [Discord] <amazingfate> Use the one from radxa-pkg
<DC-IRC> [Discord] <spooky8086> Yeah that is what i ended up doing
<DC-IRC> [Discord] <rpardini> Yo gurus @amazingfate @spooky8086 should we (I mean... you :-D) push 6.1-rkr1 to `armbian/linux-rockchip` ? or rebases still going?
<DC-IRC> [Discord] <rpardini> I've stable Armbian builds on 6.1-rkr1 -- no more /dev/loop madness like in 5.10
<DC-IRC> [Discord] <rpardini> so vendor kernel can be used for github runners and such, I'm very happy
<DC-IRC> [Discord] <spooky8086> Yeah, i think that ap6275p bluetooth may be a little weird on 6.1, but overall the kernel is very good
<DC-IRC> [Discord] <rpardini> Oh -- indeed, I've no Wifi on the Mekotronics. (I'd forgot. I don't use it).
<DC-IRC> [Discord] <rpardini> Bluetooth.... (checks)
<DC-IRC> [Discord] <spooky8086> Ohhh i can fix that with a pr to the armbian-firmware repo
<DC-IRC> [Discord] <spooky8086> ap6275p/nvram_ap6275p.txt needs a symlink to ap6275p/nvram_AP6275P.txt
<DC-IRC> [Discord] <efectn> Isn't it specified on kernel config?
<DC-IRC> [Discord] <rpardini> damn ou guys have fixes for literally everything already
<DC-IRC> [Discord] <rpardini> 👍
<DC-IRC> [Discord] <igorpec> https://github.com/armbian/build/pull/6380 KDE neon is coming too 😉
<DC-IRC> [Discord] <spooky8086> It may be, ive been doing so much ive not had a look
<DC-IRC> [Discord] <spooky8086> I dont see it in the kernel config, only the below:
<DC-IRC> [Discord] <spooky8086> ```
<DC-IRC> [Discord] <spooky8086> CONFIG_BCMDHD_FW_PATH="/lib/firmware/ap6275p/fw_bcmdhd.bin"
<DC-IRC> [Discord] <spooky8086> CONFIG_BCMDHD_NVRAM_PATH="/lib/firmware/ap6275p/nvram.txt"
<DC-IRC> [Discord] <spooky8086> ```
<DC-IRC> [Discord] <efectn> it's AP6275P on 5.10 and ap6275p on 6.1. symlink seems good idea
<DC-IRC> [Discord] <spooky8086> Yeah, ill send a pr, writing it up now
<DC-IRC> [Discord] <spooky8086> This should fix it: https://github.com/armbian/firmware/pull/78
<DC-IRC> [Discord] <rpardini> - `vendor` 6.1-rkr1 wins
<DC-IRC> [Discord] <rpardini> - `/dev/loopX`'s work with no crazy 🎉
<DC-IRC> [Discord] <rpardini> - kubevirt 1.2.0 works 🥳
<DC-IRC> [Discord] <lanefu> I might have to swap out googalator for that!
<DC-IRC> [Discord] <spooky8086> The zfs dkms should also work
<DC-IRC> [Discord] <narga_64> Kubevirt is VMs for Kubernetes?
<DC-IRC> [Discord] <rpardini> kubevirt is the upstream for Openshift Virtualization, yes https://kubevirt.io/
<DC-IRC> [Discord] <narga_64> Sounds nice! But I guess it's mostly useful for enterprise. Or do you use it for the homelab?
<DC-IRC> [Discord] <rpardini> full on homelab clusterception
* DC-IRC [Discord] <rpardini> those 32gb 3588's
<DC-IRC> [Discord] <rpardini> kubevirt 1.1.0 already worked with mainline 3588, for those lucky enough to have mainline capable boards
<DC-IRC> [Discord] <rpardini> but 5.10-rkr6 was not up to to par, unclear why, VMs just hanged
<DC-IRC> [Discord] <rpardini> but this 6.1-rkr1 seems to work, still stressing it a bit, but seems good
<DC-IRC> [Discord] <narga_64> Oh I'm interested 🤓 How does Kubevirt integrate in your K8s (?) cluster? Like what use case?
<DC-IRC> [Discord] <rpardini> right now I've k8s on the metal running kubevirt & cluster api & argocd
<DC-IRC> [Discord] <rpardini> then "child" clusters running on VMs on kubevirt
<DC-IRC> [Discord] <narga_64> You own multiple 32G rk3588 boards? Wow! I only know that there is a Turing RK1 with 32G. But I found it way overpriced at 300$ compared to 190$ for 16G.
<DC-IRC> [Discord] <narga_64> Ohhh that's what you meant with clusterception! I understand now
<DC-IRC> [Discord] <rpardini> nah I was just eye'ing them. I've a couple 16gbs still. I think OPi has 32gb's, as well as Mixtile?
<DC-IRC> [Discord] <rpardini> yeah that's been working for a while. today I'm working on the bare-metal provisioning using Tinkerbell -- which runs on k8s as well, so yet another layer in the onion
<DC-IRC> [Discord] <rpardini> so it's a metal management cluster with tinkerbell, provisioning and running a child baremetal capi cluster, running kubevirt, running child clusters on vms
<DC-IRC> [Discord] <rpardini> ok I'll stop now
<DC-IRC> [Discord] <rpardini> so it's a metal management cluster with tinkerbell, provisioning and running a child baremetal capi cluster, running kubevirt, running grandchild clusters on vms
<DC-IRC> [Discord] <lanefu> Im jealous
<DC-IRC> [Discord] <narga_64> Whaaaaat, that sounds like a pretty complex setup 😄 But also cool! I need to read up on what Tinkerbell is. I have only ran a K8s cluster on VMs or on baremetal arm so far. But I'm learning.
<DC-IRC> [Discord] <narga_64> But what do yo do with all those virtualized clusters? Is there stuff that you would not be able to achieve if you ran a cluster baremetal with a few SBCs?
<DC-IRC> [Discord] <narga_64> Or is it mostly for fun and learning purposes?
<DC-IRC> [Discord] <narga_64> Oh no, I just became aware of the existence of the Mixtile Blade 3. I want one now 😂
<DC-IRC> [Discord] <narga_64> But it's 370$ for the 16G version 🥲 I guess I don't want one this badly...
<DC-IRC> [Discord] <rpardini> it's yeah doing stuff the hard way for learning, mostly.
<DC-IRC> [Discord] <rpardini> I do have a "production" cluster, but that's on bare metal sans any inceptions, for now, and just does regular home stuff like jellyfin
<DC-IRC> [Discord] <spooky8086> The Mixtile Blade 3 and Core 3588E are a little depressing with hardware quirks, basically both are locked to the vendor U-Boot
<DC-IRC> [Discord] <rpardini> Heartly agree. The PD stuff, lack of MAC on the 2.5gbit's, etc.
<DC-IRC> [Discord] <narga_64> Ah that's good to know. A few RK1 16G would probably be better in that case, to build a cluster. Or just don't use any compute modules since from what I know the Turing pi 2 is limited to 1G networking.
<DC-IRC> [Discord] <narga_64> Or are there other cluster boards which fit the rk3588?
<DC-IRC> [Discord] <rpardini> Mine are sitting on 140mm 5V Noctuas 😉
<DC-IRC> [Discord] <narga_64> That sounds good 👍
<DC-IRC> [Discord] <narga_64> From just a quick read up on Tinkerbell it seems like it could be useful for my configuration as well. Thanks for making me aware of that! There's just sooo many tools in the cloud/k8s landscape
<DC-IRC> [Discord] <narga_64> What are these?
<DC-IRC> [Discord] <narga_64> I like the tiny screen 😂
<DC-IRC> [Discord] <spooky8086> I made the device tree for the RK1 and have all the hardware revisions, so i know its pretty solid. I know the TPi2 is going to have a new revision but i do not think they will upgrade ethernet to 2.5G
<DC-IRC> [Discord] <rpardini> those are Mixtile Blade 3's. The screens are el-cheapo SSD1306's via I2C. One is directly connected to the other via 2.5gbit, since only have 1gbit switches
<DC-IRC> [Discord] <narga_64> Good work!
<DC-IRC> [Discord] <narga_64> It's a real shame since 1G ethernet is a serious bottleneck for some use cases. Still fine for many other use cases though, otherwise they probably would have used 2.5G
<DC-IRC> [Discord] <narga_64> Or it's simply difficult to implement.
<DC-IRC> [Discord] <narga_64> How can they talk to each other without a switch or router in between? Does it "just work" or did you need any specific config or crossover cable?
<DC-IRC> [Discord] <rpardini> it's just a cable.
<DC-IRC> [Discord] <rpardini> each blade has 2 interfaces, one with the real (switched) network and one with the other blade.
<DC-IRC> [Discord] <rpardini> the network between the blades is a /30, and each machine has a route to reach the other one's real switched IP over the cable
<DC-IRC> [Discord] <narga_64> Those SSD1306 screens really are cheap, I need to get one as well 😄 If I can figure out a use for it lol
<DC-IRC> [Discord] <rpardini> so it's transparent
<DC-IRC> [Discord] <rpardini> mine are running https://github.com/rpardini/sys-oled-hc4 -- RIP Kobol
<DC-IRC> [Discord] <amazingfate> After I push the aic8800 driver and rk3528 related, I will send a pr to armbian/linux-rockchip.
<DC-IRC> [Discord] <spooky8086> FYI the legend boogie started to backport Panthor
<DC-IRC> [Discord] <rpardini> oh wow so that would work with mainline mesa?