azonenberg changed the topic of #scopehal to: libscopehal, libscopeprotocols, and glscopeclient development and testing | https://github.com/glscopeclient/scopehal-apps | Logs: https://libera.irclog.whitequark.org/scopehal
<_whitenotifier-7> [scopehal] azonenberg pushed 1 commit to master [+0/-0/±4] https://github.com/glscopeclient/scopehal/compare/bb8aabaf61fa...0347ab75a7a4
<_whitenotifier-7> [scopehal] azonenberg 0347ab7 - SiglentVectorSignalGenerator: added LFO support
<_whitenotifier-7> [scopehal-apps] azonenberg pushed 1 commit to master [+0/-0/±7] https://github.com/glscopeclient/scopehal-apps/compare/a08b543810b4...c09e696aa200
<_whitenotifier-7> [scopehal-apps] azonenberg c09e696 - Continued work on scope window management. Added support for HasFunctionImpedaceControls() etc in FunctionGeneratorDialog.
<d1b2> <DriftingPancake> is there any decent way around having to manually copy in the vulkan SDK building scopehal from source? This seems likely to become a maintenance headache later
<d1b2> <azonenberg> Siglent SSG driver now supports the low frequency oscillator, via the usual function generator input
<d1b2> <azonenberg> LunarG has binary SDK packages in .deb format for recent Ubuntu, which also install fine on Debian in my experience
<d1b2> <azonenberg> That's what I use on my dev workstation (debian bullseye)
<d1b2> <DriftingPancake> ...ah. I don't really have any debian or derivatives installed; guess I'll see if AUR has something or just make a script to update it
<d1b2> <azonenberg> The good news is that we do not depend on any ultra recent stuff. We should run down to vulkan 1.0, and use a few features of 1.2 if available (specifically, byte-addressable storage buffers in shaders)
<d1b2> <azonenberg> so you should be able to just plop down one SDK version and not touch it for years
<d1b2> <DriftingPancake> fair enough
<d1b2> <azonenberg> And most of our other dependencies are pulled in as submodules or available in distro packages
<d1b2> <azonenberg> the only one i know that doesn't fit in either category, besides the SDK, is FFTS. Which we are planning to move away from in favor of vkFFT
<d1b2> <azonenberg> We already removed all clFFT calls with vkFFT, but have not yet fully transitioned away from FFTS
<d1b2> <DriftingPancake> hmm ok
<d1b2> <DriftingPancake> ffts I don't super mind since that at least goes through git
<d1b2> <DriftingPancake> Thank you for the info!
Degi_ has joined #scopehal
<d1b2> <azonenberg> So we care about FFTS because it's basically EOL, it's slow, and it seems to segfault on arm64
Degi has quit [Ping timeout: 264 seconds]
Degi_ is now known as Degi
<d1b2> <azonenberg> last commit was in 2017, it's unmaintained
<d1b2> <azonenberg> But there is a general lack of non-GPL FFT libraries out there
<azonenberg> Also, I know it's been dark on the probe front for a while. I've been busy w / ngscopeclient/glscopeclient work for a while, as well as waiting to hear back from Vishay WRT the components we RMA'd
<azonenberg> They did their own investigation and confirmed the failure conditions we observed
<d1b2> <DriftingPancake> ahh :\
<azonenberg> So with any luck it won't happen again. They sent us a full FA report with root cause analysis but it's marked confidential so i'm not sharing in the main channel
<azonenberg> But we will be assessing their response and deciding if we think the issues have been solved to our satisfaction before ordering production quantities of the parts
<d1b2> <DriftingPancake> >Warning: Socket read failed (errno=11, Resource temporarily unavailable)
<d1b2> <DriftingPancake> Trying to capture off the SDS2104X+; seem to get this after a few waveforms each open of the client
<azonenberg> That's a read timeout
<d1b2> <DriftingPancake> >Warning: Bad IDN response as well
<azonenberg> means the driver sent a command and the scope didn't reply
<azonenberg> if you run glscopeclient with --debug --trace SCPISocketTransport you will get a full log of every command sent and received
<d1b2> <DriftingPancake> Seems the scope can't deal with sending back long captures on 4 channels at 10M memory depth
<d1b2> <DriftingPancake> alright
<azonenberg> pipe that to a file and see if it sheds any light on the problem
<azonenberg> (it doesn't log raw binary waveform data transfers though)
<azonenberg> it is possible that sending a large capture takes enough time it triggers some kind of timeout
<azonenberg> the fix might be as simple as increasing the timeout
<azonenberg> But their firmware is slow in general
<azonenberg> they're nice scopes for entry level users, just not the best communications bandwidth
<d1b2> <DriftingPancake> fair enough, maybe I'm simply asking a bit much of it
<azonenberg> it is also possible our driver has a bug w/ large waveforms
<azonenberg> they're slow enough idk how well tested multi megapoint captures on the 2000x+ are
<d1b2> <DriftingPancake> Seems like you should still be able to make single-run work though, no matter what. I will try to figure out if I can
<azonenberg> Yes. It's possible the read is simply timing out
<azonenberg> as a quick hack, patch the SetRxTimeout() call in SCPISocketTransport::SharedCtorInit() (line 81) to a larger number
<azonenberg> it looks like we wait 5 sec for a reply from the instrument and give up if none comes
<azonenberg> (when this happens, if a reply comes in the future, the instrument may desync with the driver)
<d1b2> <DriftingPancake> Ok, need to get a capture with a USB and play with it for the actual reason I needed it first, but after a bit of that I'll try all these things and get you a more complete picture of what's happening
<azonenberg> Great. also ping @mubes who wrote most of the siglent driver, he's likely a good resource for issues on it
<azonenberg> (Longer term, i'll probably make the timeout adjustable in preferences)
<_whitenotifier-7> [scopehal-apps] bvernoux synchronize pull request #494: Fix for GitHub Windows CI Build issue step "Test" and step "Build MSI / portable zip" - https://github.com/glscopeclient/scopehal-apps/pull/494
<_whitenotifier-7> [scopehal-apps] bvernoux edited issue #495: GitHub Windows CI Build issue step "Test" and step "Build MSI / portable zip" - https://github.com/glscopeclient/scopehal-apps/issues/495
<d1b2> <DriftingPancake> [this may take into tomorrow, but I will get back with the info]
<d1b2> <mubes> Still here, just pretty much incognito as ORBTrace is taking up all my available hacking time for now 😕
bvernoux has joined #scopehal
<_whitenotifier-7> [scopehal-apps] bvernoux edited pull request #494: Fix for GitHub Windows CI Build issue step "Test" and step "Build MSI / portable zip" - https://github.com/glscopeclient/scopehal-apps/pull/494
<_whitenotifier-7> [scopehal-apps] bvernoux edited pull request #494: Fix for GitHub Windows CI Build issue step "Test" and step "Build MSI / portable zip" - https://github.com/glscopeclient/scopehal-apps/pull/494
<_whitenotifier-7> [scopehal-apps] bvernoux commented on issue #495: GitHub Windows CI Build issue step "Test" and step "Build MSI / portable zip" - https://github.com/glscopeclient/scopehal-apps/issues/495#issuecomment-1249100773
<_whitenotifier-7> [scopehal-apps] bvernoux closed issue #495: GitHub Windows CI Build issue step "Test" and step "Build MSI / portable zip" - https://github.com/glscopeclient/scopehal-apps/issues/495
<_whitenotifier-7> [scopehal-apps] bvernoux synchronize pull request #494: Fix for GitHub Windows CI Build issue step "Test" and step "Build MSI / portable zip" - https://github.com/glscopeclient/scopehal-apps/pull/494
nelgau_ has joined #scopehal
nelgau has quit [Ping timeout: 264 seconds]
bvernoux1 has joined #scopehal
bvernoux has quit [Ping timeout: 250 seconds]
bvernoux1 has quit [Quit: Leaving]
bvernoux has joined #scopehal
<_whitenotifier-7> [scopehal-apps] bvernoux edited pull request #494: Fix for GitHub Windows CI Build issue step "Test" and step "Build MSI / portable zip" - https://github.com/glscopeclient/scopehal-apps/pull/494
<_whitenotifier-7> [scopehal-apps] bvernoux synchronize pull request #494: Fix for GitHub Windows CI Build issue step "Test" and step "Build MSI / portable zip" - https://github.com/glscopeclient/scopehal-apps/pull/494
<_whitenotifier-7> [scopehal-apps] bvernoux edited pull request #494: Fix for GitHub Windows CI Build issue step "Test" and step "Build MSI / portable zip" - https://github.com/glscopeclient/scopehal-apps/pull/494
massi has joined #scopehal
<_whitenotifier-7> [scopehal-apps] azonenberg closed pull request #494: Fix for GitHub Windows CI Build issue step "Test" and step "Build MSI / portable zip" - https://github.com/glscopeclient/scopehal-apps/pull/494
<_whitenotifier-7> [scopehal-apps] azonenberg pushed 10 commits to master [+13/-0/±38] https://github.com/glscopeclient/scopehal-apps/compare/c09e696aa200...b3a7da58ca33
<_whitenotifier-7> [scopehal-apps] bvernoux cc055ce - Temporary Disable test as GitHub Windows CI Build fail to run the exe
<_whitenotifier-7> [scopehal-apps] bvernoux 7dee5c9 - Merge branch 'glscopeclient:master' into master
<_whitenotifier-7> [scopehal-apps] bvernoux 615be38 - Merge branch 'glscopeclient:master' into master
<_whitenotifier-7> [scopehal-apps] ... and 7 more commits.
<_whitenotifier-7> [scopehal-apps] azonenberg pushed 1 commit to master [+0/-0/±1] https://github.com/glscopeclient/scopehal-apps/compare/b3a7da58ca33...de04fb4921e3
<_whitenotifier-7> [scopehal-apps] azonenberg de04fb4 - Newly added waveform groups will split windows and dock as needed
<_whitenotifier-7> [scopehal-apps] azonenberg pushed 2 commits to master [+0/-0/±8] https://github.com/glscopeclient/scopehal-apps/compare/de04fb4921e3...48a7b3dc2d22
<_whitenotifier-7> [scopehal-apps] azonenberg 1517254 - Can now drag waveform handles to middle of another area to add to that plot
<_whitenotifier-7> [scopehal-apps] azonenberg 48a7b3d - Implemented waveform group splitting
<d1b2> <azonenberg> multiple waveform areas with splitting when you drag to the edge of an area
<d1b2> <azonenberg> integrates nicely with the other docking stuff
<azonenberg> there's still an issue where we do not handle the case of dragging a waveform into a floating (not docked) window that does not have any splits in it
<azonenberg> So i'll work on that when i get a chance
<bvernoux> ha interesting
<bvernoux> the console is a must have also
<bvernoux> for future we could even use it to launch some script or anything fun ;)
<azonenberg> So the console is specifically a SCPI shell on a specific instrument
<azonenberg> it's meant for sending commands a driver doesn't implement during dev/testing
<azonenberg> and the log viewer is just a mirror of stdout
<bvernoux> yes but for Oscilloscope it could be used for other stuff
<bvernoux> the log viewer is clearly a must have
<azonenberg> i'm not opposed to adding some kind of scripting interface etc in the future
<azonenberg> but that's not what this is
<bvernoux> as it is boring to check in windows or linux console with the GUI in an other place
<bvernoux> and also the linux or windows cmd console are ultra slow and slow down everything when you have some traces in realtime I think the ImGui console is 100000x faster ;)
<azonenberg> anyway, still a lot more to be done. like, you know, actually drawing waveform content :p
<bvernoux> yes real waveform ;)
<bvernoux> do you have tested HDPI too ?
<bvernoux> as ImGui have some hint to manage it easily which was impossible with GTK IIRC
<azonenberg> Someone said they played with it. I expect there will be bugs
<azonenberg> i also have not tried changing font sizes etc yet (as there's no preference dialog in ngscopeclient yet)
<azonenberg> the preference system exists but is not used for much
<azonenberg> Yet
<bvernoux> yes preference stuff from glscopeclient shall be rewritten
<bvernoux> anyway in ImGui it is very simple and you do not need tons of line of code
<bvernoux> also ImGui UI could be improved later
<bvernoux> as it can be customized without changing any code of the UI of course
<bvernoux> a bit like applying skin
<bvernoux> But in a smarter way ;)
<bvernoux> as skin often add overhead with "bitmap"
massi has quit [Remote host closed the connection]
<azonenberg> So we will be adding an imgui dialog for the existing preference system
<azonenberg> then probably adding some new preferences for themeing specifically of imgui
<azonenberg> But that is not the highest priority right now
<bvernoux> An other example of ImGui used in SatDump => https://github.com/altillimity/SatDump
<bvernoux> Yes themeing is the cherry on the cake ;)
<azonenberg> anyway at this point my goal is to get waveform rendering up and running as quickly as possible
<azonenberg> then probably filter graph operations, then worry about saving sessions
<azonenberg> I think it's going to move fast
<bvernoux> About ImGui Theme see https://github.com/ocornut/imgui/issues/707
<bvernoux> We can have very nice UI ;)
<bvernoux> yes rendering waveform will be very nice
<bvernoux> Do you have feedback about the vulkan rendering ?
<azonenberg> lain is starting work on it today
<azonenberg> had some delays
<bvernoux> ha ok
<lain> :3
<_whitenotifier-7> [scopehal-apps] azonenberg pushed 1 commit to master [+0/-0/±3] https://github.com/glscopeclient/scopehal-apps/compare/48a7b3dc2d22...55f1df255bee
<_whitenotifier-7> [scopehal-apps] azonenberg 55f1df2 - Initial skeleton of timeline. Blocked out space but just draw a gradient there for now.
<azonenberg> lain, johnsel, louis: any suggestions on a good image library for loading PNGs (and possibly other formats) for toolbar icons etc? things to go with / avoid?
<azonenberg> i've used FreeImage years ago and am inclined to go with that again
<azonenberg> vs raw libpng, since it's format agnostic
<azonenberg> (it calls out to libpng, libjpeg, etc under the hood iirc, but provides a format abstraction layer)
<lain> I've used libpng in the past without complaints, but I don't have enough experience there to have a preference
<azonenberg> yeah my question is more, do we use raw format libs or something higher level
<azonenberg> given that we might be working with other image formats in the future too
<azonenberg> on the other hand, how likely is that? all of our toolbar icons, color ramps, etc are simple lossless images so it might make sense to just have all external image resources be PNG and not support anything else
<azonenberg> (I also plan to switch color ramps to an image format rather than raw rgba8 pixels like we have now, to improve maintainability)
<electronic_eel> won't the gui icons be in some vector format instead of pixel based stuff? otherwise scaling is difficult
<azonenberg> electronic_eel: i'm not going to attempt to render SVG in the app live
<azonenberg> Some source files may be SVG, sure, but they'll be pre-rendered ti images at fixed sizes and we'll load the correct one for the GUI scale
<azonenberg> but especially at small sizes like 16x16 it's common to do individual pixel tweaks to images to make them work better
<electronic_eel> isn't svg rendering what the gui toolkits do by default nowadays?
<azonenberg> No
<azonenberg> generally you start with a svg, render to bitmaps at a range of sizes, then hand tweak the bitmaps to give nice clean lines and such
<azonenberg> you might add more detail at a larger pixel scale that is best to completely remove vs trying to antialias when small
<azonenberg> the windows .ico format for example is not a vector format
<azonenberg> although it may be based on renderings of vectors way up the chain
<azonenberg> but it's actually just a list of botmaps
<azonenberg> bitmaps*
<electronic_eel> i don't mean windows .ico. i mean things like current gnome or kde
<azonenberg> look in /usr/share/icons/$theme/
<azonenberg> you'll see directories for bitmaps at 8x8, 16x16, 22x22, 24x24, 32x32, 48x48, 64x64, 96x96, 256x256, 512x512, and svg versions
<azonenberg> afaik almost everything uses the bitmaps
<electronic_eel> i had the impression the prerendered images were just for "classic" window managers / desktop environments while the more modern ones do live rendering
<azonenberg> AFAIK at small sizes you still want to use prerendered bitmaps
<azonenberg> its a similar problem to font rendering
<azonenberg> unless you have extreme levels of hinting at small sizes, you get artifacts where things dont line up exactly with pixel boundaries etc
<azonenberg> it's often eaiser to just manually pixel-art like 8 bit game assets
<azonenberg> and then switch to a scalable version for bigger stuff
<d1b2> <Mughees> Can I get access to the project: git push -u origin burstwidthmeasurmentfilter Username for 'https://github.com': MugheesChohan Password for 'https://MugheesChohan@github.com': remote: Permission to glscopeclient/scopehal.git denied to MugheesChohan. fatal: unable to access 'https://github.com/glscopeclient/scopehal.git/': The requested URL returned error: 403
<azonenberg> mughees: Generally we have folks start out developing in a local fork and send pull requests for changes
<electronic_eel> isn't this the https vs. ssh submodule issue?
<azonenberg> and then you get direct push access after a period of steady contributions that don't need extensive rework etc
<azonenberg> electronic_eel: no he's trying to push to the upstream repo
<azonenberg> not his own fork
<azonenberg> and he's a brand new team member who doesn't yet have commit access
<electronic_eel> yeah, but doesn't that happen when you just fork the main repo and recurse submodules?
<azonenberg> the URL in the error message is pointing to the upstream repo
<azonenberg> if you fork the main repo and not the submoudules you'll get errors where the relative paths point to nonexistent forks under your account
<azonenberg> to me this looks like github access controls working as designed and intended
<electronic_eel> yeah, right
<d1b2> <Mughees> hmmm. i am not a very super git user....
<d1b2> <Mughees> i cloned the scopehal repo directly ..then branched locally..made my changes and then i am trying to push upstream
<azonenberg> @louis: can you give Mughees a hand setting up local forks he can push to?
<azonenberg> Mughees: you'll need to make a fork of the upstream repo under your github account
<azonenberg> push your changes there, then send a pull request to the upstream repo that a core developer can merge after code review
<d1b2> <Mughees> hmmm....right..i think i get it now
<azonenberg> We don't hand out push access to the main repo like candy, you have to earn it :)
<d1b2> <Mughees> 🙂
<d1b2> <Mughees> Sorry...The disadvantages of years of closed source development
<d1b2> <Mughees> i wasn't aware of this flow
<azonenberg> Yeah. We do give more experienced devs direct access to the upstream repo to skip that step, but it takes time to earn that level of trust
<_whitenotifier-7> [scopehal] MugheesChohan forked the repository - https://github.com/MugheesChohan
<azonenberg> And yeah i think github enterprise accounts have more fancy access controls
<azonenberg> like allowing specific accounts to push to some branches but not others
<azonenberg> But the project is on a free account that i dont think has nearly as fine grained controls
<azonenberg> that is definitely the kind of thing to look into as the project grows though
<d1b2> <ehntoo> The pull request workflow isn't all that onerous once you get used to it, either. Definitely a little tricky to pick up on the first time through.
<azonenberg> ehntoo: yeah the bigger issue is that if you change origin for your local working copy to your personal fork
<azonenberg> the relative paths in the submodules mean you now have to fork and maintain sync to all of the submodules
<azonenberg> but the alternative is to put absolute paths in .gitmodules which has its own can of worms
<azonenberg> this is one thing i wish git handled better
<azonenberg> If your personal fork is a push-only sandbox for PRs and you never pull from it, and you still have origin set to upstream, it's a non issue
<d1b2> <ehntoo> Yeah, that part isn't so great.
<d1b2> <Mughees> And yeah I have been using SVN for a long time too 😁
<_whitenotifier-7> [scopehal] MugheesChohan opened pull request #689: Adding burst width measurement filter - https://github.com/glscopeclient/scopehal/pull/689
<azonenberg> Great. I'll have a look at that in a bit
<d1b2> <Mughees> oh so here it appears...yayyy..i hope this is right flow now..
<azonenberg> And yes, we have a bot logging issues, pull requests, etc to the developer chat. Handy for staying on top of status
<d1b2> <Mughees> And since this is my first PR... I want everyone to be absolutely lethal....
<azonenberg> mughees: Before I even look at your code, my first feedback is that it needs to be documented. So please add a page to the user manual (under scopehal-docs) describing this filter
<azonenberg> and send a companion PR for the documentation
<d1b2> <Mughees> the .tex documenrts right?
<azonenberg> We already have about 90 filters that have next to no documentation, and I don't want to make the problem worse. So as a general policy any contributions of new filters must be paired with a PR against the documentation
<azonenberg> Yes
<d1b2> <Mughees> Sure
<azonenberg> I'm in the middle of some stuff and it might be a few hours before I get around to reviewing the code. Will let you know if there's any issues that need fixing before it gets merged
<_whitenotifier-7> [scopehal] MugheesChohan commented on pull request #689: Adding burst width measurement filter - https://github.com/glscopeclient/scopehal/pull/689#issuecomment-1249801522
<d1b2> <Mughees> Well, take your time....
<d1b2> <Mughees> no hurries from my side 🙂
<_whitenotifier-7> [scopehal] MugheesChohan synchronize pull request #689: Adding burst width measurement filter - https://github.com/glscopeclient/scopehal/pull/689
bvernoux has quit [Read error: Connection reset by peer]
<azonenberg> Significant performance regression (OOM or more) in the i2c decode, possibly others, due to the new waveform data model. more precisely due to the code refactoring to handle sparse vs dense input being done lazily
<azonenberg> investigating now, i have idea on solutions
<azonenberg> actually maybe it's just an infinite loop
<azonenberg> ok yeah its just an infinite loop lol
<_whitenotifier-7> [scopehal] azonenberg pushed 1 commit to master [+0/-0/±1] https://github.com/glscopeclient/scopehal/compare/0347ab75a7a4...bc4b8cea2ad0
<_whitenotifier-7> [scopehal] azonenberg bc4b8ce - I2CDecoder: fixed hang
<azonenberg> that said it can still be optimized. but it's not the showstopper i thought it was
<_whitenotifier-7> [scopehal] azonenberg pushed 1 commit to master [+0/-0/±1] https://github.com/glscopeclient/scopehal/compare/bc4b8cea2ad0...e405ca385571
<_whitenotifier-7> [scopehal] azonenberg e405ca3 - I2CDecoder: significant (~4x) performance improvements by using template function for inner loop
<azonenberg> ok maybe it's not quite 4x, i misread the profiler results. it's more like 2x
<azonenberg> but still it's a lot faster
<_whitenotifier-7> [scopehal-apps] azonenberg pushed 1 commit to master [+0/-0/±1] https://github.com/glscopeclient/scopehal-apps/compare/55f1df255bee...0fb301153bd9
<_whitenotifier-7> [scopehal-apps] azonenberg 0fb3011 - Updated submodules