cfbolz changed the topic of #pypy to: #pypy PyPy, the flexible snake https://pypy.org | IRC logs: https://quodlibet.duckdns.org/irc/pypy/latest.log.html#irc-end and https://libera.irclog.whitequark.org/pypy | insert pithy quote here
fotis has quit [Ping timeout: 252 seconds]
fotis has joined #pypy
fotis has quit [Ping timeout: 265 seconds]
fotis has joined #pypy
fotis has quit [Ping timeout: 240 seconds]
fotis has joined #pypy
fotis has quit [Ping timeout: 258 seconds]
fotis has joined #pypy
fotis has quit [Ping timeout: 256 seconds]
fotis has joined #pypy
fotis has quit [Ping timeout: 258 seconds]
fotis has joined #pypy
fotis has quit [Ping timeout: 240 seconds]
lritter has joined #pypy
fotis has joined #pypy
greedom has joined #pypy
greedom has quit [Remote host closed the connection]
fotis has quit [Ping timeout: 265 seconds]
fotis has joined #pypy
Atque has joined #pypy
fotis has quit [Ping timeout: 258 seconds]
fotis has joined #pypy
Dejan has joined #pypy
fotis has quit [Ping timeout: 240 seconds]
fotis has joined #pypy
fotis has quit [Ping timeout: 265 seconds]
fotis has joined #pypy
fotis has quit [Ping timeout: 245 seconds]
fotis has joined #pypy
fotis has quit [Ping timeout: 252 seconds]
fotis has joined #pypy
<bbot2> Started: http://buildbot.pypy.org/builders/pypy-c-jit-win-x86-64/builds/331 [mattip: force build, py3.8]
<bbot2> Started: http://buildbot.pypy.org/builders/own-win-x86-64/builds/379 [mattip: force build, py3.8]
<bbot2> Started: http://buildbot.pypy.org/builders/own-linux-x86-64/builds/8785 [mattip: force build, py3.8]
fotis has quit [Ping timeout: 256 seconds]
jryans has quit [Quit: Bridge terminating on SIGTERM]
daubers has quit [Quit: Bridge terminating on SIGTERM]
jryans has joined #pypy
ambv has joined #pypy
daubers has joined #pypy
fotis has joined #pypy
<bbot2> Failure: http://buildbot.pypy.org/builders/own-linux-x86-64/builds/8785 [mattip: force build, py3.8]
fotis has quit [Ping timeout: 240 seconds]
fotis has joined #pypy
fotis has quit [Ping timeout: 276 seconds]
fotis has joined #pypy
fotis has quit [Ping timeout: 245 seconds]
<bbot2> Failure: http://buildbot.pypy.org/builders/pypy-c-jit-win-x86-64/builds/331 [mattip: force build, py3.8]
fotis has joined #pypy
<arigato> can somebody help me with git?
<arigato> pff OK, "git push" can appear to fail with an obscure and unhelpful error message while it actually worked fine
<arigato> so a bare "git pull" only pulls the current branch, while a bare "git push" will try to push all branches and may succeed at some while failing at others
<arigato> Good To Know
mathieu_ has joined #pypy
fotis has quit [Ping timeout: 240 seconds]
fotis has joined #pypy
<mathieu_> @mattip FYI, I did look at the tools directory and found gcanalyze too but it does not do this. It parses logs generated by PYPYLOG=gc-collect:log.
<mathieu_> I have taken time to read the documentation @ https://doc.pypy.org/en/latest/gc_info.html
<mathieu_> n this on a test file (format is a json string per line), the finaly memory usage appears to
<mathieu_> @mattip I checked that tools directory and found gcanalyze.py too but it parses logs generated with PYPYLOG=gc-collect:log
mathieu_ has quit [Client Quit]
mathieu_ has joined #pypy
<mathieu_> crap, sorry for these previous messages. it looks like my irc terminal got garbled
fotis has quit [Ping timeout: 276 seconds]
<bbot2> Failure: http://buildbot.pypy.org/builders/own-win-x86-64/builds/379 [mattip: force build, py3.8]
fotis has joined #pypy
ambv is now known as ambv_
fotis has quit [Ping timeout: 272 seconds]
ambv has joined #pypy
<mathieu_> @mattip FYI, I did spend some time tweaking my testcase and the extra memory allocations appear to be coming from the use of the \u2581 unicode char in re.sub('\s+', '\u2581', s). i.e., re.sub('\s+', ' ', s) does not use extra memory
<mathieu_> so I looked in the sre implementation used in pypy and I see that it appears to have two codepaths, depending on the type of the arguments
<mathieu_> I suspect I need to learn a bit about the pypy3 unicode support
fotis has joined #pypy
<Dejan> mattip, is your _PyDict_GetItemStringWithError merged into py38 ?
<Dejan> i mean, the fix...
mathieu_ has quit [Ping timeout: 268 seconds]
luckydonald has joined #pypy
ambv_ has quit [Quit: Bye]
fotis has quit [Ping timeout: 268 seconds]
fotis has joined #pypy
stkrdknmibalz has quit [Quit: WeeChat 3.0.1]
fotis has quit [Ping timeout: 272 seconds]
<mattip> Dejan: yes
<Dejan> weird, i am having the same error with latest nightly...
Atque has quit [Quit: ...]
fotis has joined #pypy
<mattip> Dejan: yeah, something seems off
<mattip> no, it is fine
<mattip> Dejan: are you using pypy-c-jit-102871-cfd47581da0a-linux64 ?
<Dejan> yep
<Dejan> let me double-check
<mattip> I see the function declared in include/pypy_decl.h
<mattip> _PyDict_GetItemStringWithError - did I misspell something?
<Dejan> _PyDict_GetItemStringWithError yea
<Dejan> Python 3.8.10 (cfd47581da0a, Jul 29 2021, 10:16:09)
<Dejan> ok, i hope it is the cache
<Dejan> maybe pip has cached something
<Dejan> yea... numpy wheel was cached
<Dejan> sorry mattip my bad
<Dejan> it works now
<Dejan> i need to write a tool that deletes all pypy wheels after i install new pypy :)
the_drow has joined #pypy
<mattip> pip install --no-cache-dir ?
<Dejan> i actually do want to freshen all pypy wheels
<Dejan> will --no-cache-dir actually make pip overwrite in the cache?
fotis has quit [Ping timeout: 252 seconds]
fotis has joined #pypy
<mattip> dunno
fotis has quit [Ping timeout: 252 seconds]
mathieu1 has joined #pypy
smarr has joined #pypy
<mathieu1> [for the logs] FYI, I finally found out what was "wrong" with my testcase: I discovered that pypy stores unicode strings as utf-8 in memory, so the total memory usage depends on which exact characters appear and how often they appear and how many bytes each of them needs to be encoded as utf-8. Basically , re.sub('\s+', '\u2581') replaces a bunch of one-byte characters with a 3-byte character so,
<mathieu1> re.sub increases my memory usage and the amount it increases is exactly equal to the number of times the regexp matches times (3-1)...
mathieu1 is now known as mathieu_
<smarr> in RPython, is there an easy way to use `str.replace()` with a unicode character? It's a very basic thing: `name.replace(":", "⫶")` not essential, just cosmetic.
fotis has joined #pypy
<arigato> smarr: yes, that should work, but if everything is unicode ('self' and the two arguments)
lritter has quit [Quit: Leaving]
<arigato> (really unicodes, not utf-8 byte strings---if you're working with utf-8 byte strings then probably str.replace() cannot replace a byte with a multi-bytes character)
<ronan> arigato, smarr: it should also work with str literals (the string will contain the utf8-encoded version), but in both cases you need to set the source file encoding to UTF-8
greedom has joined #pypy
<smarr> thanks. and, right, I had marked the file as UTF-8. Simplest solution seems to be to chose another ASCII character and so I can avoid the issue.
fotis has quit [Ping timeout: 252 seconds]
greedom has quit [Remote host closed the connection]
isidentical has joined #pypy
<bbot2> Started: http://buildbot.pypy.org/builders/pypy-c-jit-linux-x86-64/builds/7786 [Batuhan Taskaya: force build, py3.8]
fotis has joined #pypy
<mattip> I updated the wiki page. We are down to ~400 failing lib-python tests from ~560 a month ago
<cfbolz> mattip: awesome!
<mattip> for comparison, py3.7 has 105
fotis has quit [Ping timeout: 240 seconds]
<cfbolz> mattip: good trajectory. i'll hopefully have more time to work on it "any week now"
<mattip> whoot
<bbot2> Failure: http://buildbot.pypy.org/builders/pypy-c-jit-linux-x86-64/builds/7786 [Batuhan Taskaya: force build, py3.8]
<mattip> correction: py3.7 has 132. Picking a random buildbot run from October 2020, after the first release, we had 560 failures on py3.7
mathieu_ has quit [Ping timeout: 276 seconds]
<mattip> looking at the test times, lib-python/3/test/test_multiprocessing_fork.py has a timeout, so that might be nice to fix to speed things up
<mattip> it seems we never finished vectorcall
<mattip> test_ast.py has the most failures at 26
<cfbolz> mattip: heh
<cfbolz> mattip: test_ast I can definitely do a pass
<mattip> cool
fotis has joined #pypy
<cfbolz> mattip: ah, cool, seems batuhan is looking into a few things too?
<mattip> it seems there is still more there to be merged indeed
<cfbolz> it's marked as draft, but it looks mostly great
<isidentical> yes! I need to rebase it on top of the latest changes
<isidentical> I also plan to tackle a few more
<isidentical> but after that it should be ready
<isidentical> mattip: where do you see the total number of tests that are failing?
<cfbolz> isidentical: you don't *really* need to rebase
<cfbolz> that's a gitism ;-)
<isidentical> cfbolz: haha, true i guess.
<mattip> isidentical: I grep around the stdout of the lib-python tests, which I get to via
<mattip> for instance, and then look at the lib-python step's stdio
<mattip> with examples of useful grep formula
<isidentical> Ah, cool, thanks for these hints!
fotis has quit [Ping timeout: 245 seconds]
fotis has joined #pypy
fotis has quit [Ping timeout: 265 seconds]
fotis has joined #pypy
fotis has quit [Ping timeout: 240 seconds]
ambv_ has joined #pypy
fotis has joined #pypy
ambv_ has quit [Client Quit]
fotis has quit [Ping timeout: 258 seconds]
<bbot2> Started: http://buildbot.pypy.org/builders/pypy-c-jit-linux-x86-64/builds/7787 [Batuhan Taskaya: force build, isidentical-py38-test-fixes]
fotis has joined #pypy
fotis has quit [Ping timeout: 265 seconds]
<bbot2> Failure: http://buildbot.pypy.org/builders/pypy-c-jit-linux-x86-64/builds/7787 [Batuhan Taskaya: force build, isidentical-py38-test-fixes]
fotis has joined #pypy
Julian has joined #pypy
Julian has quit [Client Quit]
fotis has quit [Ping timeout: 245 seconds]
fotis has joined #pypy
fotis has quit [Ping timeout: 258 seconds]
fotis has joined #pypy
fotis has quit [Ping timeout: 272 seconds]
fotis has joined #pypy
fotis has quit [Ping timeout: 258 seconds]
fotis has joined #pypy