[python-updates] 2025-01-19: major updates

[mweinelt]

This is a bulk update run on the python package set.

• Jobset: https://hydra.lossy.network/jobset/nixpkgs/python-updates
• Eval reports: https://shells.darmstadt.ccc.de/~hexa/636.html

Questions? Join #python:nixos.org on Matrix.

Known issues

• oslo-utils will be fixed via qemu-utils: enable crypto support #376394
• pygit2 will be fixed via libgit2: 1.8.4 -> 1.9.0 (also pygit2 update) #373096

[mweinelt]

https://shells.darmstadt.ccc.de/~hexa/586.html

[mweinelt]

https://shells.darmstadt.ccc.de/~hexa/589.html

[mweinelt]

https://shells.darmstadt.ccc.de/~hexa/593.html

[mweinelt]

https://shells.darmstadt.ccc.de/~hexa/594.html

[mweinelt]

https://shells.darmstadt.ccc.de/~hexa/599.html

[imincik]

@mweinelt , see #375859 .

[mweinelt]

Did a rebase on staging to get postgresql to build and uncover the hidden build failures behind it.

Also dropped all bumps for which there were reverts and ordered package inits in front of the package that required packaging them.

[mweinelt]

https://shells.darmstadt.ccc.de/~hexa/605.html

[mweinelt]

https://shells.darmstadt.ccc.de/~hexa/610.html

[SuperSandro2000]

When #376394 is merged, drop the oslo-utils test ignore from this PR

[mweinelt]

I never pushed it.

[trofi]

Bisect says 5ec79bb python313Packages.autobahn: fix broken tests broke the python3Packages.autobahn.optional-dependencies.all evaluation on staging-next as:

$ nix eval --impure --json --expr 'with import ./. {}; python3Packages.autobahn.optional-dependencies.all'
error:
       … while evaluating the attribute 'autobahn.optional-dependencies.all'
         at pkgs/development/python-modules/autobahn/default.nix:86:5:
           85|   optional-dependencies = lib.fix (self: {
           86|     all =
             |     ^
           87|       with self;

       … while evaluating one of the elements to concatenate
         at pkgs/development/python-modules/autobahn/default.nix:88:88:
           87|       with self;
           88|       accelerate ++ compress ++ encryption ++ nvx ++ serialization ++ scram ++ twisted ++ ui;
             |                                                                                        ^
           89|     accelerate = [

       error: expected a list but found a set: { type = "derivation"; LANG = «thunk»; __ignoreNulls = true; __structuredAttrs = false; all = «thunk»; args = «thunk»; buildInputs = «thunk»; builder = «thunk»; cmakeFlags = «thunk»; configureFlags = «thunk»; «49 attributes elided» }

For comparison on master it works as:

$ nix eval --impure --json --expr 'with import ./. {}; python3Packages.autobahn.optional-dependencies.all'
["/nix/store/z0fqjcb3y371gcz2pbvdgjm9j1yfyp4g-python3.12-python-snappy-0.7.3","/nix/store/jb90gdnbiy40dms4dr3aparzdnnx2f86-python3.12-pynacl-1.5.0","/nix/store/ip7rnsssajap2h1xdil0yqkkj1vy5dx9-python3.12-pyopenssl-24.3.0","/nix/store/65l1gxn2lakp65p3x8qi1zmvg79xvzlg-python3.12-qrcode-8.0","/nix/store/abygdanzjx90xq2rzz8xjb7rp3z8np90-python3.12-service-identity-24.2.0","/nix/store/4yj8py190djp65q68zvp6ngqd71wr64c-python3.12-cffi-1.17.1","/nix/store/bn9d0cyg4nxda8x3spjyha846hb7pbpl-python3.12-cbor2-5.6.5","/nix/store/2mwcrbcbgk54y07m9zl5yp434yalgm6w-python3.12-flatbuffers-24.12.23","/nix/store/gs4i6llxz8mxwsh2bg2i1yqf6hskrgsj-python3.12-msgpack-1.1.0","/nix/store/ivj32q6gwf5nb9j4493qwiar271f26a5-python3.12-ujson-5.10.0","/nix/store/q91p9ai87dmwdlr6zz7gy4f551ya4zk3-python3.12-py-ubjson-0.16.1","/nix/store/g9g0h16g0vkkg0yf19ahsi0nj62brfjh-python3.12-argon2-cffi-23.1.0","/nix/store/4yj8py190djp65q68zvp6ngqd71wr64c-python3.12-cffi-1.17.1","/nix/store/kzsn3xl4lnkh8kc9bzr89b1fr8mqk3dy-python3.12-passlib-1.7.4","/nix/store/x3hp0a4yqspha3qxp396a7im4rz8q5l8-python3.12-attrs-24.2.0","/nix/store/0mmm1qg66d0gv4flhdd7hwin8by7im6x-python3.12-twisted-24.11.0","/nix/store/m1bhs0z4dbr05yx69h8q073icpznd8wz-python3.12-zope.interface-6.4.post2","/nix/store/visgbsss0q5g7c5l5szqy3d3gg48vwr8-python3.12-pygobject-3.50.0"]

[mweinelt]

Fixed in 63d8d3c

[kalekseev]

@mweinelt can we somehow exclude playwright from such updates a0cce8a? The lib depends on a specific driver version and must be updated using included update.sh. PR with such update #358638

[drupol]

I tried to update open-webui to version 0.5.10 and noticed a few issues:

• langfuse (missing requests dep, fix in open-webui: 0.5.9 -> 0.5.10 #379779)
• duckduckgo-search (relax primp dep)
• pymilvius (missing milvius-lite dep, milvius-lite is missing in nixpkgs)
• qdrant-client (missing portalocker dep, fix in open-webui: 0.5.9 -> 0.5.10 #379779)
• youtube-transcript-api (change build system, missing defusedxml dep, fix in open-webui: 0.5.9 -> 0.5.10 #379779)

There might be some more, but I don't have the energy at the moment to fix all of them.

[mweinelt]

@mweinelt can we somehow exclude playwright from such updates a0cce8a? The lib depends on a specific driver version and must be updated using included update.sh. PR with such update #358638

If a package is fragile and often breaks during these bulks updates, it may be reasonable to set passthru.skipBulkUpdate = true in the derivation. This decision should not be made on a whim and should always be supported by a qualifying comment.

https://github.com/NixOS/nixpkgs/blob/master/doc/languages-frameworks/python.section.md#updating-packages-in-bulk-python-package-bulk-updates

[trofi]

On master python3Packages.androguard fails as:

$ nix build --no-link -f. -L python3Packages.androguard
...
python3.12-androguard> applying patch /nix/store/0ihd8gmffhv6ppx0nv8hzfcrsp1d6dyg-drop-removed-networkx-formats.patch
python3.12-androguard> patching file androguard/cli/main.py
python3.12-androguard> Hunk #1 FAILED at 110.
python3.12-androguard> 1 out of 1 hunk FAILED -- saving rejects to file androguard/cli/main.py.rej

I suspect it's after 47c6362 python3Packages.androguard: 3.4.0a1 -> 4.1.2 (bisect fails early on other intermediate python package failures, thus have to guess).

[linsui]

New androguard requires a broken dep. androguard/androguard#1068

[trofi]

Bisect says 311264f python3Packages.cstruct: 5.3 -> 6.0 broke jefferson (a diffoscope dependency) on master as:

$ nix build --no-link -f. jefferson -L
...
jefferson> Checking runtime dependencies for jefferson-0.4.5-py3-none-any.whl
jefferson>   - cstruct<6.0,>=5.2 not satisfied by version 6.0

[sikmir]

h3 is broken after update (#380382).

[happysalada]

@drawbu it looks like duckduckgo-search is broken on a mismatch of primp package. If you have time of course.

[Sigmanificient]

This breaks fava too, #380197

[arjan-s]

This breaks XWayland support in Qtile. We were already tracking the problem in #371737 and qtile/qtile#5101 and this PR just blindly updated Qtile without looking at it.
Can we revert the qtile and qtile-extras updates done by this PR?