Unable to downgrade in an environment after installing arrow-14
#1223
Comments
|
This should work out of the box, and not need specific support. Could you please try again with the newest mamba and see if the issue persists? I understand that it's annoying to run into such corner cases - in the meantime, the workaround is to recreate the environment with arrow 13. |
|
It's same issue with latest |
|
Noticing conflicts with Would it make sense to add metapackages to Arrow 13 matching those created in Arrow 14? They could just depend on Arrow 13's |
Yeah, this is the likely cause. Mamba pins current packages in the environment and is then unable to remove the
TBH I'm against that, because one could make the same argument about downgrading to arrow 12 or 11 (still maintained too), and I'd like to not muddy the waters here.
IMO this is a bug in mamba that we should get fixed. |
|
Is it an issue in Mamba or libsolv? Is there an existing issue open? |
|
@galipremsagar @jakirkham |
Moving across arrow versions in a conda environment seems to be not possible after we install
arrow=14packages, is there a plan to support this downgrade in future?(base) pgali@abc:/nvme/0/pgali/cudf$ mamba create --prefix /nvme/0/pgali/envs/cudfdevtst-arrow-14-13 -c conda-forge libarrow=14 pyarrow=14 __ __ __ __ / \ / \ / \ / \ / \/ \/ \/ \ ███████████████/ /██/ /██/ /██/ /████████████████████████ / / \ / \ / \ / \ \____ / / \_/ \_/ \_/ \ o \__, / _/ \_____/ ` |/ ███╗ ███╗ █████╗ ███╗ ███╗██████╗ █████╗ ████╗ ████║██╔══██╗████╗ ████║██╔══██╗██╔══██╗ ██╔████╔██║███████║██╔████╔██║██████╔╝███████║ ██║╚██╔╝██║██╔══██║██║╚██╔╝██║██╔══██╗██╔══██║ ██║ ╚═╝ ██║██║ ██║██║ ╚═╝ ██║██████╔╝██║ ██║ ╚═╝ ╚═╝╚═╝ ╚═╝╚═╝ ╚═╝╚═════╝ ╚═╝ ╚═╝ mamba (1.4.2) supported by @QuantStack GitHub: https://github.com/mamba-org/mamba Twitter: https://twitter.com/QuantStack █████████████████████████████████████████████████████████████ Looking for: ['libarrow=14', 'pyarrow=14'] conda-forge/linux-64 Using cache conda-forge/noarch Using cache warning libmamba Cache file "/nvme/0/pgali/anaconda3/pkgs/cache/47929eba.json" was modified by another program warning libmamba Cache file "/nvme/0/pgali/anaconda3/pkgs/cache/3e39a7aa.json" was modified by another program warning libmamba Cache file "/nvme/0/pgali/anaconda3/pkgs/cache/2ce54b42.json" was modified by another program warning libmamba Cache file "/nvme/0/pgali/anaconda3/pkgs/cache/4ea078d6.json" was modified by another program pkgs/main/noarch 853.2kB @ 2.8MB/s 0.3s pkgs/r/linux-64 1.9MB @ 3.2MB/s 0.6s pkgs/r/noarch 2.3MB @ 3.7MB/s 0.7s pkgs/main/linux-64 6.3MB @ 4.5MB/s 1.5s Transaction Prefix: /nvme/0/pgali/envs/cudfdevtst-arrow-14-13 Updating specs: - libarrow=14 - pyarrow=14 Package Version Build Channel Size ───────────────────────────────────────────────────────────────────────────────────────────── Install: ───────────────────────────────────────────────────────────────────────────────────────────── + _libgcc_mutex 0.1 conda_forge conda-forge/linux-64 Cached + _openmp_mutex 4.5 2_gnu conda-forge/linux-64 Cached + aws-c-auth 0.7.5 h2acc10b_2 conda-forge/linux-64 Cached + aws-c-cal 0.6.9 h0fad3b2_0 conda-forge/linux-64 Cached + aws-c-common 0.9.5 hd590300_0 conda-forge/linux-64 Cached + aws-c-compression 0.2.17 h3e65c2a_5 conda-forge/linux-64 Cached + aws-c-event-stream 0.3.2 hc1d3383_5 conda-forge/linux-64 Cached + aws-c-http 0.7.13 h858fa18_9 conda-forge/linux-64 Cached + aws-c-io 0.13.35 hf90439a_7 conda-forge/linux-64 Cached + aws-c-mqtt 0.9.8 hd23f6f0_1 conda-forge/linux-64 Cached + aws-c-s3 0.3.22 h2de862a_1 conda-forge/linux-64 Cached + aws-c-sdkutils 0.1.12 h3e65c2a_4 conda-forge/linux-64 Cached + aws-checksums 0.1.17 h3e65c2a_4 conda-forge/linux-64 Cached + aws-crt-cpp 0.24.4 h233f1e4_5 conda-forge/linux-64 Cached + aws-sdk-cpp 1.11.182 h18c0b32_3 conda-forge/linux-64 Cached + bzip2 1.0.8 hd590300_5 conda-forge/linux-64 Cached + c-ares 1.21.0 hd590300_0 conda-forge/linux-64 Cached + ca-certificates 2023.7.22 hbcca054_0 conda-forge/linux-64 Cached + gflags 2.2.2 he1b5a44_1004 conda-forge/linux-64 Cached + glog 0.6.0 h6f12383_0 conda-forge/linux-64 Cached + icu 73.2 h59595ed_0 conda-forge/linux-64 Cached + keyutils 1.6.1 h166bdaf_0 conda-forge/linux-64 Cached + krb5 1.21.2 h659d440_0 conda-forge/linux-64 Cached + ld_impl_linux-64 2.40 h41732ed_0 conda-forge/linux-64 Cached + libabseil 20230802.1 cxx17_h59595ed_0 conda-forge/linux-64 Cached + libarrow 14.0.0 he61f9f8_0_cpu conda-forge/linux-64 Cached + libarrow-acero 14.0.0 h59595ed_0_cpu conda-forge/linux-64 Cached + libarrow-dataset 14.0.0 h59595ed_0_cpu conda-forge/linux-64 Cached + libarrow-flight 14.0.0 h120cb0d_0_cpu conda-forge/linux-64 Cached + libarrow-flight-sql 14.0.0 h61ff412_0_cpu conda-forge/linux-64 Cached + libarrow-gandiva 14.0.0 hacb8726_0_cpu conda-forge/linux-64 Cached + libarrow-substrait 14.0.0 h61ff412_0_cpu conda-forge/linux-64 Cached + libblas 3.9.0 19_linux64_openblas conda-forge/linux-64 Cached + libbrotlicommon 1.1.0 hd590300_1 conda-forge/linux-64 Cached + libbrotlidec 1.1.0 hd590300_1 conda-forge/linux-64 Cached + libbrotlienc 1.1.0 hd590300_1 conda-forge/linux-64 Cached + libcblas 3.9.0 19_linux64_openblas conda-forge/linux-64 Cached + libcrc32c 1.1.2 h9c3ff4c_0 conda-forge/linux-64 Cached + libcurl 8.4.0 hca28451_0 conda-forge/linux-64 Cached + libedit 3.1.20191231 he28a2e2_2 conda-forge/linux-64 Cached + libev 4.33 h516909a_1 conda-forge/linux-64 Cached + libevent 2.1.12 hf998b51_1 conda-forge/linux-64 Cached + libexpat 2.5.0 hcb278e6_1 conda-forge/linux-64 Cached + libffi 3.4.2 h7f98852_5 conda-forge/linux-64 Cached + libgcc-ng 13.2.0 h807b86a_2 conda-forge/linux-64 Cached + libgfortran-ng 13.2.0 h69a702a_2 conda-forge/linux-64 Cached + libgfortran5 13.2.0 ha4646dd_2 conda-forge/linux-64 Cached + libgomp 13.2.0 h807b86a_2 conda-forge/linux-64 Cached + libgoogle-cloud 2.12.0 h5206363_4 conda-forge/linux-64 Cached + libgrpc 1.59.2 hd6c4280_0 conda-forge/linux-64 Cached + libiconv 1.17 h166bdaf_0 conda-forge/linux-64 Cached + liblapack 3.9.0 19_linux64_openblas conda-forge/linux-64 Cached + libllvm15 15.0.7 h5cf9203_3 conda-forge/linux-64 Cached + libnghttp2 1.55.1 h47da74e_0 conda-forge/linux-64 Cached + libnsl 2.0.1 hd590300_0 conda-forge/linux-64 Cached + libnuma 2.0.16 h0b41bf4_1 conda-forge/linux-64 Cached + libopenblas 0.3.24 pthreads_h413a1c8_0 conda-forge/linux-64 Cached + libparquet 14.0.0 h352af49_0_cpu conda-forge/linux-64 Cached + libprotobuf 4.24.4 hf27288f_0 conda-forge/linux-64 Cached + libre2-11 2023.06.02 h7a70373_0 conda-forge/linux-64 Cached + libsqlite 3.44.0 h2797004_0 conda-forge/linux-64 Cached + libssh2 1.11.0 h0841786_0 conda-forge/linux-64 Cached + libstdcxx-ng 13.2.0 h7e041cc_2 conda-forge/linux-64 Cached + libthrift 0.19.0 hb90f79a_1 conda-forge/linux-64 Cached + libutf8proc 2.8.0 h166bdaf_0 conda-forge/linux-64 Cached + libuuid 2.38.1 h0b41bf4_0 conda-forge/linux-64 Cached + libxml2 2.11.5 h232c23b_1 conda-forge/linux-64 Cached + libzlib 1.2.13 hd590300_5 conda-forge/linux-64 Cached + lz4-c 1.9.4 hcb278e6_0 conda-forge/linux-64 Cached + ncurses 6.4 h59595ed_2 conda-forge/linux-64 Cached + numpy 1.26.0 py312heda63a1_0 conda-forge/linux-64 7MB + openssl 3.1.4 hd590300_0 conda-forge/linux-64 Cached + orc 1.9.0 h4b38347_4 conda-forge/linux-64 Cached + pip 23.3.1 pyhd8ed1ab_0 conda-forge/noarch Cached + pyarrow 14.0.0 py312h176e3d2_0_cpu conda-forge/linux-64 5MB + python 3.12.0 hab00c5b_0_cpython conda-forge/linux-64 32MB + python_abi 3.12 4_cp312 conda-forge/linux-64 6kB + rdma-core 28.9 h59595ed_1 conda-forge/linux-64 Cached + re2 2023.06.02 h2873b5e_0 conda-forge/linux-64 Cached + readline 8.2 h8228510_1 conda-forge/linux-64 Cached + s2n 1.3.56 h06160fa_0 conda-forge/linux-64 Cached + setuptools 68.2.2 pyhd8ed1ab_0 conda-forge/noarch Cached + snappy 1.1.10 h9fff704_0 conda-forge/linux-64 Cached + tk 8.6.13 noxft_h4845f30_101 conda-forge/linux-64 Cached + tzdata 2023c h71feb2d_0 conda-forge/noarch Cached + ucx 1.15.0 h64cca9d_0 conda-forge/linux-64 Cached + wheel 0.41.3 pyhd8ed1ab_0 conda-forge/noarch Cached + xz 5.2.6 h166bdaf_0 conda-forge/linux-64 Cached + zstd 1.5.5 hfc55251_0 conda-forge/linux-64 Cached Summary: Install: 89 packages Total download: 44MB ───────────────────────────────────────────────────────────────────────────────────────────── Confirm changes: [Y/n] y python_abi 6.4kB @ 25.2kB/s 0.3s pyarrow 4.5MB @ 15.4MB/s 0.3s numpy 7.5MB @ 17.5MB/s 0.4s python 32.1MB @ 57.0MB/s 0.6s Downloading and Extracting Packages Preparing transaction: done Verifying transaction: done Executing transaction: done To activate this environment, use $ mamba activate /nvme/0/pgali/envs/cudfdevtst-arrow-14-13 To deactivate an active environment, use $ mamba deactivate (base) pgali@abc:/nvme/0/pgali/cudf$ conda activate /nvme/0/pgali/envs/cudfdevtst-arrow-14-13 (cudfdevtst-arrow-14-13) pgali@dt07:/nvme/0/pgali/cudf$ mamba install -c conda-forge libarrow=13 pyarrow=13 __ __ __ __ / \ / \ / \ / \ / \/ \/ \/ \ ███████████████/ /██/ /██/ /██/ /████████████████████████ / / \ / \ / \ / \ \____ / / \_/ \_/ \_/ \ o \__, / _/ \_____/ ` |/ ███╗ ███╗ █████╗ ███╗ ███╗██████╗ █████╗ ████╗ ████║██╔══██╗████╗ ████║██╔══██╗██╔══██╗ ██╔████╔██║███████║██╔████╔██║██████╔╝███████║ ██║╚██╔╝██║██╔══██║██║╚██╔╝██║██╔══██╗██╔══██║ ██║ ╚═╝ ██║██║ ██║██║ ╚═╝ ██║██████╔╝██║ ██║ ╚═╝ ╚═╝╚═╝ ╚═╝╚═╝ ╚═╝╚═════╝ ╚═╝ ╚═╝ mamba (1.4.2) supported by @QuantStack GitHub: https://github.com/mamba-org/mamba Twitter: https://twitter.com/QuantStack █████████████████████████████████████████████████████████████ Looking for: ['libarrow=13', 'pyarrow=13'] conda-forge/linux-64 Using cache conda-forge/noarch Using cache warning libmamba Cache file "/nvme/0/pgali/anaconda3/pkgs/cache/47929eba.json" was modified by another program warning libmamba Cache file "/nvme/0/pgali/anaconda3/pkgs/cache/3e39a7aa.json" was modified by another program warning libmamba Cache file "/nvme/0/pgali/anaconda3/pkgs/cache/2ce54b42.json" was modified by another program warning libmamba Cache file "/nvme/0/pgali/anaconda3/pkgs/cache/4ea078d6.json" was modified by another program pkgs/main/noarch 853.2kB @ 3.9MB/s 0.2s pkgs/r/linux-64 1.9MB @ 4.1MB/s 0.5s pkgs/r/noarch 2.3MB @ 4.1MB/s 0.6s pkgs/main/linux-64 6.3MB @ 4.7MB/s 1.4s Pinned packages: - python 3.12.* Could not solve for environment specs The following packages are incompatible ├─ libarrow 13** is requested and can be installed; └─ pyarrow 13** is installable with the potential options ├─ pyarrow 13.0.0 would require │ └─ libarrow 13.0.0 hd3e26bc_5_cuda, which can be installed; ├─ pyarrow 13.0.0 would require │ └─ python >=3.10,<3.11.0a0 , which can be installed; ├─ pyarrow 13.0.0 would require │ └─ python >=3.11,<3.12.0a0 , which can be installed; ├─ pyarrow 13.0.0 would require │ └─ libarrow 13.0.0 h8d17fec_10_cpu, which can be installed; ├─ pyarrow 13.0.0 would require │ └─ libarrow 13.0.0 he1fec18_11_cpu, which can be installed; ├─ pyarrow 13.0.0 would require │ └─ libarrow 13.0.0 he1fec18_12_cpu, which can be installed; ├─ pyarrow 13.0.0 would require │ └─ libarrow 13.0.0 hecbb4c5_13_cpu, which can be installed; ├─ pyarrow 13.0.0 would require │ └─ libarrow 13.0.0 h3b6bca8_14_cpu, which can be installed; ├─ pyarrow 13.0.0 would require │ └─ libarrow 13.0.0 h1935d02_5_cpu, which can be installed; ├─ pyarrow 13.0.0 would require │ └─ libarrow 13.0.0 hc3189b8_6_cpu, which can be installed; ├─ pyarrow 13.0.0 would require │ └─ libarrow 13.0.0 h0f80be4_7_cpu, which can be installed; ├─ pyarrow 13.0.0 would require │ └─ libarrow 13.0.0 h75f0d2f_8_cpu, which can be installed; ├─ pyarrow 13.0.0 would require │ └─ libarrow 13.0.0 h4121bdd_9_cpu, which can be installed; ├─ pyarrow 13.0.0 would require │ └─ libarrow 13.0.0 h392d4ea_10_cuda, which can be installed; ├─ pyarrow 13.0.0 would require │ └─ libarrow 13.0.0 hab0744f_11_cuda, which can be installed; ├─ pyarrow 13.0.0 would require │ └─ libarrow 13.0.0 hab0744f_12_cuda, which can be installed; ├─ pyarrow 13.0.0 would require │ └─ libarrow 13.0.0 h4ed642f_13_cuda, which can be installed; ├─ pyarrow 13.0.0 would require │ └─ libarrow 13.0.0 h3adf09d_14_cuda, which can be installed; ├─ pyarrow 13.0.0 would require │ └─ libarrow 13.0.0 h8a72790_6_cuda, which can be installed; ├─ pyarrow 13.0.0 would require │ └─ libarrow 13.0.0 hca7e773_7_cuda, which can be installed; ├─ pyarrow 13.0.0 would require │ └─ libarrow 13.0.0 h3d00cb7_8_cuda, which can be installed; ├─ pyarrow 13.0.0 would require │ └─ libarrow 13.0.0 hdac2b50_9_cuda, which can be installed; ├─ pyarrow 13.0.0 would require │ └─ python >=3.8,<3.9.0a0 , which can be installed; └─ pyarrow 13.0.0 would require └─ python >=3.9,<3.10.0a0 , which can be installed.The text was updated successfully, but these errors were encountered: