Wrong modules with wrong package versions are loaded from outside of the cond env

[Ark-kun]

Checklist

• I added a descriptive title.
• I searched through existing issues and couldn't find a solution or duplicate issue.
• I searched on the web (e.g. Google) and didn't find any helpful information.
• I searched the Anaconda documentation and didn't find any helpful information.

Impacted product

• A conda package (built by Anaconda)
• Anaconda Distribution (formerly Anaconda Individual Edition)
• Miniconda
• Anaconda.org

What happened?

I've just installed the latest Anaconda version, initialized it and added conda-forge.

When activating environment and using python, some packages are loaded from outside the env and have incorrect versions.

$ conda create -n issue_3129_11 "python==3.10" "protobuf<4" "google-cloud-aiplatform==1.58"
$ conda activate issue_3129_11
(issue_3129_11) avolkov@avolkov:~$ python -c 'import sys; print(sys.path); from google.cloud import aiplatform; print(aiplatform); print(aiplatform.__version__)'
[
'',
'/usr/local/buildtools/current/sitecustomize', 
'/usr/local/google/home/avolkov/anaconda3/envs/issue_3129_11/lib/python310.zip', 
'/usr/local/google/home/avolkov/anaconda3/envs/issue_3129_11/lib/python3.10', 
'/usr/local/google/home/avolkov/anaconda3/envs/issue_3129_11/lib/python3.10/lib-dynload', 
'/usr/local/google/home/avolkov/.local/lib/python3.10/site-packages',
'/usr/local/google/home/avolkov/anaconda3/envs/issue_3129_11/lib/python3.10/site-packages',
]
<module 'google.cloud.aiplatform' from '/usr/local/google/home/avolkov/.local/lib/python3.10/site-packages/google/cloud/aiplatform/__init__.py'>
1.25.0

$ which python
/usr/local/google/home/avolkov/anaconda3/envs/issue_3129_11/bin/python

$ echo $PYTHONPATH
/usr/local/buildtools/current/sitecustomize

Expected behavior or outcome

I expect the modules to be loaded from the installed conda packages and have correct versions.

Conda info

active environment : issue_3129_11
    active env location : /usr/local/google/home/avolkov/anaconda3/envs/issue_3129_11
            shell level : 1
       user config file : /usr/local/google/home/avolkov/.condarc
 populated config files : /usr/local/google/home/avolkov/.condarc
          conda version : 24.1.2
    conda-build version : 24.1.2
         python version : 3.11.7.final.0
                 solver : libmamba (default)
       virtual packages : __archspec=1=zen2
                          __conda=24.1.2=0
                          __glibc=2.37=0
                          __linux=6.6.15=0
                          __unix=0=0
       base environment : /usr/local/google/home/avolkov/anaconda3  (writable)
      conda av data dir : /usr/local/google/home/avolkov/anaconda3/etc/conda
  conda av metadata url : None
           channel URLs : https://repo.anaconda.com/pkgs/main/linux-64
                          https://repo.anaconda.com/pkgs/main/noarch
                          https://repo.anaconda.com/pkgs/r/linux-64
                          https://repo.anaconda.com/pkgs/r/noarch
                          https://conda.anaconda.org/conda-forge/linux-64
                          https://conda.anaconda.org/conda-forge/noarch
          package cache : /usr/local/google/home/avolkov/anaconda3/pkgs
                          /usr/local/google/home/avolkov/.conda/pkgs
       envs directories : /usr/local/google/home/avolkov/anaconda3/envs
                          /usr/local/google/home/avolkov/.conda/envs
               platform : linux-64
             user-agent : conda/24.1.2 requests/2.31.0 CPython/3.11.7 Linux/6.6.15-2rodete2-amd64 debian/n/a glibc/2.37 solver/libmamba conda-libmamba-solver/24.1.0 libmambapy/1.5.6 aau/0.4.3 c/gGnaCFIVORuOvkrnyq_U8A s/lubT3UTu59cP4SiINpF5IA e/8bSJCcHeKUHdhOW-48UEqg
                UID:GID : 589262:89939
             netrc file : None
           offline mode : False

Conda config

==> /usr/local/google/home/avolkov/.condarc <==
auto_activate_base: False
channels:
  - defaults
  - conda-forge

Conda list

# packages in environment at /usr/local/google/home/avolkov/anaconda3/envs/issue_3129_11:
#
# Name                    Version                   Build  Channel
_libgcc_mutex             0.1                        main    defaults
_openmp_mutex             5.1                       1_gnu    defaults
abseil-cpp                20211102.0           hd4dd3e8_0    defaults
aiohttp                   3.9.5           py310h5eee18b_0    defaults
aiosignal                 1.2.0              pyhd3eb1b0_0    defaults
annotated-types           0.6.0           py310h06a4308_0    defaults
async-timeout             4.0.3           py310h06a4308_0    defaults
attrs                     23.1.0          py310h06a4308_0    defaults
blas                      1.0                    openblas    defaults
brotli-python             1.0.9           py310h6a678d5_8    defaults
bzip2                     1.0.8                h5eee18b_6    defaults
c-ares                    1.19.1               h5eee18b_0    defaults
ca-certificates           2024.3.11            h06a4308_0    defaults
cachetools                5.3.3           py310h06a4308_0    defaults
certifi                   2024.6.2        py310h06a4308_0    defaults
cffi                      1.15.1          py310h74dc2b5_0    defaults
charset-normalizer        2.0.4              pyhd3eb1b0_0    defaults
cryptography              41.0.3          py310h130f0dd_0    defaults
docstring_parser          0.16               pyhd8ed1ab_0    conda-forge
frozenlist                1.4.0           py310h5eee18b_0    defaults
geos                      3.8.0                he6710b0_0    defaults
google-api-core           2.10.1          py310h06a4308_0    defaults
google-api-core-grpc      2.10.1          py310h06a4308_0    defaults
google-auth               2.29.0          py310h06a4308_0    defaults
google-cloud-aiplatform   1.58.0             pyhd8ed1ab_0    conda-forge
google-cloud-bigquery-core 3.18.0             pyhd8ed1ab_0    conda-forge
google-cloud-core         2.3.2           py310h06a4308_0    defaults
google-cloud-resource-manager 1.6.3              pyhd8ed1ab_0    conda-forge
google-cloud-storage      2.6.0           py310h06a4308_0    defaults
google-crc32c             1.5.0           py310h5eee18b_0    defaults
google-resumable-media    2.4.0           py310h06a4308_0    defaults
googleapis-common-protos  1.56.4          py310h06a4308_0    defaults
googleapis-common-protos-grpc 1.56.4          py310h06a4308_0    defaults
grpc-cpp                  1.48.2               h5bf31a4_0    defaults
grpc-google-iam-v1        0.13.1             pyhd8ed1ab_0    conda-forge
grpcio                    1.48.2          py310h5bf31a4_0    defaults
grpcio-status             1.41.1             pyhd3eb1b0_0    defaults
idna                      3.7             py310h06a4308_0    defaults
ld_impl_linux-64          2.38                 h1181459_1    defaults
libcrc32c                 1.1.2                h6a678d5_0    defaults
libffi                    3.3                  he6710b0_2    defaults
libgcc-ng                 11.2.0               h1234567_1    defaults
libgfortran-ng            11.2.0               h00389a5_1    defaults
libgfortran5              11.2.0               h1234567_1    defaults
libgomp                   11.2.0               h1234567_1    defaults
libopenblas               0.3.21               h043d6bf_0    defaults
libprotobuf               3.20.3               he621ea3_0    defaults
libstdcxx-ng              11.2.0               h1234567_1    defaults
libuuid                   1.41.5               h5eee18b_0    defaults
multidict                 6.0.4           py310h5eee18b_0    defaults
ncurses                   6.4                  h6a678d5_0    defaults
numpy                     1.26.4          py310heeff2f4_0    defaults
numpy-base                1.26.4          py310h8a23956_0    defaults
openssl                   1.1.1w               h7f8727e_0    defaults
packaging                 24.1            py310h06a4308_0    defaults
pip                       24.0            py310h06a4308_0    defaults
proto-plus                1.22.1          py310h06a4308_0    defaults
protobuf                  3.20.3          py310h6a678d5_0    defaults
pyasn1                    0.4.8              pyhd3eb1b0_0    defaults
pyasn1-modules            0.2.8                      py_0    defaults
pycparser                 2.21               pyhd3eb1b0_0    defaults
pydantic                  2.5.3           py310h06a4308_0    defaults
pydantic-core             2.14.6          py310hb02cf49_0    defaults
pyopenssl                 23.2.0          py310h06a4308_0    defaults
pysocks                   1.7.1           py310h06a4308_0    defaults
python                    3.10.0               h12debd9_5    defaults
python-dateutil           2.9.0post0      py310h06a4308_2    defaults
re2                       2022.04.01           h295c915_0    defaults
readline                  8.2                  h5eee18b_0    defaults
requests                  2.32.2          py310h06a4308_0    defaults
rsa                       4.7.2              pyhd3eb1b0_1    defaults
setuptools                69.5.1          py310h06a4308_0    defaults
shapely                   2.0.1           py310h006c72b_0    defaults
six                       1.16.0             pyhd3eb1b0_1    defaults
sqlite                    3.45.3               h5eee18b_0    defaults
tk                        8.6.14               h39e8969_0    defaults
typing-extensions         4.11.0          py310h06a4308_0    defaults
typing_extensions         4.11.0          py310h06a4308_0    defaults
tzdata                    2024a                h04d1e81_0    defaults
urllib3                   2.2.2           py310h06a4308_0    defaults
wheel                     0.43.0          py310h06a4308_0    defaults
xz                        5.4.6                h5eee18b_1    defaults
yarl                      1.9.3           py310h5eee18b_0    defaults
zlib                      1.2.13               h5eee18b_1    defaults

Additional information

No response

[saundramonroe]

HI there, Can you tell me which packages have the incorrect version.