Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Missing kfp-kubernetes #103

Open
1 task done
therc opened this issue Aug 13, 2024 · 1 comment
Open
1 task done

Missing kfp-kubernetes #103

therc opened this issue Aug 13, 2024 · 1 comment
Labels
bug Something isn't working

Comments

@therc
Copy link

therc commented Aug 13, 2024

Solution to issue cannot be found in the documentation.

  • I checked the documentation.

Issue

In V2, kubeflow-pipelines has moved Kubernetes-specific features to a kfp-kubernetes package. It doesn't look like it's packaged in kfp. Upstream, it's located in a subdirectory of its own:
https://github.com/kubeflow/pipelines/tree/master/kubernetes_platform/python/kfp/kubernetes

There is a kfp-kubernetes pip package. I can see three ways to offer the functionality:

  1. punt to the PyPI package
  2. release a separate kfp-kubernetes subpackage in lockstep with kfp
  3. just include it in the main kfp packages (as kfp.kubernetes)

Installed packages

_libgcc_mutex             0.1                 conda_forge    conda-forge
_openmp_mutex             4.5                       2_gnu    conda-forge
aiohappyeyeballs          2.3.5              pyhd8ed1ab_0    conda-forge
aiohttp                   3.10.3          py310h5b4e0ec_0    conda-forge
aiosignal                 1.3.1              pyhd8ed1ab_0    conda-forge
archspec                  0.2.3              pyhd8ed1ab_0    conda-forge
async-timeout             4.0.3              pyhd8ed1ab_0    conda-forge
attrs                     24.2.0             pyh71513ae_0    conda-forge
blinker                   1.8.2              pyhd8ed1ab_0    conda-forge
boltons                   24.0.0             pyhd8ed1ab_0    conda-forge
brotli-python             1.1.0           py310hc6cd4ac_1    conda-forge
bzip2                     1.0.8                h4bc722e_7    conda-forge
c-ares                    1.33.0               ha66036c_0    conda-forge
ca-certificates           2024.7.4             hbcca054_0    conda-forge
cachetools                5.4.0              pyhd8ed1ab_0    conda-forge
certifi                   2024.7.4           pyhd8ed1ab_0    conda-forge
cffi                      1.17.0          py310h2fdcea3_0    conda-forge
charset-normalizer        3.3.2              pyhd8ed1ab_0    conda-forge
click                     8.1.7           unix_pyh707e725_0    conda-forge
colorama                  0.4.6              pyhd8ed1ab_0    conda-forge
conda                     24.7.1          py310hff52083_0    conda-forge
conda-content-trust       0.2.0           py310h06a4308_0  
conda-libmamba-solver     23.12.0            pyhd3eb1b0_1  
conda-package-handling    2.3.0              pyh7900ff3_0    conda-forge
conda-package-streaming   0.10.0             pyhd8ed1ab_0    conda-forge
cryptography              43.0.0          py310h4909e49_0    conda-forge
distro                    1.9.0              pyhd8ed1ab_0    conda-forge
docstring_parser          0.16               pyhd8ed1ab_0    conda-forge
fmt                       9.1.0                h924138e_0    conda-forge
frozendict                2.4.2           py310h5eee18b_0  
frozenlist                1.4.1           py310h2372a71_0    conda-forge
google-api-core           2.19.1             pyhd8ed1ab_0    conda-forge
google-auth               2.33.0             pyhff2d567_0    conda-forge
google-cloud-core         2.4.1              pyhd8ed1ab_0    conda-forge
google-cloud-storage      2.18.2             pyhff2d567_0    conda-forge
google-crc32c             1.5.0                    pypi_0    pypi
google-resumable-media    2.7.2              pyhd8ed1ab_1    conda-forge
googleapis-common-protos  1.63.2             pyhd8ed1ab_0    conda-forge
grpcio                    1.62.2          py310h6a678d5_0  
h2                        4.1.0              pyhd8ed1ab_0    conda-forge
hpack                     4.0.0              pyh9f0ad1d_0    conda-forge
hyperframe                6.0.1              pyhd8ed1ab_0    conda-forge
icu                       73.2                 h59595ed_0    conda-forge
idna                      3.7                pyhd8ed1ab_0    conda-forge
jsonpatch                 1.33               pyhd8ed1ab_0    conda-forge
jsonpointer               3.0.0           py310hff52083_0    conda-forge
keyutils                  1.6.1                h166bdaf_0    conda-forge
kfp                       2.8.0              pyhd8ed1ab_0    conda-forge
kfp-pipeline-spec         0.3.0              pyhd8ed1ab_0    conda-forge
kfp-server-api            2.0.5                    pypi_0    pypi
krb5                      1.20.1               h81ceb04_0    conda-forge
ld_impl_linux-64          2.40                 hf3520f5_7    conda-forge
libabseil                 20240116.2      cxx17_he02047a_1    conda-forge
libarchive                3.6.2                hfab0078_4  
libcrc32c                 1.1.2                h9c3ff4c_0    conda-forge
libcurl                   8.7.1                h251f7ec_0  
libedit                   3.1.20191231         he28a2e2_2    conda-forge
libev                     4.33                 hd590300_2    conda-forge
libffi                    3.4.2                h7f98852_5    conda-forge
libgcc-ng                 14.1.0               h77fa898_0    conda-forge
libgomp                   14.1.0               h77fa898_0    conda-forge
libgrpc                   1.62.2               h2d74bed_0  
libmamba                  1.5.8                hfe524e5_2  
libmambapy                1.5.8           py310h2dafd23_2  
libnghttp2                1.57.0               h2d74bed_0  
libprotobuf               4.25.3               he621ea3_0  
libsolv                   0.7.24               he621ea3_1  
libssh2                   1.10.0               ha35d2d1_2    conda-forge
libstdcxx-ng              14.1.0               hc0a3c3a_0    conda-forge
libuuid                   1.41.5               h5eee18b_0  
libxml2                   2.13.1               hfdd30dd_2  
lz4-c                     1.9.4                hcb278e6_0    conda-forge
menuinst                  2.0.1           py310h06a4308_1  
multidict                 6.0.5           py310h2372a71_0    conda-forge
ncurses                   6.5                  h59595ed_0    conda-forge
oauthlib                  3.2.2              pyhd8ed1ab_0    conda-forge
openssl                   3.3.1                h4bc722e_2    conda-forge
packaging                 24.1               pyhd8ed1ab_0    conda-forge
pcre2                     10.42                hebb0a14_1  
pip                       23.3.1          py310h06a4308_0  
platformdirs              4.2.2              pyhd8ed1ab_0    conda-forge
pluggy                    1.5.0              pyhd8ed1ab_0    conda-forge
proto-plus                1.24.0                   pypi_0    pypi
protobuf                  4.25.4                   pypi_0    pypi
pyasn1                    0.6.0              pyhd8ed1ab_0    conda-forge
pyasn1-modules            0.4.0              pyhd8ed1ab_0    conda-forge
pybind11-abi              4                    hd8ed1ab_3    conda-forge
pycosat                   0.6.6           py310h2372a71_0    conda-forge
pycparser                 2.22               pyhd8ed1ab_0    conda-forge
pyjwt                     2.9.0              pyhd8ed1ab_1    conda-forge
pyopenssl                 24.2.1             pyhd8ed1ab_2    conda-forge
pysocks                   1.7.1              pyha2e5f31_6    conda-forge
python                    3.10.13              h955ad1f_0  
python-dateutil           2.9.0.post0              pypi_0    pypi
python-kubernetes         26.1.0             pyhd8ed1ab_0    conda-forge
python_abi                3.10                    2_cp310    conda-forge
pyu2f                     0.1.5              pyhd8ed1ab_0    conda-forge
pyyaml                    6.0.2           py310h5b4e0ec_0    conda-forge
re2                       2022.04.01           h27087fc_0    conda-forge
readline                  8.2                  h8228510_1    conda-forge
reproc                    14.2.4.post0         hd590300_1    conda-forge
reproc-cpp                14.2.4.post0         h59595ed_1    conda-forge
requests                  2.32.3             pyhd8ed1ab_0    conda-forge
requests-oauthlib         2.0.0              pyhd8ed1ab_0    conda-forge
requests-toolbelt         0.10.1             pyhd8ed1ab_0    conda-forge
rsa                       4.9                pyhd8ed1ab_0    conda-forge
ruamel.yaml               0.18.6          py310h2372a71_0    conda-forge
ruamel.yaml.clib          0.2.8           py310h2372a71_0    conda-forge
setuptools                68.2.2          py310h06a4308_0  
six                       1.16.0             pyh6c4a22f_0    conda-forge
sqlite                    3.45.3               h5eee18b_0  
tabulate                  0.9.0              pyhd8ed1ab_1    conda-forge
tk                        8.6.14               h39e8969_0  
tqdm                      4.66.5             pyhd8ed1ab_0    conda-forge
truststore                0.8.0              pyhd8ed1ab_0    conda-forge
typing-extensions         4.12.2               hd8ed1ab_0    conda-forge
typing_extensions         4.12.2             pyha770c72_0    conda-forge
tzdata                    2024a                h0c530f3_0    conda-forge
urllib3                   1.26.19            pyhd8ed1ab_0    conda-forge
websocket-client          1.8.0              pyhd8ed1ab_0    conda-forge
wheel                     0.41.2          py310h06a4308_0  
xz                        5.4.6                h5eee18b_1  
yaml                      0.2.5                h7f98852_2    conda-forge
yaml-cpp                  0.8.0                h59595ed_0    conda-forge
yarl                      1.9.4           py310h2372a71_0    conda-forge
zlib                      1.2.13               h5eee18b_1  
zstandard                 0.22.0          py310h1275a96_0    conda-forge
zstd                      1.5.5                hc292b87_2

Environment info

active environment : base
    active env location : /home/rudi/miniconda3
            shell level : 1
       user config file : /home/rudi/.condarc
 populated config files : /home/rudi/.condarc
          conda version : 24.7.1
    conda-build version : not installed
         python version : 3.10.13.final.0
                 solver : classic
       virtual packages : __archspec=1=icelake
                          __conda=24.7.1=0
                          __glibc=2.38=0
                          __linux=6.9.11=0
                          __unix=0=0
       base environment : /home/rudi/miniconda3  (writable)
      conda av data dir : /home/rudi/miniconda3/etc/conda
  conda av metadata url : None
           channel URLs : https://conda.anaconda.org/conda-forge/linux-64
                          https://conda.anaconda.org/conda-forge/noarch
                          https://repo.anaconda.com/pkgs/main/linux-64
                          https://repo.anaconda.com/pkgs/main/noarch
                          https://repo.anaconda.com/pkgs/r/linux-64
                          https://repo.anaconda.com/pkgs/r/noarch
          package cache : /home/rudi/miniconda3/pkgs
                          /home/rudi/.conda/pkgs
       envs directories : /home/rudi/miniconda3/envs
                          /home/rudi/.conda/envs
               platform : linux-64
             user-agent : conda/24.7.1 requests/2.32.3 CPython/3.10.13 Linux/6.9.11-100.fc39.x86_64 fedora/39 glibc/2.38
                UID:GID : 1000:1000
             netrc file : None
           offline mode : False
@therc therc added the bug Something isn't working label Aug 13, 2024
@therc
Copy link
Author

therc commented Aug 13, 2024

In case you're wondering, this is to set up things such as node selector labels, pod labels, ephemeral volumes and ports. See https://www.kubeflow.org/docs/components/pipelines/user-guides/core-functions/platform-specific-features/

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@therc