Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Root cause conda anaconda telemetry #4111

Open
wants to merge 4 commits into
base: main
Choose a base branch
from
Open

Root cause conda anaconda telemetry #4111

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
3f2dbe0
test for nightly CI
junjieqi Dec 26, 2024
d55f907
comment the fix
junjieqi Dec 27, 2024
ba1a6b7
add reports
junjieqi Dec 27, 2024
2faec9d
test
junjieqi Dec 28, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 5 additions & 4 deletions .github/actions/build_conda/action.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -31,15 +31,16 @@ runs:
with:
python-version: '3.11'
miniconda-version: latest
reports: {'quiet': 'False'}
- name: Install conda build tools
shell: ${{ steps.choose_shell.outputs.shell }}
run: |
conda install -y -q "conda!=24.11.0"
conda install -y -q "conda-build!=24.11.0"
- name: Fix CI failure
shell: ${{ steps.choose_shell.outputs.shell }}
if: runner.os != 'Windows'
run: conda remove conda-anaconda-telemetry
# - name: Fix CI failure
# shell: ${{ steps.choose_shell.outputs.shell }}
# if: runner.os != 'Windows'
# run: conda remove conda-anaconda-telemetry
- name: Enable anaconda uploads
if: inputs.label != ''
shell: ${{ steps.choose_shell.outputs.shell }}
Expand Down
258 changes: 130 additions & 128 deletions .github/workflows/nightly.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,7 +1,9 @@
name: Nightly
on:
schedule:
- cron: '10 6 * * *'
workflow_dispatch:
pull_request:
branches:
- main
env:
OMP_NUM_THREADS: '10'
MKL_THREADING_LAYER: GNU
Expand All @@ -20,129 +22,129 @@ jobs:
ANACONDA_API_TOKEN: ${{ secrets.ANACONDA_API_TOKEN }}
with:
label: nightly
linux-x86_64-GPU-CUDA-11-4-4-nightly:
name: Linux x86_64 GPU nightlies (CUDA 11.4.4)
runs-on: 4-core-ubuntu-gpu-t4
env:
CUDA_ARCHS: "60-real;61-real;62-real;70-real;72-real;75-real;80;86-real"
FAISS_FLATTEN_CONDA_INCLUDES: "1"
steps:
- name: Checkout
uses: actions/checkout@v4
with:
fetch-depth: 0
fetch-tags: true
- uses: ./.github/actions/build_conda
env:
ANACONDA_API_TOKEN: ${{ secrets.ANACONDA_API_TOKEN }}
with:
label: nightly
cuda: "11.4.4"
linux-x86_64-GPU-CUVS-CUDA11-8-0-nightly:
name: Linux x86_64 GPU w/ cuVS nightlies (CUDA 11.8.0)
runs-on: 4-core-ubuntu-gpu-t4
env:
CUDA_ARCHS: "70-real;72-real;75-real;80;86-real"
steps:
- name: Checkout
uses: actions/checkout@v4
with:
fetch-depth: 0
fetch-tags: true
- uses: ./.github/actions/build_conda
env:
ANACONDA_API_TOKEN: ${{ secrets.ANACONDA_API_TOKEN }}
with:
label: nightly
cuvs: "ON"
cuda: "11.8.0"
linux-x86_64-GPU-CUDA-12-1-1-nightly:
name: Linux x86_64 GPU nightlies (CUDA 12.1.1)
runs-on: 4-core-ubuntu-gpu-t4
env:
CUDA_ARCHS: "70-real;72-real;75-real;80;86-real"
steps:
- name: Checkout
uses: actions/checkout@v4
with:
fetch-depth: 0
fetch-tags: true
- uses: ./.github/actions/build_conda
env:
ANACONDA_API_TOKEN: ${{ secrets.ANACONDA_API_TOKEN }}
with:
label: nightly
cuda: "12.1.1"
linux-x86_64-GPU-CUVS-CUDA12-4-0-nightly:
name: Linux x86_64 GPU w/ cuVS nightlies (CUDA 12.4.0)
runs-on: 4-core-ubuntu-gpu-t4
env:
CUDA_ARCHS: "70-real;72-real;75-real;80;86-real"
steps:
- name: Checkout
uses: actions/checkout@v4
with:
fetch-depth: 0
fetch-tags: true
- uses: ./.github/actions/build_conda
env:
ANACONDA_API_TOKEN: ${{ secrets.ANACONDA_API_TOKEN }}
with:
label: nightly
cuvs: "ON"
cuda: "12.4.0"
windows-x86_64-nightly:
name: Windows x86_64 nightlies
runs-on: windows-2019
steps:
- name: Checkout
uses: actions/checkout@v4
with:
fetch-depth: 0
fetch-tags: true
- uses: ./.github/actions/build_conda
env:
ANACONDA_API_TOKEN: ${{ secrets.ANACONDA_API_TOKEN }}
with:
label: nightly
osx-arm64-nightly:
name: OSX arm64 nightlies
runs-on: macos-14
steps:
- name: Checkout
uses: actions/checkout@v4
with:
fetch-depth: 0
fetch-tags: true
- uses: ./.github/actions/build_conda
env:
ANACONDA_API_TOKEN: ${{ secrets.ANACONDA_API_TOKEN }}
with:
label: nightly
linux-arm64-nightly:
name: Linux arm64 nightlies
runs-on: 2-core-ubuntu-arm
steps:
- name: Checkout
uses: actions/checkout@v4
with:
fetch-depth: 0
fetch-tags: true
- uses: ./.github/actions/build_conda
env:
ANACONDA_API_TOKEN: ${{ secrets.ANACONDA_API_TOKEN }}
with:
label: nightly
auto-retry:
name: Auto retry on failure
if: fromJSON(github.run_attempt) < 2
runs-on: ubuntu-latest
steps:
- name: Start rerun workflow
env:
GH_REPO: ${{ github.repository }}
GH_TOKEN: ${{ github.token }}
GH_DEBUG: api
run: |
gh workflow run retry_build.yml \
-F run_id=${{ github.run_id }}
# linux-x86_64-GPU-CUDA-11-4-4-nightly:
# name: Linux x86_64 GPU nightlies (CUDA 11.4.4)
# runs-on: 4-core-ubuntu-gpu-t4
# env:
# CUDA_ARCHS: "60-real;61-real;62-real;70-real;72-real;75-real;80;86-real"
# FAISS_FLATTEN_CONDA_INCLUDES: "1"
# steps:
# - name: Checkout
# uses: actions/checkout@v4
# with:
# fetch-depth: 0
# fetch-tags: true
# - uses: ./.github/actions/build_conda
# env:
# ANACONDA_API_TOKEN: ${{ secrets.ANACONDA_API_TOKEN }}
# with:
# label: nightly
# cuda: "11.4.4"
# linux-x86_64-GPU-CUVS-CUDA11-8-0-nightly:
# name: Linux x86_64 GPU w/ cuVS nightlies (CUDA 11.8.0)
# runs-on: 4-core-ubuntu-gpu-t4
# env:
# CUDA_ARCHS: "70-real;72-real;75-real;80;86-real"
# steps:
# - name: Checkout
# uses: actions/checkout@v4
# with:
# fetch-depth: 0
# fetch-tags: true
# - uses: ./.github/actions/build_conda
# env:
# ANACONDA_API_TOKEN: ${{ secrets.ANACONDA_API_TOKEN }}
# with:
# label: nightly
# cuvs: "ON"
# cuda: "11.8.0"
# linux-x86_64-GPU-CUDA-12-1-1-nightly:
# name: Linux x86_64 GPU nightlies (CUDA 12.1.1)
# runs-on: 4-core-ubuntu-gpu-t4
# env:
# CUDA_ARCHS: "70-real;72-real;75-real;80;86-real"
# steps:
# - name: Checkout
# uses: actions/checkout@v4
# with:
# fetch-depth: 0
# fetch-tags: true
# - uses: ./.github/actions/build_conda
# env:
# ANACONDA_API_TOKEN: ${{ secrets.ANACONDA_API_TOKEN }}
# with:
# label: nightly
# cuda: "12.1.1"
# linux-x86_64-GPU-CUVS-CUDA12-4-0-nightly:
# name: Linux x86_64 GPU w/ cuVS nightlies (CUDA 12.4.0)
# runs-on: 4-core-ubuntu-gpu-t4
# env:
# CUDA_ARCHS: "70-real;72-real;75-real;80;86-real"
# steps:
# - name: Checkout
# uses: actions/checkout@v4
# with:
# fetch-depth: 0
# fetch-tags: true
# - uses: ./.github/actions/build_conda
# env:
# ANACONDA_API_TOKEN: ${{ secrets.ANACONDA_API_TOKEN }}
# with:
# label: nightly
# cuvs: "ON"
# cuda: "12.4.0"
# windows-x86_64-nightly:
# name: Windows x86_64 nightlies
# runs-on: windows-2019
# steps:
# - name: Checkout
# uses: actions/checkout@v4
# with:
# fetch-depth: 0
# fetch-tags: true
# - uses: ./.github/actions/build_conda
# env:
# ANACONDA_API_TOKEN: ${{ secrets.ANACONDA_API_TOKEN }}
# with:
# label: nightly
# osx-arm64-nightly:
# name: OSX arm64 nightlies
# runs-on: macos-14
# steps:
# - name: Checkout
# uses: actions/checkout@v4
# with:
# fetch-depth: 0
# fetch-tags: true
# - uses: ./.github/actions/build_conda
# env:
# ANACONDA_API_TOKEN: ${{ secrets.ANACONDA_API_TOKEN }}
# with:
# label: nightly
# linux-arm64-nightly:
# name: Linux arm64 nightlies
# runs-on: 2-core-ubuntu-arm
# steps:
# - name: Checkout
# uses: actions/checkout@v4
# with:
# fetch-depth: 0
# fetch-tags: true
# - uses: ./.github/actions/build_conda
# env:
# ANACONDA_API_TOKEN: ${{ secrets.ANACONDA_API_TOKEN }}
# with:
# label: nightly
# auto-retry:
# name: Auto retry on failure
# if: fromJSON(github.run_attempt) < 2
# runs-on: ubuntu-latest
# steps:
# - name: Start rerun workflow
# env:
# GH_REPO: ${{ github.repository }}
# GH_TOKEN: ${{ github.token }}
# GH_DEBUG: api
# run: |
# gh workflow run retry_build.yml \
# -F run_id=${{ github.run_id }}
Loading