support Pipeline parallelism #148
Workflow file for this run
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| name: Test LLM Models on Dev | |
| on: | |
| push: | |
| except: | |
| branches: | |
| - 'main' | |
| jobs: | |
| test-llama-7b: | |
| runs-on: self-hosted | |
| steps: | |
| - name: Get Branch Name | |
| id: branch_name | |
| run: echo "::set-output name=branch::${GITHUB_REF#refs/heads/}" | |
| - name: clone repository | |
| run: | | |
| current_branch="${{ steps.branch_name.outputs.branch }}" | |
| cd /workspace | |
| rm -rf ./multi-lora-fine-tune | |
| git clone -b $current_branch --single-branch [email protected]:TUDB-Labs/multi-lora-fine-tune.git | |
| - name: finetune llama-7b | |
| run: | | |
| cd /workspace/multi-lora-fine-tune | |
| python mlora.py --base_model /data/llama-7b-hf --config ./config/dummy.json --load_8bit | |
| - name: test inference with lora | |
| run: | | |
| cd /workspace/multi-lora-fine-tune | |
| python .github/workflows/ci_script.py "llama" "/data/llama-7b-hf" "./lora_1" "What is m-LoRA?" "Multi-LoRA" |