Llm phi

[porteratzo]

A jupyter notebook to demo finetuning with the Phi3 LLM model. https://huggingface.co/docs/transformers/main/en/model_doc/phi3

We use the math_10k dataset https://github.com/AGI-Edgerunners/LLM-Adapters/tree/main

We download the dataset from github and check its hash and preprocess the dataset.

We load the phi model and prepare it for PEFT training.

Then we create a workflow that extracts the peft parameters and excludes sending the full model to the collaborators, the collaborators reconstruct the model from the original model and only modify the peft parameters. And after training and evaluation return the peft parameters again to be used with fed average.

[rahulga1]

@porteratzo can you take care of failed pipelines and ask for review agian?

[rajithkrishnegowda]

can you remove the absolute path and. keep general like
!pip install git+https://github.com/securefederatedai/openfl.git
!pip install -r workflow_interface_requirements.txt

[rajithkrishnegowda]

when running "!pip install datasets trl" getting the below error

      -- Running cmake for PyArrow
      cmake -DCMAKE_INSTALL_PREFIX=/private/var/folders/bj/xlf52n2s7zx24gvllky2f_wh0000gn/T/pip-install-55o676u7/pyarrow_50ccfaecb1b946ff8ad649bdf24d7546/build/lib.macosx-10.9-x86_64-cpython-311/pyarrow -DPYTHON_EXECUTABLE=/Users/rkrishne/anaconda3/bin/python -DPython3_EXECUTABLE=/Users/rkrishne/anaconda3/bin/python -DPYARROW_CXXFLAGS= -DPYARROW_BUNDLE_ARROW_CPP=off -DPYARROW_BUNDLE_CYTHON_CPP=off -DPYARROW_GENERATE_COVERAGE=off -DCMAKE_BUILD_TYPE=release /private/var/folders/bj/xlf52n2s7zx24gvllky2f_wh0000gn/T/pip-install-55o676u7/pyarrow_50ccfaecb1b946ff8ad649bdf24d7546
      error: command 'cmake' failed: No such file or directory
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
  ERROR: Failed building wheel for pyarrow
Failed to build pyarrow
ERROR: Could not build wheels for pyarrow, which is required to install pyproject.toml-based projects

[rajithkrishnegowda]

to resolve tat error we need to install cmake package but even after installing cmake package getting the below error

/private/var/folders/bj/xlf52n2s7zx24gvllky2f_wh0000gn/T/pip-install-doldjp2l/pyarrow_53bf7158da274fff8d32761768c8e19b/pyarrow/src/arrow/python/arrow_to_pandas.cc:208:16:` error: no member named 'LARGE_LIST_VIEW' in 'arrow::Type'; did you mean 'LARGE_LIST'?
          case Type::LARGE_LIST_VIEW: {
               ~~~~~~^~~~~~~~~~~~~~~
                     LARGE_LIST
      /anaconda3/include/arrow/type_fwd.h:410:5: note: 'LARGE_LIST' declared here
          LARGE_LIST = 36,
          ^
      fatal error: too many errors emitted, stopping now [-ferror-limit=]
      20 errors generated.
      make[2]: *** [CMakeFiles/arrow_python.dir/pyarrow/src/arrow/python/arrow_to_pandas.cc.o] Error 1
      make[1]: *** [CMakeFiles/arrow_python.dir/all] Error 2
      make: *** [all] Error 2
      error: command '/usr/local/bin/cmake' failed with exit code 2
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
  ERROR: Failed building wheel for pyarrow
Failed to build pyarrow
ERROR: Could not build wheels for pyarrow, which is required to install pyproject.toml-based projects
Note: you may need to restart the kernel to use updated packages.

[porteratzo]

I am unable to replicate the error, tested with a fresh python3.10 env using conda, also used --no-cache to make sure packages where being downloaded

[rajithkrishnegowda]

I tired with python 3.10 version and was able to install without any error. But when i tired with python 3.11 version then we get the above issue.

We have to specify somewhere as a prerequisites that it only works with python 3.10.

[rahulga1]

@psfoley should we direct this PR to openFL-contrib instead?