Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Refactor: OpenFL support with Gramine. #1079

Conversation

MasterSkepticista
Copy link
Collaborator

This PR upgrades assets to enable SGX-based TEE execution for FL experiments.

A detailed description of changes will be made soon.

Changes:

  • Update fx workspace export.
  • Refactor fx workspace dockerize/graminize

Tests: TBA

MasterSkepticista and others added 30 commits October 3, 2024 14:59
Signed-off-by: Shah, Karan <[email protected]>
Signed-off-by: Shah, Karan <[email protected]>
Signed-off-by: Shah, Karan <[email protected]>
Updates the requirements on [protobuf](https://github.com/protocolbuffers/protobuf) to permit the latest version.
- [Release notes](https://github.com/protocolbuffers/protobuf/releases)
- [Changelog](https://github.com/protocolbuffers/protobuf/blob/main/protobuf_release.bzl)
- [Commits](protocolbuffers/protobuf@v4.22.0...v5.28.0-rc3)

---
updated-dependencies:
- dependency-name: protobuf
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Signed-off-by: kta-intel <[email protected]>
Signed-off-by: Teodor Parvanov <[email protected]>
* restructure: renamed requirements-linter file

Signed-off-by: Pant, Akshay <[email protected]>

* restructure: renamed requirements-test file

Signed-off-by: Pant, Akshay <[email protected]>

* restructure: renamed docs/requirements-docs file

Signed-off-by: Pant, Akshay <[email protected]>

* restructure: renamed openfl-tutorials/experimental/requirements_workflow_interface file

Signed-off-by: Pant, Akshay <[email protected]>

* feat(dependabot config): ignore certain directories from the scan

Signed-off-by: Pant, Akshay <[email protected]>

---------

Signed-off-by: Pant, Akshay <[email protected]>
Signed-off-by: kta-intel <[email protected]>
…eratedai#1076)

- Added `openfl/utilities/dataloading.py` to provide a way to get
data_loader from plan object. `get_dataloader` function will accept
the plan object and options like `prefer_minimal` and `input_shape`
to provide either full `DataLoader` with training capability or a light
`MockDataLoader` with input_shape to make sure we can make
task_runner instance without full data context.

- Updated `openfl/interface/plan.py` and replaced the data_loader
fetch logic to use the new `get_dataloader`

- Updated `openfl/interface/model.py` and replaced the data_loader
fetch logic to use the new `get_dataloader`. This will make the fx
command `fx model save` to be able to save the model without
any initial data being present in the workspace.

Signed-off-by: Joe Kim <[email protected]>
@MasterSkepticista
Copy link
Collaborator Author

Tip moved ahead, many rebase conflicts. New PR will be opened.

@MasterSkepticista MasterSkepticista deleted the karansh1/gramine_refactor branch October 22, 2024 05:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

9 participants