Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support for ReFT #1822

Closed
RonanKMcGovern opened this issue Apr 27, 2024 · 1 comment
Closed

Support for ReFT #1822

RonanKMcGovern opened this issue Apr 27, 2024 · 1 comment
Labels
Stale

Comments

@RonanKMcGovern
Copy link

Feature request

Add support for reft, allowing for sub spaces to be activated on the fly (incl different sub spaces for each batch).

stanfordnlp/pyreft#63

Motivation

Applying Lora on the fly is too slow. ReFT can be done much more easily as it only adjusts representations.

Your contribution

See here stanfordnlp/pyreft#63
@github-actions GitHub Actions
Copy link

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 5 days.

@github-actions github-actions bot added the Stale label May 28, 2024
@github-actions github-actions bot closed this as not planned Won't fix, can't repro, duplicate, stale Jun 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Stale
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@RonanKMcGovern