Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Llama 3.2 #46

Open
skyne98 opened this issue Nov 9, 2024 · 1 comment · May be fixed by #55
Open

Llama 3.2 #46

skyne98 opened this issue Nov 9, 2024 · 1 comment · May be fixed by #55
Labels
enhancement New feature or request

Comments

@skyne98
Copy link

skyne98 commented Nov 9, 2024

Is loading Llama 3.2 model variants already possible with the current implementation? It would be amazing to potentially utilize smaller Llama 3.2 variants on mobile :) Thanks!
@laggui
Copy link
Member

laggui commented Nov 11, 2024

Adding support for 3.2 text model variants should be relatively straightforward with the current implementation 🙂

Just haven't had the time to do so yet. Will try to do it in the coming week!

@laggui laggui added the enhancement New feature or request label Nov 11, 2024
@laggui laggui linked a pull request Jan 17, 2025 that will close this issue
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Llama 3.2 tracel-ai/models
2 participants
@skyne98 @laggui