You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I tried to export Llama 3.3 70B with the latest version of neuronx-tgi (0.0.27) but it fails with error "No tokenizer found ...".
The problems should be related to the transformers/tokenizers version: Llama 3.3 requires transformers >= 4.45.0, while in optimum neuron 0.0.27 we have 4.43.x.
Is there a plan to upgrade and add support for Llama 3.3?
Thanks
The text was updated successfully, but these errors were encountered:
I tried to export Llama 3.3 70B with the latest version of neuronx-tgi (0.0.27) but it fails with error "No tokenizer found ...".
The problems should be related to the transformers/tokenizers version: Llama 3.3 requires transformers >= 4.45.0, while in optimum neuron 0.0.27 we have 4.43.x.
Is there a plan to upgrade and add support for Llama 3.3?
Thanks
The text was updated successfully, but these errors were encountered: