fix indentation error in models/_utils.py:209 #1287
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Fixed this error I was getting while using FastInference
Traceback (most recent call last):
File /opt/conda/lib/python3.10/site-packages/IPython/core/interactiveshell.py:3553 in run_code
exec(code_obj, self.user_global_ns, self.user_ns)
Cell In[16], line 1
from unsloth import FastLanguageModel
File /opt/conda/lib/python3.10/site-packages/unsloth/init.py:170
from .models import *
File /opt/conda/lib/python3.10/site-packages/unsloth/models/init.py:15
from .loader import FastLanguageModel
File /opt/conda/lib/python3.10/site-packages/unsloth/models/loader.py:15
from ._utils import is_bfloat16_supported, HAS_FLASH_ATTENTION, HAS_FLASH_ATTENTION_SOFTCAPPING
File /opt/conda/lib/python3.10/site-packages/unsloth/models/_utils.py:209
exec(source)
File :25
)if len(self) == 0:
^
SyntaxError: invalid syntax