Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix indentation error in models/_utils.py:209 #1287

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

grpathak22
Copy link

Fixed this error I was getting while using FastInference
Traceback (most recent call last):

File /opt/conda/lib/python3.10/site-packages/IPython/core/interactiveshell.py:3553 in run_code
exec(code_obj, self.user_global_ns, self.user_ns)

Cell In[16], line 1
from unsloth import FastLanguageModel

File /opt/conda/lib/python3.10/site-packages/unsloth/init.py:170
from .models import *

File /opt/conda/lib/python3.10/site-packages/unsloth/models/init.py:15
from .loader import FastLanguageModel

File /opt/conda/lib/python3.10/site-packages/unsloth/models/loader.py:15
from ._utils import is_bfloat16_supported, HAS_FLASH_ATTENTION, HAS_FLASH_ATTENTION_SOFTCAPPING

File /opt/conda/lib/python3.10/site-packages/unsloth/models/_utils.py:209
exec(source)

File :25
)if len(self) == 0:
^
SyntaxError: invalid syntax

@grpathak22 grpathak22 changed the title fixed indentation error in models/_utils.py:209 fix indentation error in models/_utils.py:209 Nov 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant