Skip to content
/ AutoQPAD Public

Example of finetuning a quantized AutoGPTQ LLama2 model using QLoRA, adding the PAD token, while preventing a loss of 0.0.

Notifications You must be signed in to change notification settings

lazzd/AutoQPAD

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 

Repository files navigation

AutoQPAD

Example of finetuning a quantized AutoGPTQ LLama2 model using QLoRA, adding the PAD token, while preventing a loss of 0.0.

About

Example of finetuning a quantized AutoGPTQ LLama2 model using QLoRA, adding the PAD token, while preventing a loss of 0.0.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published