New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

训练数据中的"task_type"的作用 #8

Open

guihonghao opened this issue May 14, 2024 · 1 comment

guihonghao commented May 14, 2024

{
     "instruction": "Passage: The * storekeepers * stayed in town to run their stores and lived in the rooms behind # them # .\nDoes the pronoun # them # refer to * storekeepers *?\nA. Yes\nB. No\nAnswer: ",
     "input": "",
     "output": "B",
     "task_type": 0
}

你好，请问"task_type"的作用是什么？假设有8个Lora专家，那么"task_type": 0表示这条数据，倾向于被第一个专家处理？

Owner

Ablustrund commented May 18, 2024

task_type是论文里面的，我们将sft数据分为两类（知识性和非知识性）。task_type此时为1或者0.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment