admin管理员组文章数量:1399944
My goal is to create a chat bot specialized in answering questions related to diabetes.
I am new to fine tuning and have a couple questions before I begin. My question is about the dataset format and the underlying model I should use.
I want to fine tune the LLM on the following dataset - I am thinking of using the Alpaca format - make a prompt with ##[Instruction] ##[Input] ##[Output] - (). However, I want to use the rationale and explanation column from the database. How should I incorporate it? If not rationale, I want to incorporate explanation column while fine tuning.
I plan to use the base model rather than the instruct model. Will that be the right choice?
Seeking guidance, Thanks!
本文标签: large language modelHow to incorporate additional data in fine tuning LLMStack Overflow
版权声明:本文标题:large language model - How to incorporate additional data in fine tuning LLM - Stack Overflow 内容由网友自发贡献,该文观点仅代表作者本人, 转载请联系作者并注明出处:http://www.betaflare.com/web/1744128285a2592055.html, 本站仅提供信息存储空间服务,不拥有所有权,不承担相关法律责任。如发现本站有涉嫌抄袭侵权/违法违规的内容,一经查实,本站将立刻删除。
发表评论