發(fā)簡(jiǎn)信
IP屬地：貴州
個(gè)人介紹
Base LLM has been trained to predict the next word base on text training data, often trained on a large amount of data from the internet and other sources to figure out what's the next most likely word to follow
Instruction Tuned LLM:
has been trained to follow instructions
You start off with a base LLMs that has been trained on a huge amount of text data and further train it further fine tune it
with input and outputs that are instructions and good attempts to follow those instructions call RLHF reinforcement learning to make the system better able to be helpful and follow instructions because instruction tuned LLMs have been trained
If you can't explain it simply, you don't understand it well enough.
Figure out what you love doing and don’t suck at, then try to figure out how to make a living doing that! Don’t be scared. We’re all going to die, it’s just a question of when and how
All problems in computer science can be solved by another level of indirection
Instruction Tuned LLM:
has been trained to follow instructions
You start off with a base LLMs that has been trained on a huge amount of text data and further train it further fine tune it
with input and outputs that are instructions and good attempts to follow those instructions call RLHF reinforcement learning to make the system better able to be helpful and follow instructions because instruction tuned LLMs have been trained
If you can't explain it simply, you don't understand it well enough.
Figure out what you love doing and don’t suck at, then try to figure out how to make a living doing that! Don’t be scared. We’re all going to die, it’s just a question of when and how
All problems in computer science can be solved by another level of indirection