8,773
edits
Talk:Restless Souls/Technology: Difference between revisions
m
no edit summary
Paradox-01 (talk | contribs) mNo edit summary |
Paradox-01 (talk | contribs) mNo edit summary |
||
| Line 560: | Line 560: | ||
* '''GenAI''' = Generative AI, its a significant step between ANI and AGI. GenAI included at least three major points: | * '''GenAI''' = Generative AI, its a significant step between ANI and AGI. GenAI included at least three major points: | ||
** The new transformer architecture (GPT). | ** The new transformer architecture (GPT). | ||
** The actual data-holding model, including its parameters and weights. Most often, this is a Large Language Model (LLM) or a Large Multimodal Model (LMM). The learned data consist of statistical patterns about text, images, or other media. | ** The actual data-holding model, including its parameters and weights. Most often, this is a Large Language Model (LLM) or a Large Multimodal Model (LMM). The learned data consist of statistical patterns about text, images, or other media. If the original training data wasn't "internalized" it is usually not reconstructable from the model. | ||
** Reinforcement learning from human feedback (RLHF) and (its successor RLAIF) can be named as another important feature that added a reward model for higher quality and alignment. | ** Reinforcement learning from human feedback (RLHF) and (its successor RLAIF) can be named as another important feature that added a reward model for higher quality and alignment. | ||
** Other features or milestones like chain of thought (reasoning), mixture of experts (MoE), context expansion and the use of external tools via MCP to compensate own shortcomings are better described as incremental improvements in the evolution of GenAI.<!-- | ** Other features or milestones like chain of thought (reasoning), mixture of experts (MoE), context expansion and the use of external tools via MCP to compensate own shortcomings are better described as incremental improvements in the evolution of GenAI.<!-- | ||