8,852
edits
Talk:Restless Souls/Technology: Difference between revisions
m
no edit summary
Paradox-01 (talk | contribs) m (→Terms) |
Paradox-01 (talk | contribs) mNo edit summary |
||
| Line 574: | Line 574: | ||
:: As (still too) probabilistic systems - a.k.a. "statistical parrots" - LLMs tend to treat many possible outputs as valid solutions unless they are explicitly prohibited. [https://www.golem.de/news/unkontrollierbares-fehlverhalten-ki-agenten-werden-zu-immer-groesserem-insider-risiko-2603-206491.html Because hacking is fundamentally a creative act, even simple and seemingly harmless directives such as "be more creative" can lead to unintended or even catastrophic outcomes.] Therefore, agentic AI has also been compared to jinn or genies that grant wishes, but these wishes might be fulfilled in unexpected or even unacceptable ways. | :: As (still too) probabilistic systems - a.k.a. "statistical parrots" - LLMs tend to treat many possible outputs as valid solutions unless they are explicitly prohibited. [https://www.golem.de/news/unkontrollierbares-fehlverhalten-ki-agenten-werden-zu-immer-groesserem-insider-risiko-2603-206491.html Because hacking is fundamentally a creative act, even simple and seemingly harmless directives such as "be more creative" can lead to unintended or even catastrophic outcomes.] Therefore, agentic AI has also been compared to jinn or genies that grant wishes, but these wishes might be fulfilled in unexpected or even unacceptable ways. | ||
: Due to current shortcomings, people let specialized agentic AIs work in groups. Multi-agent systems. | : Due to current shortcomings, people let specialized agentic AIs work in groups. Multi-agent systems. | ||
* '''Mamba | * '''Mamba enhanced GenAI''' = [[wp:Mamba_(deep_learning_architecture)|mamba]] transformer hybrid LLMs for better long-context reasoning<!--This is an important intermediate step because the transformer-only approach basically has hit its limit.--> | ||
:: The hybrid approach together with MoE is called Jamba by AI21 and is also used by Nvidia. | :: The hybrid approach together with MoE is called Jamba by AI21 and is also used by Nvidia. | ||
:: Matured mamba transformer hybrids will make agentic AI smarter and therefore way more safer to use by default. | :: Matured mamba transformer hybrids will make agentic AI smarter and therefore way more safer to use by default. | ||