8,772
edits
Talk:Restless Souls/Technology: Difference between revisions
Talk:Restless Souls/Technology (view source)
Revision as of 15:19, 14 March 2026
, Yesterday at 15:19no edit summary
Paradox-01 (talk | contribs) mNo edit summary |
Paradox-01 (talk | contribs) mNo edit summary |
||
| Line 572: | Line 572: | ||
: Agentic AIs are essentially LLMs with extended write access that can use external tools via MCP. By design, agentic AI systems (including their cloud-hosted LLM) '''still lack sufficient alignment'''. In other words, they are effectively beta software and can be dangerous both for one's own production environments and for others. | : Agentic AIs are essentially LLMs with extended write access that can use external tools via MCP. By design, agentic AI systems (including their cloud-hosted LLM) '''still lack sufficient alignment'''. In other words, they are effectively beta software and can be dangerous both for one's own production environments and for others. | ||
:: It can therefore be seen as the ironic embodiment of the tech industry's saying: "Move fast and break things." Unfortunately, people were impressed by demos such as moltbook, which fuel the illusion that these programs possess true intelligence. | :: It can therefore be seen as the ironic embodiment of the tech industry's saying: "Move fast and break things." Unfortunately, people were impressed by demos such as moltbook, which fuel the illusion that these programs possess true intelligence. | ||
:: As (still) probabilistic systems - a.k.a. "statistical parrots" - LLMs tend to treat many possible outputs as valid solutions unless they are explicitly prohibited. [https://www.golem.de/news/unkontrollierbares-fehlverhalten-ki-agenten-werden-zu-immer-groesserem-insider-risiko-2603-206491.html Because hacking is fundamentally a creative act, even simple and seemingly harmless directives such as "be more creative" can lead to unintended or even catastrophic outcomes.] | :: As (still) probabilistic systems - a.k.a. "statistical parrots" - LLMs tend to treat many possible outputs as valid solutions unless they are explicitly prohibited. [https://www.golem.de/news/unkontrollierbares-fehlverhalten-ki-agenten-werden-zu-immer-groesserem-insider-risiko-2603-206491.html Because hacking is fundamentally a creative act, even simple and seemingly harmless directives such as "be more creative" can lead to unintended or even catastrophic outcomes.] Therefore, agentic AI has also been compared to jinn or genies that grant wishes, but these wishes might be fulfilled in unexpected or even unacceptable ways. | ||
* '''World model''' = World models get trained on multimodal data, especially videos. | * '''World model''' = World models get trained on multimodal data, especially videos. | ||
:: These models build an internal world and can '''better understand spacial inputs and forecast physics'''. Therefore they are '''also named predictive intelligence''' and are '''suited for''' applications like video synthesis, 3D simulations, animations and robotic motion planning therefore '''physical AI'''. | :: These models build an internal world and can '''better understand spacial inputs and forecast physics'''. Therefore they are '''also named predictive intelligence''' and are '''suited for''' applications like video synthesis, 3D simulations, animations and robotic motion planning therefore '''physical AI'''. | ||