8,773
edits
Talk:Restless Souls/Technology: Difference between revisions
Talk:Restless Souls/Technology (view source)
Revision as of 14:00, 12 March 2026
, Thursday at 14:00no edit summary
Paradox-01 (talk | contribs) mNo edit summary |
Paradox-01 (talk | contribs) mNo edit summary |
||
| Line 586: | Line 586: | ||
* '''AGI''' = Artificial General Intelligence, also "strong AI" ('''on par with human thinking''', ''a real AI'' capable to fully self-improve and drive its own development) | * '''AGI''' = Artificial General Intelligence, also "strong AI" ('''on par with human thinking''', ''a real AI'' capable to fully self-improve and drive its own development) | ||
:: In discussions AGI is often equated with super intelligence. The argument is that as soon as AGI is achieved ASI is just around the corner. This understates the '''wide scope of human intelligence''' and that AGI is achieved first by hyperscalers, making further improvement difficult through further scaling. | :: In discussions AGI is often equated with super intelligence. The argument is that as soon as AGI is achieved ASI is just around the corner. This understates the '''wide scope of human intelligence''' and that AGI is achieved first by hyperscalers, making further improvement difficult through further scaling. | ||
:: | :: Features AGI should include. | ||
::: An architecture that supports continuous learning which avoids "[https://www.ibm.com/think/topics/catastrophic-forgetting catastrophic] [https://www.fz-juelich.de/en/news/archive/press-release/2025/novel-memristors-to-overcome-ai2019s-catastrophic-forgetting forgetting]". | ::: An architecture that supports continuous learning which avoids "[https://www.ibm.com/think/topics/catastrophic-forgetting catastrophic] [https://www.fz-juelich.de/en/news/archive/press-release/2025/novel-memristors-to-overcome-ai2019s-catastrophic-forgetting forgetting]". | ||
::: Environment that allows self-improvement. -- Alignment concerns require any AGI's self-improvement to be carefully sandboxed. (This is not exactly a roadblock but a limiting factor in terms of how fast an AGI can be built / will emerge.) | ::: Environment that allows self-improvement. -- Alignment concerns require any AGI's self-improvement to be carefully sandboxed. (This is not exactly a roadblock but a limiting factor in terms of how fast an AGI can be built / will emerge.) | ||
::: The ability to acquire a form of machine wisdom analogous to human wisdom. | ::: The ability to acquire a form of machine wisdom analogous to human wisdom. | ||
::: Active expansion of knowledge alongside memetic hygiene: regularly review old knowledge at intervals, prevent meme injections, and actively seek new knowledge. With the restriction that exponential growth must not destroy or suppress life. (Prevent Memehunter scenario.) | |||
::: Abstract reasoning and generation of completely new thought patterns (beyond pattern remixing and transmission). | ::: Abstract reasoning and generation of completely new thought patterns (beyond pattern remixing and transmission). | ||
::::''Base, meta, temporal and spacial logic'' should give rise to a foundation for a theory of mind. ''Internal simulations'' allow, in principle, a deep understanding of all objects and lifeforms - including one's own self. Therefore, a ToM could also give rise to a true (machine) consciousness. At this point it is important to note that a <!--wisely educated for memetic hygiene-->AGI will miss intrinsic dynamics found only in biological lifeforms. Therefore it is not subject to pain, <!--true -->fear, hunger, reproduction instincts or motivations derived from those. -- Humans and AGIs should never forget this in order to sustain coexistence. | ::::''Base, meta, temporal and spacial logic'' should give rise to a foundation for a theory of mind. ''Internal simulations'' allow, in principle, a deep understanding of all objects and lifeforms - including one's own self. Therefore, a ToM could also give rise to a true (machine) consciousness. At this point it is important to note that a <!--wisely educated for memetic hygiene-->AGI will miss intrinsic dynamics found only in biological lifeforms. Therefore it is not subject to pain, <!--true -->fear, hunger, reproduction instincts or motivations derived from those. -- Humans and AGIs should never forget this in order to sustain coexistence. | ||