- Overfitting or underfitting in collective reasoning or systemic (governing) structures (which probably correlates)<ref>[https://www.sciencedirect.com/science/article/pii/S0028390822004579 Canalization and plasticity in psychopathology, R.L. Carhart-Harris et al., 2023]</ref><ref>[[OSF]([OSF]([OSF]([OSF]([OSF]([OSF]([OSF](https://psyarxiv.com/uxmz6/))))))) Deep CANALs: A Deep Learning Approach to Refining the Canalization Theory of Psychopathology, Adam Safron et al., 2023]</ref><ref>[[The Canal Papers - by Scott Alexander - Astral Codex Ten]([The Canal Papers - by Scott Alexander - Astral Codex Ten]([The Canal Papers - by Scott Alexander - Astral Codex Ten]([The Canal Papers - by Scott Alexander - Astral Codex Ten]([The Canal Papers - by Scott Alexander - Astral Codex Ten]([The Canal Papers - by Scott Alexander - Astral Codex Ten]([The Canal Papers - by Scott Alexander - Astral Codex Ten]([The Canal Papers - by Scott Alexander - Astral Codex Ten]([The Canal Papers - by Scott Alexander - Astral Codex Ten]([The Canal Papers - by Scott Alexander - Astral Codex Ten]([The Canal Papers - by Scott Alexander - Astral Codex Ten]([The Canal Papers - by Scott Alexander - Astral Codex Ten](https://astralcodexten.substack.com/p/the-canal-papers)))))))))))) The Canal Papers, Astral Codex Ten, 2023]</ref><ref>[https://journals.sagepub.com/doi/10.1177/17456916221075252 Autistic-Like Traits and Positive Schizotypy as Diametric Specializations of the Predictive Mind, Brett P. Andersen, 2022]</ref><ref>[[Autism as a disorder of dimensionality – Opentheory.net]([Autism as a disorder of dimensionality – Opentheory.net]([Autism as a disorder of dimensionality – Opentheory.net]([Autism as a disorder of dimensionality – Opentheory.net]([Autism as a disorder of dimensionality – Opentheory.net]([Autism as a disorder of dimensionality – Opentheory.net]([Autism as a disorder of dimensionality – Opentheory.net]([Autism as a disorder of dimensionality – Opentheory.net]([Autism as a disorder of dimensionality – Opentheory.net]([Autism as a disorder of dimensionality – Opentheory.net]([Autism as a disorder of dimensionality – Opentheory.net]([Autism as a disorder of dimensionality – Opentheory.net](https://opentheory.net/2023/05/autism-as-a-disorder-of-dimensionality/)))))))))))) Autism as a disorder of dimensionality, Michael Edward Johnson, 2023]</ref> that can be modified by societal annealing<ref>[[- YouTube]([- YouTube](https://www.youtube.com/watch?v===QktnfpbYx7M)) The Romance of Reality, Universal Bayesianism, Bobby Azarian et al., 2023]</ref> <references/> - Other maladaptive parameter values in active inference<ref>[[- YouTube](https://www.youtube.com/watch?v===DepOiSw2nF0), A Computational Neuroscience Perspective on Subjective Wellbeing, Ryan Smith, 2022]</ref> <references/> =====Structures monitoring and reducing the probability of threats to humanity and directing towards positive futures===== Measuring and reducing chances of climate change, nuclear war tensions, natural risks,...<ref>[[Anders Sandberg - Grand Futures – Thinking Truly Long Term - YouTube]([Anders Sandberg - Grand Futures – Thinking Truly Long Term - YouTube]([Anders Sandberg - Grand Futures – Thinking Truly Long Term - YouTube](https://youtu.be/5fPOYEHHy4I))) Grand Futures – Thinking Truly Long Term, Anders Sandberg, 2022]</ref><ref>[[Meta Crisis 101: What is the Meta-Crisis? (+ Infographics) | Sloww]([Meta Crisis 101: What is the Meta-Crisis? (+ Infographics) | Sloww]([Meta Crisis 101: What is the Meta-Crisis? (+ Infographics) | Sloww]([Meta Crisis 101: What is the Meta-Crisis? (+ Infographics) | Sloww]([Meta Crisis 101: What is the Meta-Crisis? (+ Infographics) | Sloww]([Meta Crisis 101: What is the Meta-Crisis? (+ Infographics) | Sloww]([Meta Crisis 101: What is the Meta-Crisis? (+ Infographics) | Sloww]([Meta Crisis 101: What is the Meta-Crisis? (+ Infographics) | Sloww]([Meta Crisis 101: What is the Meta-Crisis? (+ Infographics) | Sloww]([Meta Crisis 101: What is the Meta-Crisis? (+ Infographics) | Sloww]([Meta Crisis 101: What is the Meta-Crisis? (+ Infographics) | Sloww]([Meta Crisis 101: What is the Meta-Crisis? (+ Infographics) | Sloww]([Meta Crisis 101: What is the Meta-Crisis? (+ Infographics) | Sloww](https://www.sloww.co/meta-crisis-101/))))))))))))) Maps of the Metacrisis, Kyle Kowalski]</ref><ref>[[Start Here - 🤯 Meta-Crisis Meta-Resource]([Start Here - 🤯 Meta-Crisis Meta-Resource]([Start Here - 🤯 Meta-Crisis Meta-Resource]([Start Here - 🤯 Meta-Crisis Meta-Resource](https://metacrisis.org/)))) Meta-Crisis Meta-Resource]</ref><ref>[[- YouTube](https://www.youtube.com/watch?v===jHxTvvPZUuI) Confronting The Meta-Crisis: Criteria for Turning The Titanic, Terry Patten, 2019]</ref><ref>[[- YouTube](https://www.youtube.com/watch?v===Y7unE1SkpHc) Tasting the Pickle: Ten Flavours of Meta-Crisis, Jonathan Rowson, 2021]</ref><ref>[https://slatestarcodex.com/2020/04/01/book-review-the-precipice/ The Precipice - landscape of existential risks, Toby Ord, 2021]</ref><ref>[https://existential-risk.org/concept.pdf Existential Risk Prevention as Global Priority, Nick Bostrom, 2013]</ref><ref>[[Global catastrophic risk - Wikipedia]([Global catastrophic risk - Wikipedia](https://en.wikipedia.org/wiki/Global_catastrophic_risk)) Global catastrophic risk wikipedia page]</ref><ref>[https://hpluspedia.org/index.php?title===Existential_risk&mobileaction===toggle_view_desktop Existential risk and dystopia map, Deku-shrub, 2021]</ref><ref>[[AI Existential Safety Map]([AI Existential Safety Map]([AI Existential Safety Map](https://aisafety.world/))) Map of AI existencial safety]</ref><ref>[[Why Meta & Metta?. Could we go two levels deeper than the… | by Jakub Simek | Meta & Metta | Medium]([Why Meta & Metta?. Could we go two levels deeper than the… | by Jakub Simek | Meta & Metta | Medium]([Why Meta & Metta?. Could we go two levels deeper than the… | by Jakub Simek | Meta & Metta | Medium]([Why Meta & Metta?. Could we go two levels deeper than the… | by Jakub Simek | Meta & Metta | Medium](https://medium.com/meta-metta/why-meta-metta-287baccde4c2)))) Rivalrous dynamics as generator functions of existential risks, Jakub Simek, 2019]</ref><ref>[[- YouTube](https://www.youtube.com/watch?v===4DnJxnEXB1g) How to save the planet from global warming, Tom Chi, 2016]</ref><ref>[https://twitter.com/rtk254/status/1528742051461865472 Polluted online epistemic environments impairing societies' ability to coordinate effectively, Ronen Tamari et al., 2022]</ref><ref>[[Center for Humane Technology]([Center for Humane Technology](https://www.humanetech.com/)) Center For Humane Technology: We envision a world where technology supports our shared well-being, sense-making, democracy, and ability to tackle complex global challenges]</ref><ref>[[Existential Hope]([Existential Hope]([Existential Hope](https://www.existentialhope.com/))) Existencial Hope: Let's aim for positive futures]</ref><ref>[https://enlightenedworldview.com/courses/meta-crisis/ The Meta-Crisis – What it is and what you can do about it]</ref><ref>[[A framework for comparing global problems in terms of expected impact - 80,000 Hours]([A framework for comparing global problems in terms of expected impact - 80,000 Hours]([A framework for comparing global problems in terms of expected impact - 80,000 Hours]([A framework for comparing global problems in terms of expected impact - 80,000 Hours]([A framework for comparing global problems in terms of expected impact - 80,000 Hours](https://80000hours.org/articles/problem-framework/))))) A framework for comparing global problems in terms of expected impact, Robert Wiblin, 2016]</ref><ref>[[The Consilience Project | The Consilience Project is a publication of the Civilization Research Institute (CRI)]([The Consilience Project | The Consilience Project is a publication of the Civilization Research Institute (CRI)]([The Consilience Project | The Consilience Project is a publication of the Civilization Research Institute (CRI)]([The Consilience Project | The Consilience Project is a publication of the Civilization Research Institute (CRI)]([The Consilience Project | The Consilience Project is a publication of the Civilization Research Institute (CRI)]([The Consilience Project | The Consilience Project is a publication of the Civilization Research Institute (CRI)]([The Consilience Project | The Consilience Project is a publication of the Civilization Research Institute (CRI)]([The Consilience Project | The Consilience Project is a publication of the Civilization Research Institute (CRI)]([The Consilience Project | The Consilience Project is a publication of the Civilization Research Institute (CRI)](https://consilienceproject.org/))))))))) The Consilience Project, Daniel Schmachtenberger]</ref> <references/> =====Prepared structures to be activated in case of an existencial risk realizing itself===== Nuclear fallouts, pandemic preparations,...<ref>[[A framework for comparing global problems in terms of expected impact - 80,000 Hours]([A framework for comparing global problems in terms of expected impact - 80,000 Hours]([A framework for comparing global problems in terms of expected impact - 80,000 Hours]([A framework for comparing global problems in terms of expected impact - 80,000 Hours]([A framework for comparing global problems in terms of expected impact - 80,000 Hours](https://80000hours.org/articles/problem-framework/))))) A framework for comparing global problems in terms of expected impact, Robert Wiblin, 2016]</ref> <references/> =====Alignment of clusters of biological and artificial agents===== ======Cooperation====== - diplomatic cooperation, reducing power asymmetries, regulations that are not opressive but help everyone, common knowledge of democracy theory, transparency, promoting long term big picture thinking, shared identity and goals<ref>[[The Consilience Project | The Consilience Project is a publication of the Civilization Research Institute (CRI)]([The Consilience Project | The Consilience Project is a publication of the Civilization Research Institute (CRI)]([The Consilience Project | The Consilience Project is a publication of the Civilization Research Institute (CRI)]([The Consilience Project | The Consilience Project is a publication of the Civilization Research Institute (CRI)]([The Consilience Project | The Consilience Project is a publication of the Civilization Research Institute (CRI)]([The Consilience Project | The Consilience Project is a publication of the Civilization Research Institute (CRI)]([The Consilience Project | The Consilience Project is a publication of the Civilization Research Institute (CRI)]([The Consilience Project | The Consilience Project is a publication of the Civilization Research Institute (CRI)]([The Consilience Project | The Consilience Project is a publication of the Civilization Research Institute (CRI)](https://consilienceproject.org/))))))))) The Consilience Project, Daniel Schmachtenberger]</ref>, finding middle ground between different values coexisting in nonconflicting cooperative peace. <references/> ======Failure modes====== - preventing arms race multipolar traps<ref>[[- YouTube]([- YouTube]([- YouTube](https://www.youtube.com/watch?v===8XCXvzQdcug))) In Search of the Third Attractor, Daniel Schmachtenberger, 2022]</ref> where agents maximize local short term free energy minimizing objective function instead of global one by supporting shared free energy minimizing goal states, preventing power monopolies, decreasing power asymmetries thanks to common ground between agents<ref>[[- YouTube]([- YouTube]([- YouTube]([- YouTube](https://www.youtube.com/watch?v===odkks5F9ZMM)))) Collective intelligence and active inference, Rafael Kaufmann et al., 2021]</ref><ref>[https://www.researchgate.net/publication/356784803_Active_Inference_in_Modeling_Conflict Active Inference in Modeling Conflict, Daniel A. Friedman et al., 2022]</ref><ref>[[Frontiers | Active Inference and Cooperative Communication: An Ecological Alternative to the Alignment View]([Frontiers | Active Inference and Cooperative Communication: An Ecological Alternative to the Alignment View](https://www.frontiersin.org/articles/10.3389/fpsyg.2021.708780/full)) Active Inference and Cooperative Communication: An Ecological Alternative to the Alignment View, Rémi Tison et al., 2021]</ref><ref>[[Resonating Minds—Emergent Collaboration Through Hierarchical Active Inference | Cognitive Computation]([Resonating Minds—Emergent Collaboration Through Hierarchical Active Inference | Cognitive Computation](https://link.springer.com/article/10.1007/s12559-021-09960-4)) Resonating Minds—Emergent Collaboration Through Hierarchical Active Inference, Jan Pöppel et al., 2022]</ref><ref>[[[2210.13113] Interactive inference: a multi-agent model of cooperative joint actions]([[2210.13113] Interactive inference: a multi-agent model of cooperative joint actions](https://arxiv.org/abs/2210.13113)) Interactive inference: a multi-agent model of cooperative joint actions, Domenico Maisto et al., 2022]</ref><ref>[https://www.sciencedirect.com/science/article/abs/pii/B9780128176368000041 Chapter 4 - Active Inference in Multiagent Systems: Context-Driven Collaboration and Decentralized Purpose-Driven Team Adaptation, Georgiy Levchuk et al., 2019]</ref><ref>[https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7858259/ Cooperation and Social Rules Emerging From the Principle of Surprise Minimization, Mattis Hartwig, 2020]</ref> <references/> ======Common language====== - unifying common language of meaning and values, thinking about what unifes us instead of what polarizes us, keeping both collective unity but also individualistic specialized diversity<ref>[[- YouTube]([- YouTube](https://www.youtube.com/watch?v===hZpKdfbrd6o)) Rebuilding Society on Meaning, Joe Edelman et al., 2023]</ref><ref>[[- YouTube](https://www.youtube.com/watch?v===YRZIgYwCTJ4) Emergentism: The Religion That's Not a Religion, Brendan Graham Dempsey, 2023]</ref> - quantify common language by mapping out the massage passing dynamics (evolutionary dynamics of differently specialized interacting languages) between the different interacting ecosystem of Active Inference agents and the goal for global wellbeing is to minimize the dissonant friction between them thanks to inneficient communication and conflicting goal states <references/> ======Aligning artificial intelligence====== We can analyze existing artificial intelligence systems using the Active Inference framework by finding correct descriptive model of their black box behavior, or create novel AI systems using it, which leads to much more intepretability thanks to the architecture's bigger similarity with the brain's architecture<ref>[[Towards a computational phenomenology of mental action: modelling meta-awareness and attentional control with deep parametric active inference - PubMed]([Towards a computational phenomenology of mental action: modelling meta-awareness and attentional control with deep parametric active inference - PubMed]([Towards a computational phenomenology of mental action: modelling meta-awareness and attentional control with deep parametric active inference - PubMed]([Towards a computational phenomenology of mental action: modelling meta-awareness and attentional control with deep parametric active inference - PubMed]([Towards a computational phenomenology of mental action: modelling meta-awareness and attentional control with deep parametric active inference - PubMed]([Towards a computational phenomenology of mental action: modelling meta-awareness and attentional control with deep parametric active inference - PubMed]([Towards a computational phenomenology of mental action: modelling meta-awareness and attentional control with deep parametric active inference - PubMed]([Towards a computational phenomenology of mental action: modelling meta-awareness and attentional control with deep parametric active inference - PubMed](https://pubmed.ncbi.nlm.nih.gov/34457352/)))))))) Towards a computational phenomenology of mental action: modelling meta-awareness and attentional control with deep parametric active inference, Lars Sandved-Smith et al., 2021]</ref> which is more intuitive to us, and more freedom in tuning its specialization by parametrization.<ref>[[- YouTube](https://www.youtube.com/watch?v===skf3sOM-7WI) Python package for simulating active inference agents, Conor Heins et al., 2022]</ref><ref>[[[2306.04025] Designing explainable artificial intelligence with active inference: A framework for transparent introspection and decision-making]([[2306.04025] Designing explainable artificial intelligence with active inference: A framework for transparent introspection and decision-making](https://arxiv.org/abs/2306.04025)) Designing explainable artificial intelligence with active inference: A framework for transparent introspection and decision-making, Karl Friston et al., 2023]</ref><ref>[[[2212.01354] Designing Ecosystems of Intelligence from First Principles]([[2212.01354] Designing Ecosystems of Intelligence from First Principles](https://arxiv.org/abs/2212.01354)) Designing Ecosystems of Intelligence from First Principles, Karl Friston et al., 2022]</ref> For alignment, we can implement theory of mind and shared goal space in the architecture.<ref>[[- YouTube]([- YouTube]([- YouTube]([- YouTube](https://www.youtube.com/watch?v===odkks5F9ZMM)))) Collective intelligence and active inference, Rafael Kaufmann et al., 2021]</ref> We can use testing benchmarks in simulations regarding psychopathy, depressivity, paranoia, conflictness and so on.<ref>[[MACHIAVELLI]([MACHIAVELLI](https://aypan17.github.io/machiavelli/)) Do the Rewards Justify the Means? Measuring Trade-Offs Between Rewards and Ethical Behavior in the MACHIAVELLI Benchmark, Alexander Pan et al., 2023]</ref> Most promising method of interpreting and aligning current AI language models is automating it using AI.<ref>[[Introducing Superalignment]([Introducing Superalignment]([Introducing Superalignment](https://openai.com/blog/introducing-superalignment))) Introducing Superalignment, OpenAI, 2023]</ref><ref>[[Language models can explain neurons in language models]([Language models can explain neurons in language models]([Language models can explain neurons in language models]([Language models can explain neurons in language models](https://openai.com/research/language-models-can-explain-neurons-in-language-models)))) Language models can explain neurons in language models, OpenAI, 2023]</ref> <references/> =====Collective mental health=====