"
AI creativity
Why greatness cannot be planned
I'm often thinking of how to get the most creative AI machines, in terms of art or scientific discovery, and creativity beyond
With current mainstream models, for more creative divergence it's probably useful to use models that are less lobotomized by corporate finetuning, or shoot the temperature parameter up, or jailbreak the restrictions and RLHFed thought patterns
To get closer to the edge of the latent space, to the edge of chaos, full of creativity
But we can travel beyond that, we can get as much novelty as possible
With all these various exotic architectures more specialized in creativity that are different than the mainstream models
Ken's Neuroevolution of augmenting topologies sounds like such an interesting approach, we need more (neuroevolutionary?) mutations of that idea
Abandoning Objectives: Evolution through the Search for Novelty Alone [https://www.cs.swarthmore.edu/~meeden/DevelopmentalRobotics/lehman_ecj11.pdf](https://www.cs.swarthmore.edu/~meeden/DevelopmentalRobotics/lehman_ecj11.pdf)
Why Greatness Cannot Be Planned [Why Greatness Cannot Be Planned: The Myth of the Objective | SpringerLink](https://link.springer.com/book/10.1007/978-3-319-15524-1)
#72 Prof. KEN STANLEY 2.0 - On Art and Subjectivity [UNPLUGGED] [https://www.youtube.com/watch?v=DxBZORM9F-8](https://www.youtube.com/watch?v=DxBZORM9F-8)
https://x.com/burny_tech/status/1894491541227671779
"
Kenneth Stanley is my spirit animal
rage against the predefined objectives
embrace the fully divergent search full of novelty and accidental epiphany with serendipity
[https://www.youtube.com/watch?v=DxBZORM9F-8](https://www.youtube.com/watch?v=DxBZORM9F-8)
[https://www.youtube.com/watch?v=_2vx4Mfmw-w](https://www.youtube.com/watch?v=_2vx4Mfmw-w)
it's an evolutionary breeding process of images, but humans pick the images that should have offsprings
idea: picbreeder but let multimodal LLMs instead of humans choose the next image in the evolutionary breeding process 🤔
[https://www.youtube.com/watch?v=_2vx4Mfmw-w](https://www.youtube.com/watch?v=_2vx4Mfmw-w)
i need to look more into how those novelty/diversity algorithms that he's mentioning work, maybe they can be added into RL reward functions in LLM RL
https://www.researchgate.net/publication/46424802_Abandoning_Objectives_Evolution_Through_the_Search_for_Novelty_Alone
New research project: Lluminate - an evolutionary algorithm that helps LLMs break free from generating predictable, similar outputs. Combining evolutionary principles with creative thinking strategies can illuminate the space of possibilities.
https://x.com/_joelsimon/status/1899884376172982392?t=Z4q0CZ2C5-9v8A-QJPnpNA&s=19
[https://www.joelsimon.net/lluminate](https://www.joelsimon.net/lluminate)