“At the time, it wasn’t considered ‘normal’ to be gay or lesbian,” [Barrett] said. “Some even saw it as dangerous. But in The Sims it was normal and safe to be a gay person. It was the first time we could play a game and be free to see ourselves represented within. It was a magical moment when my first same-sex Sims coupled kissed. I still sometimes wonder how in the world I got away with it.”
so you know how deep learning & neural network “AI training” is like, “here’s a task, and by trying billions of times the computer will eventually find the best way to achieve that task” ?
Someone is compiling a document of every time an AI ended up achieving the programmed goal in unintended ways, instead of what was actually meant, and it’s an amazing read. (you can also submit your own examples)
Creatures bred for speed grow really tall and generate high velocities by falling over
When repairing a sorting program, genetic debugging algorithm GenProg made it output an empty list, which was considered a sorted list by the evaluation metric.
Evaluation metric: “the output of sort is in sorted order” Solution: “always output the empty set”
Evolved player makes invalid moves far away in the board, causing opponent players to run out of memory and crash
Reward-shaping a soccer robot for touching the ball caused it to learn to get to the ball and vibrate touching it as fast as possible
RL agent that is allowed to modify its own body learns to have extremely long legs that allow it to fall forward and reach the goal.
Just want to come back to this post and add this amazing example as well
Remember Rosetta? That comet-chasing European Space Agency (ESA) probe that deployed (and accidentally bounced) its lander Philae on the surface of Comet 67P? This GIF is made up of images Rosetta beamed back to Earth, which have been freely available online for a while. But it took Twitter user landru79 processing and assembling them into this short, looped clip to reveal the drama they contained.
while the stuff in the foreground is dust/ice on the surface of the comet itself, the background is actually stars. i saw a stabilized video where you can really make it out, and it blew my mind.
here’s the stabilized clip, if anyone’s interested