-Listen. Say you manage to create an artificial intelligence as smart as a human being.
-Okay.
-Except that machine intelligence can do something no human brain can ever do. It can rewrite itself. Improve its code. Make itself smarter. So this AI rewrites its own code, makes itself 5
Speedball – The Sound of the Universe