The idea of a self-improving AI doesn't usually take into account that designing a smarter version of yourself is fucking difficult, no matter how smart you get. Even worse: it might be that it gets more difficult to make a smarter version of yourself the smarter you get. The intelligence curve might be linear, logarithmic or even asymptotic, instead of exponential.
zorblax wrote (edited )
The idea of a self-improving AI doesn't usually take into account that designing a smarter version of yourself is fucking difficult, no matter how smart you get. Even worse: it might be that it gets more difficult to make a smarter version of yourself the smarter you get. The intelligence curve might be linear, logarithmic or even asymptotic, instead of exponential.