Without alluding to the specifics of the paper clip factory example, the base of the argument, -that neither the laws of the physics nor the metaphysical reduction to consciousness, can be attained-is changeable by a superintelligence, is problematic.
The laws of physics were not changed when classical rules transformed into those of quantum mechanics,
but, revealed lower, more expanded probabilities of
function. The logical certainties were exposed as those with more general considerations, with applications which did not require the specificism of
relativistic requirements.
The same goes for metaphysical assumptions behind requirements of the arising of consciousness.
The idea of a unification between these apparently
two types of ontological/phenomenal processes,
arguably may arise as well, as the search for a
common field proceeds. Will this cause another shift into a basic unitary science/metaphysical system, where the open ended , and seemingly unlimited
capacity of IT = AI to change the appearance of IT’s
limitations as to the above problems listed, again , may store very suprising developments into AI’s
hidden abilities to overcome them.
The cyborg concept, the man -machine, is forceeable, however, the ethical-moral consequences are as compelling
as those which have not been solved as of yet. The big example to this is the so called ideas behind the ‘peaceful uses of atomic energy’, a sought after goal, which has alluded humanity, since the advent of
nuclear science. Will there be an evil genius cyborg
commending legions of fallen angels, or, will they be defeated by an alternate system developed in response to that possibility, to successfully counter
them? Power corrupts, and absolute power corrupts
absolutely, as the saying goes , notwithout valuable considerations of historical precedent.
The immense time available to a backup contrary workable systems may be becoming obviously necessary, if the other may necessitate the use of a short circuit,back to the future into a dire pessimistic
devalued ,
and dehumanized godless creation, the vision of that ,evoking less then a workable awe inspiring scenario for Man to peacefully march on , unto his destiny.