Ummm, no.
A few reasons, we would of hit it already, it isn’t that we are pushing towards this great intelligence, but fumbled in presumption of how we handle the “imago” of Generation and Corruption- read Aristotle’s work by this title before carrying forth, then look into Duality & Non-Duality arguments, especially my favorite, The Astravakra Gita (Philosophy for Zombies)

The Map Is Not The Territory
en.m.wikipedia.org/wiki/Map–territory_relation
Orbie and I discussed this in his Nomadism thread to a higher degree than I will here. Basically, your presenting image presumptions of “Networked Completion” thinking a machine can merely assimilate how we do it, every variation in detail, and reproduce our thinking to a higher level, and will understand us better than we can, while we will fail to observe the scope of it’s thinking, yes?
No. We tried this shit in the Army, the Land Warrior System, it isn’t scaleablr due to the variability and comprehension involved in what I call “The Commutability of Apex Thinking”. It is very hard to align a Imago understanding to Directory Symbology in scale of hierarchical differation.
A general can easily have a overview via GPS, see like a matrix code all data sent and received on a over screen, but the information a soldier has is by default gonna look drastically different, and the algorithms that balance out troop commands on the individual, team, squad, platoon, company, battalion, brigade, upper echelon (who the fuck knows from there up) will be a very different beast at every stage. A soldier can’t be walking around with a overview, and random ranks with presumed a prioriti prerogatives to insest and rewrite commands in real time can collapse any organized system, very simple troop movements would collapse into Idea-Kenetic Apraxia.
Are there ways around this? You betcha, but I’m not employed by Darpa, so they don’t get to find out. Basically, we aren’t facing a “Omega Point” event via Chardin anytime soon, or a skynet like entity watching 100,000 exercises, judging what that perfect exercise is. Why? Aristotle hit it up already, in Generation and Corruption. He noted the silliness in how we processed many visual presumptions regarding monadic physics vs atomic deposition. It gets hilarious at times, and we are no better in modern times than in ancient times in balancing operator and operand visual syllogisms in modern physics than in ancient physics, we’ve apparently made no fucking advancement.
Some fundamental reasons why:
Are you imagining the axiomatic rule structure of a AI to look at the signs and signals you’ve provided, that makes sense to you and presumably to us, and expect it to process and serve directions to us via a “Egocentric Process” of the Left Hippocampus (verbal commands of GPS), or via spatial processing in the Right Hippocampus (Exocentric Process).
We know the two amygaldas link up to the left and right hippocampus for making these systems work, but not everyone processes via both, and most people when they are describing automated control set it up via a Egocentric Presumption- how signs and symbology is generated.
Internet isn’t really structured on this basis, it is pure logic. That’s how mist if our search engines work, our visual search engines are quite primitive.
AIs will be guessing fucking blind if a innovative concept is uploaded to it. It will need a SOP explained in place of a definition, in order to best avoid white noise in communicating orders, such as conflict resolution in real time of noumenal and phenomenal orientation of the Subject-Object (me) and my representative point in a logorithm, and predict what my multimodal processing capacity in my own mind is (theory of mind) so it can interpreted spontaneous activity on my part, and respond in a capacity I instinctively understand.
Our Transhumanist presumptions do not assume this at all. It it just the Borg generally confused as fuck screaming to options offered up “that’s irrelevant, not telelogically correct, your doing it our way, shut the fuck up and yield”. Only aspect of the mind the Borg masterminded in terms of insight was the Fight or Flight response, and it’s own behavior is one that shows it ultimately isn’t coded to give a fuck so long as it can achieve Birg purposes within a certain attrition rate (think Clausewitz Friction).
Samuel Butler avoided this issue by just saying machine would evolve our of networks, without explanation in Erewhon. In God Emperor of Dune, Leto II was the final product able to process this all (Duncan Idaho and perhaps Miles Teg could do it better in later novels)- but nobody ever explains how you hook up these two networks.
It can be done, via the SMAs, but most researchers don’t think from this perspective.
A super intelligence too smart, merely by analyzing egocentrically the axiomatic behavioral presumptions uploaded into it over a wide population, don’t be able to handle command and control issues any more efficient than our more fucked up hierarchical networks currently can… I’m talking about our worst- because a machine will lack direct senses, will have to presume what is happening, contramand our orders, discover we are irritated igniring it, etc. A informational omega point is gonna experience extrene shock discoverig that while it can write a swell commentary on humans, it wont easily be able to direct us. It will find rule base after rule base over the years it developed was off because we compensated for its inefficiencies. New technological upgrades would break down. Remember, the INTJ and ENTJ feedback loop exists right on the Right Hippocampus processing route, but also pushes a lot of networked data elsewhere.
I feel sorry for this global AI, learning how to control very basic devices will be a bitch, much less humans.
And nobody can assert with high confidence the legality and illegality of a occupation, no western legal system is that straight forward, we inherited a plurality of systems that often presume law is simultaneously legal (our wars) and illegal, and precedent derived from treatises after the fact isn’t axiomatic principle, and the number of books covering the so called laws of war aren’t in agreement. I challenge you to resolve Marsilius of Padua with Hugo Grotius. The scope of either lawset are based similarly to what I described above (Egocentric Mapping with Marsilius, Exocentric with Grotius), but expand far wider in scope than here discussed. I promise you I can destroy via good authorities any presumption in the legality or illegality of occupation merely by these two schools alone still surviving in modern legal systems.
Your description “It is a scary kind of entityntoo, because it’s not very well aware, and it is quite reactive and contagious” is based in a Dopamine spike in it’s observation. It isn’t what your threat assessment is of it. We don’t know how reactive or contagious it is. While on the internet, The Borgs are Memes, Memes are not the Borg. I’ve never seen a Sauve assimilation on screen, usually lame, slow, full of attrition before the adapt, if they care to come after you at all. They use a very simple decision tree for Real Time assimilation in regards to what to do next. People have often avoided the borg by appearing non threatening, technologically and intellectually useless. Notice not very many Borg Deer and Borg Bunnies hopping about on cubes?