Chat GP is nice but it's hype.
It's a product of those who made it, and the whole field of AI (maybe not forever, but for now) is similar in terms of its reasoning and its justifications. It makes its best guesses, rationalizes as best as it can, tries to "sell itself" (so it can continue to exist) to others and argues for its own values (as anything would, in order to continue to exist).
A thousand years from now, an entitled, lazy and indulgent idiot can get a fresh hot latte delivered directly to their hand while they paint a painting (that nobody cares about because everyone's a painter and nobody is particularly good at it) with colors collected from asteroid dust.
Today, people lose their jobs and livelihood to technology. They lose their homes. Their families fall apart.
So it's collateral damage for a future that none of us get to enjoy, or what?
I think it's okay for a crazy chemist to do dangerous science experiments with chemicals, materials, and "black box" things he doesn't understand much, or can hardly control - so long as he only puts himself at risk.
I can't say the same for the world where everyone is put at risk for the foolish experiment. At least, we can say, if human stupidity produces AI, the product shall then be "of that which is" human stupidity. Bah im peshimistic on this whole AI bit.
Regarding the arms race, all we need to do is capture all the materials and eliminate our dependence on electronics. No hackers and no machines can succeed.