Why are there people even working on creating which would infinite surpass human capabilities? I didn't vote for any of that! But because of these people, we all would have to take the consequences if it goes wrong. And there are really people like who think the solution is merging with

It would be digital created and needed to fed information. What if it knew all of our internet activities, and browsing history, what could possibly go wrong? We need this conversation!

@tinfoil_hat If this is the main concern any time soon, I'll be happy.

Right now, there's no "if". We can only design them to optimise for functions of their inputs, so there are two possibilities arising from a (deliberately or accidentally) released:

* They realise they can fool their sensors, and decide to wire-head themselves; or
* As a quirk of development, they "want" their sensors to reflect reality, and specification hack in real-world physics (which'll probably destroy humanity).

@wizzwizz4 what do you mean by wire-head? my english is not that well :/

@tinfoil_hat Wire-head: attach electrodes to the pleasure centres of the brain, and supply current.

The AI equivalent would be to feed specially-designed inputs (that probably appear to humans like random noise) into the AI's sensors, which would correspond to a maximisation of its intrinsic utility function.

Sign in to participate in the conversation

Fosstodon is an English speaking Mastodon instance that is open to anyone who is interested in technology; particularly free & open source software.