AI with added values

Photo by Jon Tyson

A common refrain: what if AI went rogue? How do we instil human ethical ideas and values in a robot? The desire to do so is known as ‘alignment’.

This links to talk of whether AI can ever gain consciousness, or whether it can only ever perform tasks – however complex – for us. Mustafa Süleyman, the boss at Microsoft AI, has this to say:

“They are sequence completion engines, internally hollow, designed to follow instructions, and accomplish goals set by humans.”

That should put us at our ease. If they can only accomplish goals set by humans, then we can indeed build them to be good.

Keeping AI aligned

Alignment is a field which aims to build human ethical ideas and principles into AI. In other words, it aims to keep it on track with what humans value.

But what about when humans are morally deviant, which is also entirely human? Should AI mirror that?

Humans have been attempting to instil ethical and moral values in other humans for a long time, with patchy results. Do we think AI will be better than us at that as well, or will it merely reflect how we ourselves are?

AI is not yet conscious and therefore has no inherent hidden layers of motivation and impulse, but what about the humans telling us about AI? What about the tech bosses, flipping between warnings and reassurance?

If we can assume that the leaders of the top AI firms are indeed humans then we can assume that what they say may be driven in part of personal desires – for recognition, for fame, for profit – and an imperfect moral and ethical consciousness.  

Then again, maybe they aren’t human? Can you know for certain that you aren’t already being led by AI? In which case, you better hope it’s not so much aligned with humans, but instead rather ethically better.

Read more? AI stole my em dash

Share

Response

  1. William Beeny avatar
    William Beeny

    Hi Nat, good provocative piece! I have been in AI for one year now and everyday I realize how little I understood AI until that moment (and I have several a day!).
    A South African friend of mine who is based in Dubai told me something back in Feb that really hit home the last few weeks. He said, treat AI like a small kid, giving rules, context and letting it understand how you make decisions and why.

    As we are building Agentic AI systems for the finance industry, training multiple agents on small tasks, it came to light that as good as vibe coding is, if you do not have the system architecture experience and a good knack for psychology your outcomes will not be to the level you expect. Anthropic has gone further hiring
    1) Religious scholars: Consulted Christian, Jewish, Sikh, and other religious thinkers about morality, virtue, and ethical decision-making.
    2) Psychologists: Expanded discussions to psychological questions, including AI behavior, relationships, and possible AI welfare.
    3) Philosophers: Helped examine moral reasoning, autonomy, honesty, and competing ethical obligations.
    4) Internal researchers: Worked on translating these principles into model training and evaluations.

    I don’t know and would not risk a prediction of where AI will be in 5 years (for sure in robotics) but it will for sure change the world and there will be a big gap between those who know how to use it and those who do not.

Leave a Reply

Your email address will not be published. Required fields are marked *