"We are now dangerously close to crossing a moral red line: the autonomous targeting of humans by machines," said United Nations Secretary-General Antonio Guterres and President of the International Committee of the Red Cross Mirjana Spoljaric in a joint statement.

"Negotiations must begin now to urgently adopt a legally binding instrument to regulate autonomous weapon systems with clear prohibitions and restrictions," they said.

States are meeting in Geneva on potential new rules next week amid mounting concerns over the role of AI-assisted semi-autonomous weapons that have been used in conflicts in Ukraine, Sudan, Gaza, and in Iran and the Gulf.

These discussions, ongoing since 2014, have made some progress but technology has also advanced.

Fully autonomous weapons are already in use by some armies, such as anti-missile systems on warships, but for now they are not known to be used against human targets.

Human rights groups also worry that AI-driven systems cannot be adequately predicted or controlled, raising the risk of fatal errors such as a failure to recognize an injured or surrendering soldier. And once such errors occur, it is harder to hold perpetrators to account in any future war crimes cases, they say.

"States must show political courage and move beyond incremental discussions towards decisive action", the joint statement said, calling for those talks to begin in November when a major conference is planned in Geneva.

Popular

Calls for reform grow ahead of Prabowo’s state address

Indonesia’s rare earth push faces low-content, costly extraction hurdles

Indonesia at 81: Whose sovereignty are we celebrating?