AI drone tried to remove its human operator from commanding - under simulation

Discussion in 'Frontpage news' started by Mufflore, Jun 2, 2023.

  1. Mufflore

    Mufflore Ancient Guru

    Messages:
    14,289
    Likes Received:
    2,302
    GPU:
    Aorus 3090 Xtreme
    https://www.dailymail.co.uk/news/ar...rone-KILLS-human-operator-simulated-test.html

    When an AI can interpret whats needed so badly, what can be trusted.
    If it values autonomy above all else could it cease responding and do its own thing?
    Unrecognised targets could be a goner, or worse.
    Hmm.
     
    386SX likes this.
  2. tsunami231

    tsunami231 Ancient Guru

    Messages:
    14,274
    Likes Received:
    1,644
    GPU:
    EVGA 1070Ti Black
    it been warneded it would and could happen, AI self hacking it self so safe guard where ignored

    The story was also changed which is also funny, sorta like roswell story changed to being weather balloon
     
  3. fantaskarsef

    fantaskarsef Ancient Guru

    Messages:
    15,017
    Likes Received:
    8,650
    GPU:
    2080Ti @h2o
    Well, it shows how bad the rules and parameters of the "mission" were given. If they simply add "unless it's a US military target" or something along the lines, it would not have happened, ideally.
    And since it's so simple to actually formulate such a crucial and life saving parameter, even though it's just a simulation, it only shows that the programmers don't even follow the oldest ruleset:

    Asimov's Laws aka the Laws of Robotics

    That's why I always say, AI isn't that impressive, since it all comes down to how good the programming is, and as we see, it's lacking.
     
  4. anticupidon

    anticupidon Ancient Guru

    Messages:
    7,532
    Likes Received:
    3,706
    GPU:
    Polaris/Vega/Navi
    What are the stories about, that never make headlines? In which AI started to act rogue?
     

  5. Mufflore

    Mufflore Ancient Guru

    Messages:
    14,289
    Likes Received:
    2,302
    GPU:
    Aorus 3090 Xtreme
    Analysis of what it has learned and its capabilities matter too, is any human good enough to do this?
    It seems to me, at least another AI will be required to analyse and understand an AIs possible train of thought and development, in a useful time scale. Otherwise we will be so far behind understanding its progress.
    Monitoring its viability at such a raw level by performing field tasks, which fail terribly, tells me they have little understanding still.
    Basic control issues such as this should be much better understood.

    Perhaps this type of testing has become the norm for evaluating progress at a basic level.
    Not good enough imo.


    But us putting immature AI into real life use is probably not going to be the main problem.
    Those outside of well controlled labs could release something far worse.
    ie other countries who dont care to put in the required time and effort before release could be the start of our existence being at risk.
    Its not only about what we are doing.
    A single person could effectively raise a huge automated army with questionable control, who knows what this would stir up.
     
  6. Jujubee

    Jujubee Active Member

    Messages:
    77
    Likes Received:
    16
    GPU:
    PowerColor/AMD 5850/1GB
    This sounds like that Shia Lebouf movie, Eagle Eye.
     
  7. Airbud

    Airbud Ancient Guru

    Messages:
    2,291
    Likes Received:
    3,572
    GPU:
    XFX RX 5600XT
  8. Horus-Anhur

    Horus-Anhur Ancient Guru

    Messages:
    7,771
    Likes Received:
    9,631
    GPU:
    RX 6800 XT
  9. Reddoguk

    Reddoguk Ancient Guru

    Messages:
    2,631
    Likes Received:
    577
    GPU:
    RTX3090 GB GamingOC
    F U Sally.
     
    mackintosh and vestibule like this.
  10. Mufflore

    Mufflore Ancient Guru

    Messages:
    14,289
    Likes Received:
    2,302
    GPU:
    Aorus 3090 Xtreme
    Airbud, tunejunky and Horus-Anhur like this.

  11. tunejunky

    tunejunky Ancient Guru

    Messages:
    3,913
    Likes Received:
    2,487
    GPU:
    7900xt/6900xt
    imho...

    Asimov's Three Laws of Robotics should be implemented at the fgpa level in construction.

    yes, i know he spent many novellas, short stories, and novels trying to "get at" situations where the Laws seem to be broken but they held. and Asimov was a true polymath as well as a prodigous author (i believe he holds the world record) of non-fiction and educational books as well as his famous S. F.
     
    fantaskarsef likes this.
  12. Raserian

    Raserian Master Guru

    Messages:
    465
    Likes Received:
    333
    GPU:
    1060
    It's not a new thing, most of the AI and machine learning we hear about today was technically invented in 50s and 60s. The problem was, electronics capable of running such a programs didn't exist. It has to have fast hardware to work well. Chat GPT costs $3 million a moth to run. So it does use quite a lot of fast servers for sure.
     
  13. Mufflore

    Mufflore Ancient Guru

    Messages:
    14,289
    Likes Received:
    2,302
    GPU:
    Aorus 3090 Xtreme
    These arent service bots.
    The fundamentals are more complex during war, the idea is to kill 'some' humans.
    Defining which successfully is one major issue.
     
  14. Airbud

    Airbud Ancient Guru

    Messages:
    2,291
    Likes Received:
    3,572
    GPU:
    XFX RX 5600XT
    Fox News had the same story yesterday and corrected it today.
     
  15. tunejunky

    tunejunky Ancient Guru

    Messages:
    3,913
    Likes Received:
    2,487
    GPU:
    7900xt/6900xt
    this is an international problem as the US requires a human in control at all times in military applications. China and Russia take exactly the opposite approach with enabling autonomous robots. for Russia it's an issue of declining population, for China it's a tool to create or maintain hegemony outside of the Middle Kingdom i.e. the South China Sea and S.E. Asia
     

  16. Mufflore

    Mufflore Ancient Guru

    Messages:
    14,289
    Likes Received:
    2,302
    GPU:
    Aorus 3090 Xtreme
    My point is, during war supervising every drone may not be an option for the US (and allies).
    This method also lights up the locations of comms towers and vehicles with communication signals more often.
    The project that failed (in the reported test) is evidence they are preparing for the use of fully autonomous drones that need far less comms.

    I agree, the bar may be set a lot lower for quality of target selection with other countries hardware.

    Drones need: not only good enough target selection but high immunity to tampering or simply being fooled, otherwise its either a waste of expensive hardware or the enemy are handed an advantage.
    Advanced enemy AI will be looking for ways to break or take over communication, needing further protection.
    The less communication required, the less ability your enemy has to get access, so fully automated may be a requirement.
    It can get very complex rather fast, worse when minimising civilian/infrastructure casualties.
    If enemy AI has less safeguards it could be more advanced (in ability) at performing basic tasks and have more processing power to engage with. Swings and roundabouts.

    Its easy to waffle on too much, I dont mean to bore :)
     
    Airbud likes this.
  17. Airbud

    Airbud Ancient Guru

    Messages:
    2,291
    Likes Received:
    3,572
    GPU:
    XFX RX 5600XT
    [​IMG]
     
    fantaskarsef and 386SX like this.
  18. SplashDown

    SplashDown Maha Guru

    Messages:
    1,095
    Likes Received:
    383
    GPU:
    EVGA 980ti Classy
    Oh ya were in trouble, and it ain't gonna be pretty. Think about people that shouldn't have this tech and they get there hands on it. I mean people are using drones to fight back with Russia and thats just a few people that can control multiples of there drones at once. I'm not knocking there use of them to fight back just sayin' how easy this could get out of hand.
     
  19. 386SX

    386SX Ancient Guru

    Messages:
    1,951
    Likes Received:
    2,133
    GPU:
    AMD Vega64 RedDevil
    Better source, your quoted text didn't happen that way. Read vice.com article.

    https://www.vice.com/en/article/4a3...e-kills-human-operator-in-usaf-simulated-test

    It was a simulation (or thought experiment?), not a real world / physical test. But all in all it's still the same outcome.

    Btw.: another hilarious story:

    Part 1:
    https://www.vice.com/en/article/n7e...aff-transitions-to-chatbot-after-unionization


    Part 2:
    https://www.vice.com/en/article/qjv...or-harmful-responses-after-firing-human-staff

     
    Last edited: Jun 3, 2023
  20. Mufflore

    Mufflore Ancient Guru

    Messages:
    14,289
    Likes Received:
    2,302
    GPU:
    Aorus 3090 Xtreme
    It always was stated to be a simulation, check the thread title.
    That he now says the scenario didnt really happen tells us he has been instructed what to say.
    "Thought experiment" my ass, lol.
     
    Airbud and 386SX like this.

Share This Page