害羞草研究所

Skip to content

AI voice cloning getting mixed reviews in the world of video games

Some fear that AI voices could replace all but the most famous human actors if big studios have their way
web1_20240219050240-65d330ebdf90154b51516ea9jpeg
Voice actor Sarah Elmaleh poses for a photo in Los Angeles on Thursday, Feb. 1, 2024. Recent years marked a golden age for making an acting career in video games, but now some studios are looking to use artificial intelligence to clone actors害羞草研究所 voices. Voice actors like Elmaleh, who played the Cube Queen in Fortnite, are taking a cautious approach to making sure such arrangements can help actors rather than replace them. (AP Photo/Richard Vogel)

If you are battling a video game goblin who speaks with a Cockney accent, or asking a gruff Scottish blacksmith to forge a virtual sword, you might be hearing the voice of actor Andy Magee.

Except it害羞草研究所檚 not quite Magee害羞草研究所檚 voice. It害羞草研究所檚 a synthetic voice clone generated by artificial intelligence.

As video game worlds get more expansive, some game studios are experimenting with AI tools to give voice to a potentially unlimited number of characters and conversations. It also saves time and money on the 害羞草研究所渧ocal scratch害羞草研究所 recordings game developers use as placeholders to test scenes and scripts.

The response from professional actors has been mixed. Some fear that AI voices could replace all but the most famous human actors if big studios have their way. Others, like Magee, have been willing to give it a try if they害羞草研究所檙e fairly compensated and their voices aren害羞草研究所檛 misused.

害羞草研究所淚 hadn害羞草研究所檛 really anticipated AI voices to be my break into the industry, but, alas, I was offered paid voice work, and I was grateful for any experience I could get at the time,害羞草研究所 said Magee, who grew up in Northern Ireland and has previously worked as a craft brewery manager, delivery driver and farmer.

He now specializes in voicing a diverse range of characters from the British Isles, turning what he used to consider a party trick into a rewarding career.

AI voice clones don害羞草研究所檛 have the best reputation, in part because they害羞草研究所檝e been misused to create convincing deepfakes of real people 害羞草研究所 from to the 害羞草研究所 saying things they never said. Some early attempts by independent developers to add them to video games have also been poorly received, both by gamers and actors 害羞草研究所 not all of whom consented to having their voices used in that way.

Most of the big studios haven害羞草研究所檛 yet employed AI voices in a noticeable way and are still in ongoing negotiations on how to use them with , which also represents game performers. Concerns about how movie studios will use last year害羞草研究所檚 strikes by the Screen Actors Guild-American Federation of Television and Radio Artists but when it comes to game studios, the union is showing signs that a deal is likely.

Sarah Elmaleh, who has played the Cube Queen in Fortnite and numerous other high-profile roles in blockbuster and indie games, said she has 害羞草研究所渁lways been one of the more conservative voices害羞草研究所 on AI-generated voices but now considers herself more agnostic.

害羞草研究所淲e害羞草研究所檝e seen some uses where the (game developer害羞草研究所檚) interest was a shortcut that was exploitative and was not done in consultation with the actor,害羞草研究所 said Elmaleh, who chairs SAG-AFTRA害羞草研究所檚 negotiating committee for interactive media.

But in other cases, she said, the role of an AI voice is often invisible and used to clean up a recording in the later stages of production, or to make a character sound older or younger at a different stage of their virtual life.

害羞草研究所淭here are use cases that I would consider with the right developer, or that I simply feel that the developer should have the right to offer to an actor, and then an actor should have the right to consider that it can be done safely and fairly without exploiting them,害羞草研究所 Elmaleh said.

SAG-AFTRA has already made a deal with one AI voice company, Replica Studios, announced last month at the CES gadget show in Las Vegas. The agreement 害羞草研究所 which described as 害羞草研究所渁 great example of AI being done right害羞草研究所 害羞草研究所 enables major studios to work with unionized actors to create and license a digital replica of their voice. It sets terms that also allow performers to opt out of having their voices used in perpetuity.

害羞草研究所淓veryone says they害羞草研究所檙e doing it with ethics in mind,害羞草研究所 but most are not and some are training their AI systems with voice data pulled off the internet without the speaker害羞草研究所檚 permission, said Replica Studios CEO Shreyas Nivas.

Nivas said his company licenses characters for a period of time. To clone a voice, it will schedule a recording session and ask the actor to voice a script either in their regular voice or the voice of the character they are performing.

害羞草研究所淭hey control whether they wish to go ahead with this,害羞草研究所 he said. 害羞草研究所淚t害羞草研究所檚 creating new revenue streams. We害羞草研究所檙e not replacing actors.害羞草研究所

It was Replica Studios that first reached out to Magee about a voice-over audio clip he had created demonstrating a Scottish accent. Working from his home studio in Vancouver, British Columbia, he害羞草研究所檚 since created a number of AI replicas and pitched his own ideas for them. For each character he害羞草研究所檒l record lines with distinct emotions 害羞草研究所 some happy, some sad, some in battle duress. Each mood gets about 7,000 words, and the final audio dataset amounts to several hours covering all of a character害羞草研究所檚 styles.

Once cloned, a paid subscriber of Replica害羞草研究所檚 text-to-speech tool can make that voice say pretty much anything 害羞草研究所 within certain guidelines.

Magee said the experience has opened doors to a range of acting experiences that don害羞草研究所檛 involve AI 害羞草研究所 including a role in the upcoming strategy game Godsworn.

Voice actor Zeke Alton, whose credits include more than a dozen roles in the military action franchise, hasn害羞草研究所檛 yet agreed to lending his voice to an AI replica. But he understands why studios might want them as they try to scale up game franchises such as Baldur害羞草研究所檚 Gate where players can explore vast, open worlds and encounter elves, warlocks or aliens at every corner.

害羞草研究所淗ow do you populate thousands of planets with walking, talking entities while paying every single actor for every single individual? That just becomes unreasonable at a point,害羞草研究所 said Alton, who also sits on the SAG-AFTRA negotiating committee for interactive media.

Alton is also open to AI tools that reduce some of the most physically straining work in creating game characters 害羞草研究所 the grunts, shouts and other sounds of characters in battle, as well as the movements of jumping, striking, falling and dying required in motion-capture scenes.

害羞草研究所淚害羞草研究所檓 one of those people that is not interested so much in banning AI,害羞草研究所 Alton said. 害羞草研究所淚 think there害羞草研究所檚 a way forward for the developers to get their tools and make their games better, while bringing along the performers so that we maintain the human artistry.害羞草研究所





(or

害羞草研究所

) document.head.appendChild(flippScript); window.flippxp = window.flippxp || {run: []}; window.flippxp.run.push(function() { window.flippxp.registerSlot("#flipp-ux-slot-ssdaw212", "Black Press Media Standard", 1281409, [312035]); }); }