Customize Consent Preferences

We use cookies to help you navigate efficiently and perform certain functions. You will find detailed information about all cookies under each consent category below.

The cookies that are categorized as "Necessary" are stored on your browser as they are essential for enabling the basic functionalities of the site. ... 

Always Active

Necessary cookies are required to enable the basic features of this site, such as providing secure log-in or adjusting your consent preferences. These cookies do not store any personally identifiable data.

No cookies to display.

Functional cookies help perform certain functionalities like sharing the content of the website on social media platforms, collecting feedback, and other third-party features.

No cookies to display.

Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics such as the number of visitors, bounce rate, traffic source, etc.

No cookies to display.

Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.

No cookies to display.

Advertisement cookies are used to provide visitors with customized advertisements based on the pages you visited previously and to analyze the effectiveness of the ad campaigns.

No cookies to display.

admin
Pinned April 4, 2023

<> Embed

@  Email

Report

Uploaded by user
The AI Seinfeld show ‘Nothing, Forever’ is back on Twitch
<> Embed @  Email Report

The AI Seinfeld show ‘Nothing, Forever’ is back on Twitch

AI Seinfeld was surreal fun until it called being trans an illness

 
Will Shanklin
Will Shanklin

Twitch has banned “Nothing, Forever,” the AI-generated Seinfeld stream, for at least 14 days following a transphobic and homophobic outburst. It’s the latest example of “hate in, hate out” when AI chatbots are trained on offensive content without adequate moderation.

Like Seinfeld, “Nothing, Forever” rotates between standup bits and scenes in the comedian’s apartment (he’s called “Larry Feinberg” in the AI version). As first reported by Vice, during one of the recent AI-scripted standup acts, the Seinfeld counterpart suggested that being transgender is a mental illness. In what almost seemed like an awareness of the material’s offensiveness, the AI comedian quickly added, “But no one is laughing, so I’m going to stop. Thanks for coming out tonight. See you next time. Where’d everybody go?” 

Although Twitch hasn’t confirmed that the “joke” was the reason for the ban, the stream was removed soon after the problematic segment aired. The program’s creators blame the hurtful rant on a model change that inadvertently left the stream without moderation tools.

“Earlier tonight, we started having an outage using OpenAI’s GPT-3 Davinci model, which caused the show to exhibit errant behaviors (you may have seen empty rooms cycling through),” a staff member wrote on Discord. “OpenAI has a less sophisticated model, Curie, that was the predecessor to Davinci. When davinci started failing, we switched over to Curie to try to keep the show running without any downtime. The switch to Curie was what resulted in the inappropriate text being generated. We leverage OpenAI’s content moderation tools, which have worked thus far for the Davinci model, but were not successful with Curie. We’ve been able to identify the root cause of our issue with the Davinci model, and will not be using Curie as a fallback in the future. We hope this sheds a little light on how this happened.”

The AI Seinfeld show 'Nothing, Forever' is back on Twitch | DeviceDaily.com

The team elaborated in another Discord post (via The Verge). “We mistakenly believed that we were leveraging OpenAI’s content moderation system for their text generation models. We are working now to implement OpenAI’s content moderation API (it’s a tool we can use to verify the safeness of the content) before we go live again, and investigating secondary content moderation systems as redundancies.”

Although the team sounds genuinely apologetic, stressing that the bigoted rant was a technical error that doesn’t represent their views, it reiterates the importance of consistent AI moderation. You may remember Microsoft’s Twitter chatbot, which only lasted about 16 hours after users taught it to spew conspiracy theories, racist views and misogynistic remarks. Then there was the bot trained entirely on 4chan, which turned out exactly as you’d expect. Whether “Nothing, Forever” returns or not, the next time a team of developers is faced with a choice between avoiding unexpected downtime and making sure those filters are in place, pick the latter.

Engadget is a web magazine with obsessive daily coverage of everything new in gadgets and consumer electronics   

(18)