Techdirt's think tank, the Copia Institute, is working with the Trust & Safety Professional Association and its sister organization, the Trust & Safety Foundation, to produce an ongoing series of case studies about content moderation decisions. These case studies are presented in a neutral fashion, not aiming to criticize or applaud any particular decision, but to highlight the many different challenges that content moderators face and the tradeoffs they result in. Find more case studies here on Techdirt and on the TSF website.

Content Moderation Case Study: Twitch Allows Users To Enable Emote-Only Chats (2016)

from the can't-be-a-troll-when-you-can-only-emote dept

Summary: Dealing with content moderation during real-time chats always presents an interesting challenge. Whether it’s being able to police language in real time, or dealing with trolling and harassment, chat has always been one of the most difficult content moderation challenges going back to its earliest days.

In 2016, Twitch decided to enable a new feature for its users: an “emote-only” mode for the chat. Emotes, on Twitch, are basically a custom set of what are more traditionally called emoji on most other websites/platforms. With Twitch, though, they are almost entirely custom, and users at certain levels are able to add their own.

Emote-only is one of a bunch of different modes and features that Twitch streamers can use to try to tame their chat. Twitch itself suggests using this as a way to stop harassment in the chats.

Turning on and off the feature is a choice for the streamer themselves, rather than Twitch. It’s just one of a few tools that Twitch users can enable to deal with potentially harassing behavior in the chat alongside their streams.

Decisions for Twitch:

  • What tools should you provide to users to deal with abusive or harassing chat participants?
  • Do features like this give more power to Twitch users, or are they offloading moderation demands from the company itself?
  • Should there be any exceptions to emote-only mode?
  • Are there times where a custom emote would be considered a policy violation because it takes on a harassing meaning in a certain context? 
  • What sort of emote review processes should be put in place?
Questions and policy implications to consider:
  • Rather than offering entirely binary options (allow/disallow) are there more creative alternatives for dealing with harassing behavior?
  • Are there ways in which even emote-only mode might be abused for harassment?
Resolution: Emote-only mode was launched quietly with little fanfare from Twitch in 2016. While it may not be widely used, many streamers do find it useful. It is not just used for stopping harassment, but sometimes to stop people in a chat from revealing spoilers or other information that may impact what they’re streaming (such as information about the video game they are playing).

Originally posted to the Trust & Safety Foundation website.

Hide this

Thank you for reading this Techdirt post. With so many things competing for everyone’s attention these days, we really appreciate you giving us your time. We work hard every day to put quality content out there for our community.

Techdirt is one of the few remaining truly independent media outlets. We do not have a giant corporation behind us, and we rely heavily on our community to support us, in an age when advertisers are increasingly uninterested in sponsoring small, independent sites — especially a site like ours that is unwilling to pull punches in its reporting and analysis.

While other websites have resorted to paywalls, registration requirements, and increasingly annoying/intrusive advertising, we have always kept Techdirt open and available to anyone. But in order to continue doing so, we need your support. We offer a variety of ways for our readers to support us, from direct donations to special subscriptions and cool merchandise — and every little bit helps. Thank you.

–The Techdirt Team

Filed Under: content moderation, emotes, harassment
Companies: twitch

Reader Comments

Subscribe: RSS

View by: Thread

  1. identicon
    Anonymous Coward, 8 Feb 2021 @ 7:31am

    Re: Re:

    To go with a lame but caught on term - isn't that just a case of "milkshake duck"? Something features someone doing something fun and then it comes out that they are a terrible person in some way overshadowing the original context.

    Said term comes from a twitter joke describing the phenomenon with a joke about a duck drinking a milkshake and then finding out the duck was racist.

Add Your Comment

Have a Techdirt Account? Sign in now. Want one? Register here

Subscribe to the Techdirt Daily newsletter

Comment Options:

  • Use markdown. Use plain text.
  • Remember name/email/url (set a cookie)

Follow Techdirt
Essential Reading
Techdirt Insider Chat
Recent Stories


Email This

This feature is only available to registered users. Register or sign in to use it.