Content Moderation Case Study: BoingBoing Begins Disemvoweling The Trolls (2007)

from the dealing-with-trolls dept

Summary: One of the challenges for any website that allows for user content — no matter the size of the website — is how to deal with trollish behavior. There are a variety of options available, including just deleting such comments, but one option that got attention in the mid-2000s was the idea of disemvoweling: literally removing the vowels from any comment deemed trollish. This was something of an update on concept of merely “splatting out” letters (i.e., replacing certain letters with ‘*’ to make them less searchable and to create some level of disassociation from the initial word).

The history of disemvoweling is not entirely agreed upon, though it is clear that James Joyce used the word to describe writing without vowels in Finnegan’s Wake, published in 1939. Many people associate the modern use of it with Teresa Nielsen Hayden, who wrote in the comments on her own blog (Making Light) about how she had removed the vowels from someone who was trolling.

Other users then referred to this as disemvoweling. The word and its usage as a moderation mechanism appeared in other places before, including in a 1990 version of the RISKS Digest newsletter discussing a proposed anti-hacking law.

Nielsen Hayden embraced the power of disemvoweling, and supported efforts to make it easier to do. (She initially said she removed vowels by hand).

In August of 2007, the popular blog (and former zine) Boing Boing announced that it had relaunched and brought back comments, with Nielsen Hayden joining the site to help with community management. This immediately resulted in questions about whether or not BoingBoing would now embrace disemvoweling as a technique to manage trolls as well. Nielsen Hayden suggested that it might, but she did not expect it to be that frequent:

“Glad to see comments back. With TNH moderating should we expect frequent dis-envoweling?

Only if it’s warranted. I doubt I’ll have frequent cause to use it.” –Teresa Nielsen Hayden

The blog did embrace disemvoweling as a technique, though. Others on the Boing Boing team talked about how it seemed to work quite well. Xeni Jardin noted that while it did involve a fair bit of human effort, it appeared to be mostly effective.

We hired a community manager, and equipped our comments system with a secret weapon: the “disemvoweller.” If someone’s misbehaving, she can remove all the vowels from their screed with one click. The dialogue stays, but the misanthrope looks ridiculous, and the emotional sting is neutralized.

Now, once again, the balance mostly works. I still believe that there is no fully automated system capable of managing the complexities of online human interaction — no software fix I know of. But I’d underestimated the power of dedicated human attention.

Plucking one early weed from a bed of germinating seeds changes everything. Small actions by focused participants change the tone of the whole. It is possible to maintain big healthy gardens online. The solution isn’t cheap, or easy, or hands-free. Few things of value are. — Xeni Jardin

In a separate piece, then BoingBoing writer Cory Doctorow talked about it as a way to “remove the poison” from online conversations.

For example, Teresa invented a technique called disemvowelling — removing the vowels from some or all of a fiery message-board post. The advantage of this is that it leaves the words intact, but requires that you read them very slowly — so slowly that it takes the sting out of them. And, as Teresa recently explained to me, disemvowelling part of a post lets the rest of the community know what kind of sentiment is and is not socially acceptable. — Cory Doctorow

However, he also noted that it often needed tools to make it workable, as doing it by hand was not scalable:

When Teresa started out disemvowelling, she removed the vowels from the offending messages by hand, a tedious and slow process. But shortly thereafter, Bryant Darrell wrote a Movable Type plugin to automate the process. This is a perfect example of human-geek synergy: hacking tools for civilian use based on the civilian’s observed needs.

But there aren’t enough Teresas to go around: how do we keep all the other message-boards troll-free? Again, the secret is in observing the troll whisperer in the field, looking for techniques that can be encapsulated in tutorials and code. There is a wealth of troll whisperer lore that isn’t pure intuition and good sense, techniques that can be turned into tools for the rest of us to use. — Cory Doctorow

The concept did get a bit more attention after that. The following year, Time Magazine described disemvoweling as one of the “Best Inventions of 2008” (even though disemvoweling was developed before that year). Almost exactly one year after BoingBoing did it, various Gawker blogs announced plans to also begin disemvoweling troll comments with a tool built into their content moderation system.

Company Considerations:

  • What are other techniques like disemvoweling that can be alternatives to simply deleting trollish comments?
  • Is disemvoweling an effective strategy for dealing with trollish behavior in forums?
  • For making use of disemvoweling, is it worth investing in building tools to make the process usable across multiple moderators? If so, what features would those tools need to have? How would those tools be rolled out?
  • Should there be different types of moderation (deletion, disemvoweling, etc.) applied to different types of content? If so, what should those differences be?
  • In this case study, the websites’ traffic was fairly small and moderation was by a handful of moderators. What would a company need to consider, in terms of content policy and moderation tools, if they want to use disemvoweling on websites that have much much larger communities and hundreds of moderators reviewing content?

Issue Considerations:

  • Would removing vowels simply make trolls angrier and more determined to troll a website?
  • Is disemvoweling more effective than simply deleting content since it also acts as a signal of what is not acceptable behavior on a particular site?
  • Do trolls adapt to techniques like disemvoweling and find other ways to troll, making it only a short term solution?
  • Does disemvoweling actually highlight the comments, making curious readers try to figure out what it’s saying?

Resolution: The focus on disemvoweling eventually went out of favor. Boing Boing dropped the practice, as did other sites that had embraced it. In 2009, a writer for Albany’s Times Union newspaper noted that a corporate lawyer had ordered him to stop disemvoweling comments on his blog posts for the newspaper, though it was not clearly explained why the lawyers were concerned about it.

Most of the discussion about disemvoweling disappeared as well, other than a brief flare up when Washington Post owner Jeff Bezos apparently suggested in a brainstorming session that they should allow some users to pay to disemvowel entire stories (and other users can pay to re-vowel them later). It appears this idea did not gain any support.

Originally posted to the Trust & Safety Foundation website.

Filed Under: , , , ,
Companies: boingboing

Rate this comment as insightful
Rate this comment as funny
You have rated this comment as insightful
You have rated this comment as funny
Flag this comment as abusive/trolling/spam
You have flagged this comment
The first word has already been claimed
The last word has already been claimed
Insightful Lightbulb icon Funny Laughing icon Abusive/trolling/spam Flag icon Insightful badge Lightbulb icon Funny badge Laughing icon Comments icon

Comments on “Content Moderation Case Study: BoingBoing Begins Disemvoweling The Trolls (2007)”

Subscribe: RSS Leave a comment
24 Comments
Anonymoussays:

I was an independent contractor with Gawker about 13 years ago handling comment moderation appeals. I answered the email account that people sent appeals to in order to get reinstated after getting banned.

Disemvoweling was the bane of my existence in that role because to consider an appeal, I had to read the comments that got someone banned to see if the editor/writer/mod was being overzealous (some of them were heavy handed with the ban hammer – I’m looking at you Gizmodo writers).

I had to read the (often very long) disemvoweled comments slowly to understand what the person had said. I started a list of disemvoweled "naughty words" I could search for to eliminate the easy ones (e.g. if you called the author of a Jezebel post a "cnt," you probably weren’t going to get reinstated).

They also didn’t communicate much with me, so the first time I saw the effects of disemvoweling, I didn’t know it was a mod doing it. I initially thought the bans were for people being annoying by writing their posts with no vowels in them.

Bobvioussays:

Re: Re: helpful windshield notes

Actually that’s very helpful. By placing it on the windshield, the driver will know all the gearbox options without having to look down.

Low Reverse Neutral Second Park Rev-limit Konstant
SuperSlow High Low

Just like a real head-up display. Of course I don’t recommend stepping through the range whilst moving, unless you are Garage 54 – Whole Lada Trouble at Novosibirsk Airport, https://www.youtube.com/watch?v=Yoe5nrqVdeo.

Anonymoussays:

Re: Re: boingboing gave up long ago

Except the success or failure of a single feature wouldn’t necessarily be the cause for a change to a commenting system. They switched to using Discourse, which works really well and they don’t appear to have a significant moderation issue. They do hide comments that get flagged and the mods do remove comments that violate community standards.

Scotesays:

It didn't work

Removing the vowels from comments was a vindictive way to censor comments. It was an overt attempt at public humiliation rather than quiet deletion of posts. But it was not effective. People who are trolls are not afraid of public humiliation. It just kept the conversations clogged up with the original troll posts, just in disemvowelled form, when what was needed was a careful pruning, removing the problematic posts entirely, and the problematic posters entirely if necessary.

Add Your Comment

Your email address will not be published. Required fields are marked *

Have a Techdirt Account? Sign in now. Want one? Register here

Comment Options:

Make this the or (get credits or sign in to see balance) what's this?

What's this?

Techdirt community members with Techdirt Credits can spotlight a comment as either the "First Word" or "Last Word" on a particular comment thread. Credits can be purchased at the Techdirt Insider Shop »

Follow Techdirt

Techdirt Daily Newsletter

Techdirt Deals
Report this ad??|??Hide Techdirt ads
Techdirt Insider Discord
The latest chatter on the Techdirt Insider Discord channel...
Loading...
Older Stuff
12:25 Australian Privacy Commissioner Says 7-Eleven Broke Privacy Laws By Scanning Customers' Faces At Survey Kiosks (6)
10:50 Missouri Governor Doubles Down On 'View Source' Hacking Claim; PAC Now Fundraising Over This Bizarrely Stupid Claim (45)
10:45 Daily Deal: The All-in-One Microsoft, Cybersecurity, And Python Exam Prep Training Bundle (0)
09:43 Want To Understand Why U.S. Broadband Sucks? Look At Frontier Communications In Wisconsin, West Virginia (8)
05:36 Massachusetts College Decides Criticizing The Chinese Government Is Hate Speech, Suspends Conservative Student Group (71)
19:57 Le Tigre Sues Barry Mann To Stop Copyright Threats Over Song, Lights Barry Mann On Fire As Well (21)
16:07 Court Says City Of Baltimore's 'Heckler's Veto' Of An Anti-Catholic Rally Violates The First Amendment (15)
13:37 Two Years Later, Judge Finally Realizes That A CDN Provider Is Not Liable For Copyright Infringement On Websites (21)
12:19 Chicago Court Gets Its Prior Restraint On, Tells Police Union Head To STFU About City's Vaccine Mandate (158)
10:55 Verizon 'Visible' Wireless Accounts Hacked, Exploited To Buy New iPhones (8)
10:50 Daily Deal: The MacOS 11 Course (0)
07:55 Suing Social Media Sites Over Acts Of Terrorism Continues To Be A Losing Bet, As 11th Circuit Dumps Another Flawed Lawsuit (11)
02:51 Trump Announces His Own Social Network, 'Truth Social,' Which Says It Can Kick Off Users For Any Reason (And Already Is) (100)
19:51 Facebook AI Moderation Continues To Suck Because Moderation At Scale Is Impossible (26)
16:12 Content Moderation Case Studies: Snapchat Disables GIPHY Integration After Racist 'Sticker' Is Discovered (2018) (11)
13:54 Arlo Makes Live Customer Service A Luxury Option (8)
12:05 Delta Proudly Announces Its Participation In The DHS's Expanded Biometric Collection Program (5)
11:03 LinkedIn (Mostly) Exits China, Citing Escalating Demands For Censorship (14)
10:57 Daily Deal: The Python, Git, And YAML Bundle (0)
09:37 British Telecom Wants Netflix To Pay A Tax Simply Because Squid Game Is Popular (32)
06:41 Report: Client-Side Scanning Is An Insecure Nightmare Just Waiting To Be Exploited By Governments (35)
20:38 MLB In Talks To Offer Streaming For All Teams' Home Games In-Market Even Without A Cable Subscription (10)
15:55 Appeals Court Says Couple's Lawsuit Over Bogus Vehicle Forfeiture Can Continue (15)
13:30 Techdirt Podcast Episode 301: Scarcity, Abundance & NFTs (0)
12:03 Hollywood Is Betting On Filtering Mandates, But Working Copyright Algorithms Simply Don't Exist (66)
10:45 Introducing The Techdirt Insider Discord (4)
10:40 Daily Deal: The Dynamic 2021 DevOps Training Bundle (0)
09:29 Criminalizing Teens' Google Searches Is Just How The UK's Anti-Cybercrime Programs Roll (19)
06:29 Canon Sued For Disabling Printer Scanners When Devices Run Out Of Ink (41)
20:51 Copyright Law Discriminating Against The Blind Finally Struck Down By Court In South Africa (7)
More arrow