Content Moderation Case Study: BoingBoing Begins Disemvoweling The Trolls (2007)

Content Moderation

from the dealing-with-trolls dept

Summary: One of the challenges for any website that allows for user content — no matter the size of the website — is how to deal with trollish behavior. There are a variety of options available, including just deleting such comments, but one option that got attention in the mid-2000s was the idea of disemvoweling: literally removing the vowels from any comment deemed trollish. This was something of an update on concept of merely “splatting out” letters (i.e., replacing certain letters with ‘*’ to make them less searchable and to create some level of disassociation from the initial word).

The history of disemvoweling is not entirely agreed upon, though it is clear that James Joyce used the word to describe writing without vowels in Finnegan’s Wake, published in 1939. Many people associate the modern use of it with Teresa Nielsen Hayden, who wrote in the comments on her own blog (Making Light) about how she had removed the vowels from someone who was trolling.

Other users then referred to this as disemvoweling. The word and its usage as a moderation mechanism appeared in other places before, including in a 1990 version of the RISKS Digest newsletter discussing a proposed anti-hacking law.

Nielsen Hayden embraced the power of disemvoweling, and supported efforts to make it easier to do. (She initially said she removed vowels by hand).

In August of 2007, the popular blog (and former zine) Boing Boing announced that it had relaunched and brought back comments, with Nielsen Hayden joining the site to help with community management. This immediately resulted in questions about whether or not BoingBoing would now embrace disemvoweling as a technique to manage trolls as well. Nielsen Hayden suggested that it might, but she did not expect it to be that frequent:

“Glad to see comments back. With TNH moderating should we expect frequent dis-envoweling?

Only if it’s warranted. I doubt I’ll have frequent cause to use it.” –Teresa Nielsen Hayden

The blog did embrace disemvoweling as a technique, though. Others on the Boing Boing team talked about how it seemed to work quite well. Xeni Jardin noted that while it did involve a fair bit of human effort, it appeared to be mostly effective.

We hired a community manager, and equipped our comments system with a secret weapon: the “disemvoweller.” If someone’s misbehaving, she can remove all the vowels from their screed with one click. The dialogue stays, but the misanthrope looks ridiculous, and the emotional sting is neutralized.

Now, once again, the balance mostly works. I still believe that there is no fully automated system capable of managing the complexities of online human interaction — no software fix I know of. But I’d underestimated the power of dedicated human attention.

Plucking one early weed from a bed of germinating seeds changes everything. Small actions by focused participants change the tone of the whole. It is possible to maintain big healthy gardens online. The solution isn’t cheap, or easy, or hands-free. Few things of value are. — Xeni Jardin

In a separate piece, then BoingBoing writer Cory Doctorow talked about it as a way to “remove the poison” from online conversations.

For example, Teresa invented a technique called disemvowelling — removing the vowels from some or all of a fiery message-board post. The advantage of this is that it leaves the words intact, but requires that you read them very slowly — so slowly that it takes the sting out of them. And, as Teresa recently explained to me, disemvowelling part of a post lets the rest of the community know what kind of sentiment is and is not socially acceptable. — Cory Doctorow

However, he also noted that it often needed tools to make it workable, as doing it by hand was not scalable:

When Teresa started out disemvowelling, she removed the vowels from the offending messages by hand, a tedious and slow process. But shortly thereafter, Bryant Darrell wrote a Movable Type plugin to automate the process. This is a perfect example of human-geek synergy: hacking tools for civilian use based on the civilian’s observed needs.

But there aren’t enough Teresas to go around: how do we keep all the other message-boards troll-free? Again, the secret is in observing the troll whisperer in the field, looking for techniques that can be encapsulated in tutorials and code. There is a wealth of troll whisperer lore that isn’t pure intuition and good sense, techniques that can be turned into tools for the rest of us to use. — Cory Doctorow

The concept did get a bit more attention after that. The following year, Time Magazine described disemvoweling as one of the “Best Inventions of 2008” (even though disemvoweling was developed before that year). Almost exactly one year after BoingBoing did it, various Gawker blogs announced plans to also begin disemvoweling troll comments with a tool built into their content moderation system.

Company Considerations:

• What are other techniques like disemvoweling that can be alternatives to simply deleting trollish comments?
• Is disemvoweling an effective strategy for dealing with trollish behavior in forums?
• For making use of disemvoweling, is it worth investing in building tools to make the process usable across multiple moderators? If so, what features would those tools need to have? How would those tools be rolled out?
• Should there be different types of moderation (deletion, disemvoweling, etc.) applied to different types of content? If so, what should those differences be?
• In this case study, the websites’ traffic was fairly small and moderation was by a handful of moderators. What would a company need to consider, in terms of content policy and moderation tools, if they want to use disemvoweling on websites that have much much larger communities and hundreds of moderators reviewing content?

Issue Considerations:

• Would removing vowels simply make trolls angrier and more determined to troll a website?
• Is disemvoweling more effective than simply deleting content since it also acts as a signal of what is not acceptable behavior on a particular site?
• Do trolls adapt to techniques like disemvoweling and find other ways to troll, making it only a short term solution?
• Does disemvoweling actually highlight the comments, making curious readers try to figure out what it’s saying?

Resolution: The focus on disemvoweling eventually went out of favor. Boing Boing dropped the practice, as did other sites that had embraced it. In 2009, a writer for Albany’s Times Union newspaper noted that a corporate lawyer had ordered him to stop disemvoweling comments on his blog posts for the newspaper, though it was not clearly explained why the lawyers were concerned about it.

Most of the discussion about disemvoweling disappeared as well, other than a brief flare up when Washington Post owner Jeff Bezos apparently suggested in a brainstorming session that they should allow some users to pay to disemvowel entire stories (and other users can pay to re-vowel them later). It appears this idea did not gain any support.

Originally posted to the Trust & Safety Foundation website.

Filed Under: content moderation, disemvowelling, james joyce, teresa nielsen hayden, trolls
Companies: boingboing