Techdirt's think tank, the Copia Institute, is working with the Trust & Safety Professional Association and its sister organization, the Trust & Safety Foundation, to produce an ongoing series of case studies about content moderation decisions. These case studies are presented in a neutral fashion, not aiming to criticize or applaud any particular decision, but to highlight the many different challenges that content moderators face and the tradeoffs they result in. Find more case studies here on Techdirt and on the TSF website.

Content Moderation Case Study: Telegram Gains Users But Struggles To Remove Violent Content (2021)

from the influx-of-insurrectionists dept

Summary: After Amazon refused to continue hosting Parler, the Twitter competitor favored by the American far-right, former Parler users looking to communicate with each other — but dodge strict moderation — adopted Telegram as their go-to service. Following the attack on the Capitol building in Washington, DC, chat app Telegram added 25 million users in a little over 72 hours.

Telegram has long been home to far-right groups, who often find their communications options limited by moderation policies that, unsurprisingly, remove violent or hateful content. Telegram’s moderation is comparatively more lax than several of its social media competitors, making it the app of choice for far right personalities.

But Telegram appears to be attempting to handle the influx of users — along with an influx of disturbing content. Some channels broadcasting extremist content have been removed by Telegram as the increasingly-popular chat service flexes its (until now rarely used) moderation muscle. According to the service, at least fifteen channels were removed by Telegram moderators, some of which were filled with white supremacist content.

Unfortunately, policing the service remains difficult. While Telegram claims to have blocked “dozens” of channels containing “calls to violence,” journalists have had little trouble finding similarly violent content on the service, which either has eluded moderation or is being ignored by Telegram. While Telegram appears responsive to some notifications of potentially-illegal content, it also appears to be inconsistent in applying its own rule against inciting violence.

Decisions to be made by Telegram:

  • Should content contained in private chats (rather than public channels) be subjected to the same rules concerning violent content?

  • Given that many of its users migrated to Telegram after being banned elsewhere for posting extremist content, should the platform increase its moderation efforts targeting calls for violence?

  • Should a process be put in place to help prevent banned users/channels from resurfacing on Telegram under new names?

Questions and policy implications to consider:

  • Does Telegram’s promise of user security and privacy dissuade it from engaging in more active content moderation?

  • Is context considered when engaging in moderation to avoid accidentally blocking people sharing content they feel is concerning, rather than promoting the content or endorsing its message?

  • Do reports of mass content violations (and lax moderation) draw extremists to Telegram? Does this increase the chance of the moderation problem “snowballing” into something that can no longer be managed effectively?

Resolution: Telegram continues to take a mostly hands-off approach to moderation but appears to be more responsive to complaints about calls to violence than it has been in the past. As it continues to draw more users — many of whom have been kicked off other platforms — its existing moderation issues are only going to increase.

Originally posted to the Trust & Safety Foundation website.

Filed Under: , ,
Companies: telegram

Rate this comment as insightful
Rate this comment as funny
You have rated this comment as insightful
You have rated this comment as funny
Flag this comment as abusive/trolling/spam
You have flagged this comment
The first word has already been claimed
The last word has already been claimed
Insightful Lightbulb icon Funny Laughing icon Abusive/trolling/spam Flag icon Insightful badge Lightbulb icon Funny badge Laughing icon Comments icon

Comments on “Content Moderation Case Study: Telegram Gains Users But Struggles To Remove Violent Content (2021)”

Subscribe: RSS Leave a comment
35 Comments
TD is extreme corporatist w Marxist tactics!says:

Re: innocuous leader -- AND THEN all text went in!

So it’s NOT a simple "filter" as alleged. Seems some wacky combination of Cloudflare blocking TOR addresses (US ones seem more likely of late), and perhaps some keyword filtering or length limit.

Can anyone get "Masnick" into the subject line, for instance? NEVER goes when I try it.

Stephen T. Stonesays:

Seems some wacky combination of Cloudflare blocking TOR addresses (US ones seem more likely of late), and perhaps some keyword filtering or length limit.

Or maybe it?s because you spam comments over and over and over and over and over again, which means the spam filters end up marking you as a spambot and flag your IP as a source of spam. If you?d stop acting like a spambot, maybe you wouldn?t be caught in the spamfilters.

Then again, by your own admission, you think Techdirt is some slowly eroding pissant tech blog that nobody reads. What the hell possesses you to act like such a site is somehow both insignificant and influential? What makes you so rabid with anger and hatred (and possibly sexual lust) over the fact that this site doesn?t cater exclusively to you and your warped, fucked up, ?conservative communist? sociopolitical ideologies? Why have you trolled this site for over a decade when a far better use of your time would be to, I?unno, write your own?

That One Guysays:

Re:

Why have you trolled this site for over a decade when a far better use of your time would be to, I?unno, write your own?

For the same reason the assholes given the boot from more civilized social media platforms keep trying desperately to force their way back rather than just setting up shop on a platform that actually wants them around I imagine: Being an asshole isn’t as fun without a crowd of people to be an asshole to/in front of.

TD is extreme corporatist w Marxist tactics!says:

NEVER a mention of "left-wing" violence.

NEVER a mention of "left-wing" violence.

Amnesia of the Anarcho-Tyrannists

https://www.unz.com/mmalkin/amnesia-of-the-anarcho-tyrannists/

Is it just me or has the entire universe of establishment media, politics and Hollywood forgotten that this country has endured an entire year of relentless violent anarchotyranny? Antifa and Black Lives Matter rioters set businesses and churches ablaze, smashed state capitols and laid siege to federal courthouses. They permanently destroyed precious statues and symbols of America’s heritage. They assaulted elderly people, stalked and menaced bystanders, taunted and terrorized law enforcement. And they committed murder – dozens of times – in the name of social justice while the powers that be sat idly by.

Stephen T. Stonesays:

NEVER a mention of "left-wing" violence.

When did armed ?leftist? protestors take over a wildlife refuge?

When did armed ?leftist? protestors storm the U.S. Capitol?

When did armed ?leftist? protestors bomb abortion clinics, the Olympics, and a federal building that housed offices for numerous federal agencies?

The few real examples of ?leftist? political violence pale in comparison to the amount, and the carnage, of right-wing political violence. (Does anything that happened in the midst of the George Floyd protests look anywhere near as bad as the aftermath of the Oklahoma City bombing? If you say yes, you?re an intentionally ignorant asshole.) And this line would be a laugh and a half if it weren?t so goddamned ridiculous:

They permanently destroyed precious statues and symbols of America’s heritage.

They tore down monuments meant to glorify a White supremacist nation-state that lasted four years, dedicated itself to the defense of slavery, was fucked over economically by the end of its existence, and betrayed the U.S. before ultimately crawling back into the Union in disgrace after the end of the War to Preserve Slavery. The Confederacy isn?t ?heritage?; it?s four years out a two-and-a-half century history of the United States???and a period at the end of a sentence on a single page of a single chapter in the entirety of human history at best. And most of those statues and monuments went up after the Civil War as an implicit reminder to now-freed Black people that White people still ruled the country. What fucking ?heritage? is there to celebrate regarding the Confederacy, other than its violently stubborn adherence to White supremacy?

That One Guysays:

Re:

It’s always so very telling when someone flips out over the removal or even destruction of statues aimed at celebrating slavery and those that defended it, as it tells you just so very much about that person. You can remember history just fine without putting up monuments celebrating and commemorating the more abhorrent people in it.

Anonymoussays:

Re: Re:

I bet that if you live in the U.S., your house or apartment is on Indian land. I think this gives us carte blanch to tear down your property, agreed? Isn?t it much worse to be an occupier of stolen land than to put up a few statues? D.M. me your address, and I?ll send my antifa buddies over to your place to rectify the problem.

Anonymoussays:

Re:

When did ?rightists? cause two billion dollars damage, blind federal agents with lasers, create ?autonomous zones? (traitorous, insurrection zones, one of which is put up in Minneapolis today), burn down police stations, car dealerships, countless other businesses, destroy federal property including statues, and parts of federal buildings, and cause the deaths of thirty people? You?re so blind to what?s happening on the authoritarian Left?s side that it boggles the mind.

Stephen T. Stonesays:

Four things.

  1. Property damage isn?t something I?m largely concerned with because property can be replaced and lives can?t.
  2. Thirty deaths is, metaphorically, a handful of people compared to the hundreds of people killed by right-wing violence???which includes the nearly 200 people killed in the bombing of the Alfred P. Murrah Federal Building, every victim of violent anti-abortion zealots, the three people killed by Some Asshole who thought he was protecting property he wasn?t even invited to protect, and Officer Brian Sicknick.
  3. I?ve seen no form of credible indication that antifascist activists are directly responsible for one death, let alone thirty.
  4. Modern right-wing violence is far more of a threat to the safety and security of the United States than modern left-wing violence ever will be.
Anonymoussays:

Re:

You guys raided the government. Getting all uppity about a few statues of "heritage" is hypocritical peanuts. But then again, if I was stupid enough like you to go out and risk my own personal safety and reputation based on the words of a dumbass, then have said dumbass throw me to the dogs to save his own skin, I’d try to forget that happened too.

Stephen T. Stonesays:

election integrity protestors

They weren?t protestors, they were rioters???and they stormed the Capitol to, by their own admission via their chants during the riot, find and kill then-Vice President Mike Pence. That hunt was part of a concerted effort to intimidate lawmakers into overturning the most closely-watched election in U.S. history. Those domestic terrorists weren?t concerned about ?election integrity?. They were unhappy that Old 45 lost fair and square.

Scary Devil Monasterysays:

Re: Re: Re:

"The election integrity protestors had the right location…"

There were no protestors there. There were insurrectionists who stormed a building chanting about murdering a person they knew was inside that building, with the manifest intent to overturn the counting of votes.

The closest they came to making that a "protest" was when a few of them decided to void their bowels on the rotunda floor. That at least, if tasteless and barbarous, did count as "civil disobedience". The rest, not so much.

Anonymoussays:

Re: NEVER a mention of "left-wing" violence.

Careful, the blind hatred the radical leftists have here for any logic that doesn?t comport with their own will force them to succumb to the binary fallacy: ?You must be on the far right, since you don?t agree with me!? There?s never discussion about a possible spectrum of political views, or the fact that most people want rule of law and don?t agree with the burning of America, tearing down statues AND the attacks on the Capitol on Jan 6. Nope, if you don?t agree one hundred percent with their opinion, then you MUST be a fascist. There?s no hope for healing the division in America when we can?t even come together to condemn radical views on the far right AND the far left.

Stephen T. Stonesays:

most people want rule of law and don?t agree with the burning of America, tearing down statues AND the attacks on the Capitol on Jan 6

I generally didn?t agree with the burning down of buildings in a handful cities across the country (which is hardly ?burning ? America?). That doesn?t mean I don?t, on some level, sympathise with those who believed riots???which, according to the one Black guy conservatives love to quote when it comes to talking about unity and peace and shit, are the language of the unheard. Stopping future riots doesn?t happen with a show of police force that resembles a military takeover in a foreign country. It happens when the conditions that caused the riots are addressed.

I don?t give a fuck about the tearing down of monuments and statues dedicated to the Confederacy and its ?heroes?. It was a racist nation-state dedicated to preserving slavery by any means necessary. It isn?t ?heritage?; it?s hate.

Your problem is how you?re trying to conflate riots over racial injustice and the tearing down of monuments that glorify racist traitors with an attack on a citadel of American democracy that attempted to overthrow the results of a free and fair election. You?ll find few people here who believe a (likely heavily insured) department store being burned down and armed insurrectionists chanting ?hang Mike Pence? in the middle of the Capitol are somehow equivalent to one another.

I can condemn left-wing violence. But it?s not nearly the same kind of threat to the United States as right-wing violence. Your whataboutism is cute in its attempt to conflate the two as being equally threatening???but it?s wrooooooooooooooooooooong.

That One Guysays:

'You were the ones calling for liability, so there's the door.'

Strangely enough when you have a recent and very visible example of what allowing that sort of stuff to flourish can result in platforms seem to be less willing to just chalk it up as ‘harmless venting’, and adding to that are the pushes to make platforms liable for user content, something which is just going to make them even quicker to pull anything that might be questionable to decrease the risks they might face for hosting such content.

Anonymoussays:

As usual when Techdirt agrees with a site?s moderation, no matter how oppressive it is to the SPIRIT of free-speech, it?s totally okay, and we?re reminded that ?it?s their site and they can do what they want. Don?t like it? Then start your own site.? When they start their own site: ?How dare they have a site that doesn?t moderate speech in the way we want??

cynoclastsays:

Re:

Doing nothing: Allowing speech on a platform built to allow posts

Voluntary action: censorship by removing posts to a platform built to allow posts

Compelled action: Being forced to print a letter

You’re trying to pretend the first is the third and nobody is falling for that strawman.

That’s the core of it. Censorship is a voluntary action, and anti-free speech advocates are pretending doing nothing (leaving posts alone) is something onerous and horrible, and compulsory.

It’s dishonest in the extreme.

Scary Devil Monasterysays:

Re: Re:

"Compelled action: Being forced to print a letter"

…and "being forced to host an unwelcome guest".

"You’re trying to pretend the first is the third and nobody is falling for that strawman."

No he’s not. He’s pointing out that preventing someone from evicting people or preventing them from shouting on their own premises is a violation of 1A. And of genertal property rights as well, but you alt-right asshats seem to have given up on those in favor of advocating closet communism – as long as it means you can no longer be shown the door by the bar owner or his online equivalent.

"…anti-free speech advocates are pretending doing nothing (leaving posts alone) is something onerous and horrible, and compulsory."

Yeah, because being forced to leave up, on their own property, posts saying "Ausl?nder raus!", "Black lives DON’T matter!", and "Hitler was right!" is indeed onerous and horrible.

"It’s dishonest in the extreme."

…says the troll who’s consistently been carrying water for the alt-right’s desperate attempt to make the online equivalent of bars cease throwing them out for being unpleasant assholes.

Every argument you make is worthless as long as it rests on your attempt to make "censorship" include the concept of a property owner show the shouty asshole the door.

cynoclastsays:

Re: Re: Re:

forced to leave up

dat mental gymnastics.

"forced to <do nothing>"

lol

You’re a joke.

…says the troll who’s consistently been carrying water for the alt-right’s desperate attempt to make the online equivalent of bars cease throwing them out for being unpleasant assholes.

Says the troll who makes strawman fallacies, ad hominems and thinks they’re gotchas.

That One Guysays:

'No no, I'm sure this time you actually ARE being censored...'

As I’ve noted in the past when others have tried that ploy you’re welcome to call moderation ‘censorship’, just keep in mind that by watering it down that much you’ll have essentially made it a useless term because it will cover something as trivial as a bar kicking out a customer for swearing at the staff(which most people would support) all the way up to the government issuing an order that said customer is not allowed to speak(which is just a titch more problematic), swearing or not.

Add Your Comment

Your email address will not be published.

Have a Techdirt Account? Sign in now. Want one? Register here

Comment Options:

Make this the or (get credits or sign in to see balance) what's this?

What's this?

Techdirt community members with Techdirt Credits can spotlight a comment as either the "First Word" or "Last Word" on a particular comment thread. Credits can be purchased at the Techdirt Insider Shop ┬╗

Follow Techdirt

Techdirt Daily Newsletter

Techdirt Insider Discord
The latest chatter on the Techdirt Insider Discord channel...
Loading...
Older Stuff
16:12 Content Moderation Case Studies: Snapchat Disables GIPHY Integration After Racist 'Sticker' Is Discovered (2018) (18)
15:30 Content Moderation Case Study: Tumblr's Approach To Adult Content (2013) (8)
15:41 Content Moderation Case Study: Twitter's Self-Deleting Tweets Feature Creates New Moderation Problems (2)
15:47 Content Moderation Case Studies: Coca Cola Realizes Custom Bottle Labels Involve Moderation Issues (2021) (16)
15:28 Content Moderation Case Study: Bing Search Results Erases Images Of 'Tank Man' On Anniversary Of Tiananmen Square Crackdown (2021) (33)
15:32 Content Moderation Case Study: Twitter Removes 'Verified' Badge In Response To Policy Violations (2017) (8)
15:36 Content Moderation Case Study: Spam "Hacks" in Among Us (2020) (8)
15:37 Content Moderation Case Study: YouTube Deals With Disturbing Content Disguised As Videos For Kids (2017) (11)
15:48 Content Moderation Case Study: Twitter Temporarily Locks Account Of Indian Technology Minister For Copyright Violations (2021) (8)
15:45 Content Moderation Case Study: Spotify Comes Under Fire For Hosting Joe Rogan's Podcast (2020) (64)
15:48 Content Moderation Case Study: Twitter Experiences Problems Moderating Audio Tweets (2020) (6)
15:48 Content Moderation Case Study: Dealing With 'Cheap Fake' Modified Political Videos (2020) (9)
15:35 Content Moderation Case Study: Facebook Removes Image Of Two Men Kissing (2011) (13)
15:23 Content Moderation Case Study: Instagram Takes Down Instagram Account Of Book About Instagram (2020) (90)
15:49 Content Moderation Case Study: YouTube Relocates Video Accused Of Inflated Views (2014) (2)
15:34 Content Moderation Case Study: Pretty Much Every Platform Overreacts To Content Removal Stimuli (2015) (23)
16:03 Content Moderation Case Study: Roblox Tries To Deal With Adult Content On A Platform Used By Many Kids (2020) (0)
15:43 Content Moderation Case Study: Twitter Suspends Users Who Tweet The Word 'Memphis' (2021) (10)
15:35 Content Moderation Case Study: Time Warner Cable Doesn't Want Anyone To See Critical Parody (2013) (14)
15:38 Content Moderation Case Studies: Twitter Clarifies Hacked Material Policy After Hunter Biden Controversy (2020) (9)
15:42 Content Moderation Case Study: Kik Tries To Get Abuse Under Control (2017) (1)
15:31 Content Moderation Case Study: Newsletter Platform Substack Lets Users Make Most Of The Moderation Calls (2020) (8)
15:40 Content Moderation Case Study: Knitting Community Ravelry Bans All Talk Supporting President Trump (2019) (29)
15:50 Content Moderation Case Study: YouTube's New Policy On Nazi Content Results In Removal Of Historical And Education Videos (2019) (5)
15:36 Content Moderation Case Study: Google Removes Popular App That Removed Chinese Apps From Users' Phones (2020) (28)
15:42 Content Moderation Case Studies: How To Moderate World Leaders Justifying Violence (2020) (5)
15:47 Content Moderation Case Study: Apple Blocks WordPress Updates In Dispute Over Non-Existent In-app Purchase (2020) (16)
15:47 Content Moderation Case Study: Google Refuses To Honor Questionable Requests For Removal Of 'Defamatory' Content (2019) (25)
15:32 Content Moderation Case Study: Vimeo Sued For Encouraging Infringement Via 'Lipdubs' (2009) (4)
15:38 Content Moderation Case Study: Friendster Battles Fakesters (2003) (4)
More arrow
This site, like most other sites on the web, uses cookies. For more information, see our privacy policy. Got it