Techdirt's think tank, the Copia Institute, is working with the Trust & Safety Professional Association and its sister organization, the Trust & Safety Foundation, to produce an ongoing series of case studies about content moderation decisions. These case studies are presented in a neutral fashion, not aiming to criticize or applaud any particular decision, but to highlight the many different challenges that content moderators face and the tradeoffs they result in. Find more case studies here on Techdirt and on the TSF website.

Content Moderation Case Study: Kik Tries To Get Abuse Under Control (2017)

from the kids-will-be-kids dept

Summary: The messaging service Kik was founded in 2009 and has gone through multiple iterations over the years. However, it seemed to build a large following for mostly anonymous communication, allowing users to create many new usernames not linked to a phone number, and to establish private connections via those usernames. This privacy feature has been applauded by some as being important for journalists, activists and at-risk populations.

However, the service has also been decried by many as being used in dangerous and abusive ways. NetNanny puts it as the number one dangerous messaging apps for kids, saying that it “has had a problem with child exploitation” and highlighting the many “inappropriate chat rooms” for kids on the app. Others have said that, while the service is used by many teenangers, many feel that it is not safe for them and full of sexual content and harassment.

Indeed, in 2017, a Forbes report detailed that Kik had a huge “child exploitation problem.” It described multiple cases of child exploitation that we found on the app, and claimed that it did not appear that the company was doing much to deal with the problem, which seemed especially concerning given that over half of its users base was under 24 years of age.

Soon after that article, Kik began to announce some changes to its content moderation efforts. It teamed up with Microsoft to improve its moderation practices. It also announced a $10 million effort to improve safety on the site and named some high profile individuals to its new Safety Advisory Board.

A few months later the company announced updated community standards, with a focus on safety, and a partnership with Crisis Text Line. However, that appeared to do little to stem the concerns. A report later in 2018 said that, among law enforcement, the app that concerned them most was Kik, with nearly all saying that they had come across child exploitation cases on the app, and that the company was difficult to deal with.

In response, the company argued that while it was constantly improving its trust & safety practices, it also wanted to protect the privacy of its users.

Decisions to be made by Kik:

  • How can a company that promotes the privacy-protective nature of its messaging also limit and prevent serious and dangerous abusive practices?
  • How closely should Kik work with law enforcement when they find evidence of crimes on the platform?
  • Are there additional tools and features that can be implemented that would discourage those looking to use the platform in abusive ways?
Questions and policy implications to consider:
  • Are there ways to retain the benefits for journalists, activists, and at-risk groups that do not put others -- especially children -- at risk?
  • What are the tradeoffs between enabling useful private communications and making sure such tools are not used in abusive or dangerous ways?
Resolution: Despite the claims from Kik that it was improving its efforts to crack down on abuse, reports have continued to suggest that little has changed on the platform. A detailed report from early 2020 -- years after Kik said it was investing millions in improving the platform -- suggested that it was still a haven for sketchy content, even noting that just posting a Kik address publicly (on Twitter) resulted in near immediate abuse.

Despite an announcement in late 2019 that the company was going to shut down the messaging service to focus on a new cryptocurrency plan, it reversed course soon after and sold off the messenger product to a new owner. In the year and half since the sale, Kik has not added any new content to its safety portal, and more recent articles still highlight how frequently child predators are found on the site.

Originally published on the Trust & Safety Foundation website.

Hide this

Thank you for reading this Techdirt post. With so many things competing for everyone’s attention these days, we really appreciate you giving us your time. We work hard every day to put quality content out there for our community.

Techdirt is one of the few remaining truly independent media outlets. We do not have a giant corporation behind us, and we rely heavily on our community to support us, in an age when advertisers are increasingly uninterested in sponsoring small, independent sites — especially a site like ours that is unwilling to pull punches in its reporting and analysis.

While other websites have resorted to paywalls, registration requirements, and increasingly annoying/intrusive advertising, we have always kept Techdirt open and available to anyone. But in order to continue doing so, we need your support. We offer a variety of ways for our readers to support us, from direct donations to special subscriptions and cool merchandise — and every little bit helps. Thank you.

–The Techdirt Team

Filed Under: content moderation, messaging, privacy, safety
Companies: kik

Reader Comments

Subscribe: RSS

View by: Thread

  • icon
    james (profile), 26 May 2021 @ 7:35am

    The outline can be said to be the main framework of Vancouver homework writing It can be structured and organized into paragraphs to make it easier for everyone to write homework. We Chinese students often ignore the importance of the outline, but if you can spend half an hour writing the outline, you can get twice the result with half the effort for subsequent homework. Speaking of homework outlines, in fact, many students know that the thesis outline is the framework of the research paper. With the main frame of this article, the main points are listed under each part of the frame, and then all the main points are structured into paragraphs, which can ensure that students will not miss anything when writing. Although there are many types of assignments in foreign universities, the common structure of most papers is five paragraphs. Every article needs an introduction, body (paragraph with argument), body (paragraph with argument), and conclusion.

    reply to this | link to this | view in chronology ]

Add Your Comment

Have a Techdirt Account? Sign in now. Want one? Register here

Subscribe to the Techdirt Daily newsletter

Comment Options:

  • Use markdown. Use plain text.
  • Remember name/email/url (set a cookie)


Add A Reply

Have a Techdirt Account? Sign in now. Want one? Register here

Subscribe to the Techdirt Daily newsletter

Comment Options:

  • Use markdown. Use plain text.
  • Remember name/email/url (set a cookie)

Follow Techdirt
Essential Reading
Techdirt Insider Chat

Warning: include(/home/beta6/deploy/itasca_20201215-3691-c395/includes/right_column/ failed to open stream: No such file or directory in /home/beta6/deploy/itasca_20201215-3691-c395/includes/right_column/ on line 8

Warning: include(): Failed opening '/home/beta6/deploy/itasca_20201215-3691-c395/includes/right_column/' for inclusion (include_path='.:/usr/share/pear:/home/beta6/deploy/itasca_20201215-3691-c395:/home/beta6/deploy/itasca_20201215-3691-c395/..') in /home/beta6/deploy/itasca_20201215-3691-c395/includes/right_column/ on line 8
Recent Stories


Email This

This feature is only available to registered users. Register or sign in to use it.