Techdirt's think tank, the Copia Institute, is working with the Trust & Safety Professional Association and its sister organization, the Trust & Safety Foundation, to produce an ongoing series of case studies about content moderation decisions. These case studies are presented in a neutral fashion, not aiming to criticize or applaud any particular decision, but to highlight the many different challenges that content moderators face and the tradeoffs they result in. Find more case studies here on Techdirt and on the TSF website.

Content Moderation Case Study: Friendster Battles Fakesters (2003)

from the revenge-of-the-fakesters dept

Summary: While the social media/social networking space today is dominated by Facebook, it’s interesting to look at how Facebook’s predecessors dealt with content moderation challenges as well. One of the earliest social networks to reach mainstream recognition was Friendster, founded by Jonathan Abrams in 2002 and launched in early 2003, gaining millions of users who signed up to connect with friends. Originally built as a dating site, it expanded quickly beyond that.

One of the first big content moderation questions that the site faced was whether or not to allow “fakesters.” As the site grew rapidly, one popular usage was to set up fake accounts -- these were accounts for completely made up fictional characters (e.g., Homer Simpson), concepts (e.g., Pure Evil), random objects (e.g., Giant Squid), or places (e.g., New Jersey). Researcher danah boyd catalogued the different types of fakesters and studied the phenomenon of fake accounts on the site.

However, Abrams quickly decided that “fakester” went against the ethos of the site he envisioned. In a 2003 article in SF Weekly that discusses the “fakester” issue, Abrams makes it clear that such accounts do not belong on the site, even if some people find them amusing:

In early July, Friendster's affable chief operating officer, Kent Lindstrom, told me the only fakesters that the company would likely remove would be ones it received complaints about. (On Friendster, users can “flag” somebody's profile for the company to review, and write comments about why it offended them.) But Abrams shakes his head emphatically when I mention this.

“No. They're all going,” he says, his voice steely. “All of them.”

As the article notes, the fakesters were often the most active users on the site, but that did not change Abrams’ mind about whether or not they belonged there:

Though they are some of Friendster's most ardent fans — many spend several hours a day on the site — fakesters do everything they can to create anarchy in the system. They are not interested in finding friends through prosaic personal ads, but through a big, surreal party where Jesus, Chewbacca, and Nitrous are all on the guest list. To fakesters, phony identities don't destroy the social experience of Friendster; they enrich it.

But fakesters aren't hosting this gig. Jonathan Abrams, the 33-year-old software engineer who founded Friendster to improve his own social life, is — and he abhors the phony profiles. He believes they diminish his site's worth as a networking tool and claims that fakesters' pictures — often images ripped off the Web — violate trademark law. Abrams' 10-person Sunnyvale company has begun ruthlessly deleting fakesters and plans to eventually eradicate them completely from the site.

A few months later, an article in Salon laid out the growing conflict between those who found the “fakesters” to be fun, and Abrams who remained adamantly against them.

Giant Squid is not alone: Among the "Fakesters" who've signed up for Friendster are Jackalope, God, Beer, Drunk Squirrel, Hippie Jesus, Malcolm X and more than a dozen Homer Simpsons. Just like regular users, they post their photos, blab on bulletin boards and collect friends like so many baseball cards. Some, staying in character, even write gushing testimonials about their friends: What higher endorsement could there be than a few complimentary words from Homer himself? "Better than a cold can of Duff beer ... "

But while it may be amusing to invite God himself into your pool of friends and get back the message, "God is now your friend," the founder of the site says that such chicanery only distorts his system.

"Fake profiles really defeats the whole point of Friendster," says entrepreneur Abrams, interviewed by cellphone as he waited to catch a plane in Los Angeles. "Some people find it amusing, but some find it annoying. And it doesn't really serve a legitimate purpose. The whole point of Friendster is to see how you're connected to people through your friends," he says.

Decisions to be made by Friendster:

  • Should it delete any and all “fakester” profiles? Should it only do so if users complain about a specific profile, or should it be proactive in removing such profiles?
  • How should the company deal with nicknames, rather than a person’s real name? How would it distinguish between celebrities and those pretending to be celebrities?
  • Does removing “fakesters” harm some of the “fun” aspects that brought people to the site in the first place?
Questions and policy implications to consider:
  • Does forcing everyone to be on the site with their real name lead to less participation from more vulnerable and at risk populations, worried about putting their profiles online?
  • How much should web sites cater to emergent behavior, like fakesters, which some users enjoyed and resulted in more usage of the site?
  • Are there legal risks associated with allowing fake profiles?
Resolution: While Friendster continued its fights against “fakester” profiles, apparently the company’s vehement stance against such profiles did not apply to monetization opportunities. In the summer of 2004, some people noticed an advertising campaign on Friendster for the “Anchorman” movie with Will Ferrell in which his character, Ron Burgandy was suggested as a “friend” to users.

When asked about this, Friendster tried to frame this situation as different than the “fakester” issue, saying that it was a “new paradigm.”

What Friendster is doing with these movie-character profiles is actually a brand-new paradigm in media promotion," Friendster spokeswoman Lisa Kopp said. "We are working directly with a number of production houses and movie studio partners to create film-character profiles, or 'fan' profiles, that allow our users to share their enthusiasm about the film with their friends."

The company also claimed that it wasn’t “fake” because it was done in partnership with the movie studio Dreamworks, which had the rights to the character:

"The issue here is actually about consumer protection," said Kopp. "We do, as a policy, strongly discourage fake profiles. A rogue user hiding behind a Jesus profile, for example, has the potential to abuse the service or users in many ways. In the case of the Anchorman characters, DreamWorks owns the rights to the characters and there is nothing fraudulent about it."

Of course, many of the “fakester” profiles didn’t involve anyone else’s intellectual property, so this excuse wouldn’t apply to accounts like “Pure Evil” and “Giant Squid.”

Friendster struggled to grow, in part because its own success overwhelmed its technical abilities. The site was quickly overtaken by MySpace and then Facebook. Since then, other sites, including Facebook, have struggled with the question of whether or not accounts should have “real names.” While many have argued that such policies discourage bad behavior, studies on this point have suggested otherwise.

Originally posted to the Trust & Safety Foundation website.

Hide this

Thank you for reading this Techdirt post. With so many things competing for everyone’s attention these days, we really appreciate you giving us your time. We work hard every day to put quality content out there for our community.

Techdirt is one of the few remaining truly independent media outlets. We do not have a giant corporation behind us, and we rely heavily on our community to support us, in an age when advertisers are increasingly uninterested in sponsoring small, independent sites — especially a site like ours that is unwilling to pull punches in its reporting and analysis.

While other websites have resorted to paywalls, registration requirements, and increasingly annoying/intrusive advertising, we have always kept Techdirt open and available to anyone. But in order to continue doing so, we need your support. We offer a variety of ways for our readers to support us, from direct donations to special subscriptions and cool merchandise — and every little bit helps. Thank you.

–The Techdirt Team

Filed Under: content moderation, fakesters, real names
Companies: friendster

Reader Comments

Subscribe: RSS

View by: Thread

  • identicon
    Anonymous Coward, 16 Apr 2021 @ 5:05pm

    Aside from insufficiently scaling to handle the massive traffic they were getting, Friendster's biggest mistake was shutting down the fake accounts that people were using to build communities. The accounts people created to represent places and interests were working around shortcomings of the system. Both mistakes can be summarized as inflexibility.

    reply to this | link to this | view in chronology ]

  • identicon
    Pixelation, 17 Apr 2021 @ 7:48am


    A great idea for a new social media company...

    reply to this | link to this | view in chronology ]

  • icon
    Tanner Andrews (profile), 18 Apr 2021 @ 8:19am

    At least still resolves to a live site, even if it only receives about 10 visitors a day (five of whom are just checking to see if the name still resolves).

    reply to this | link to this | view in chronology ]

  • identicon
    Anonymous Coward, 19 Apr 2021 @ 2:40pm

    This is only tangentially related, but this brings back a memory of the old, old days of working at Blockbuster. There were commands in the computer system that could be used to copy a local account to the national database, and vice-versa. It was kind of a fun game punching in odd number combinations to find joke profiles people had uploaded - 66666, 77777, 69696, 00000, 54321, etc. I remember God and Darth Vader being among them. We also used to have chair races, and we'd shrink wrap each other's stuff - not that management knew, of course. Good times!

    reply to this | link to this | view in chronology ]

Add Your Comment

Have a Techdirt Account? Sign in now. Want one? Register here

Subscribe to the Techdirt Daily newsletter

Comment Options:

  • Use markdown. Use plain text.
  • Remember name/email/url (set a cookie)


Add A Reply

Have a Techdirt Account? Sign in now. Want one? Register here

Subscribe to the Techdirt Daily newsletter

Comment Options:

  • Use markdown. Use plain text.
  • Remember name/email/url (set a cookie)

Follow Techdirt
Essential Reading
Techdirt Insider Chat

Warning: include(/home/beta6/deploy/itasca_20201215-3691-c395/includes/right_column/ failed to open stream: No such file or directory in /home/beta6/deploy/itasca_20201215-3691-c395/includes/right_column/ on line 8

Warning: include(): Failed opening '/home/beta6/deploy/itasca_20201215-3691-c395/includes/right_column/' for inclusion (include_path='.:/usr/share/pear:/home/beta6/deploy/itasca_20201215-3691-c395:/home/beta6/deploy/itasca_20201215-3691-c395/..') in /home/beta6/deploy/itasca_20201215-3691-c395/includes/right_column/ on line 8
Recent Stories


Email This

This feature is only available to registered users. Register or sign in to use it.