Learning About Content Moderation From Ghosts In Virtual Reality

from the ghosts-in-the-machine dept

Content moderation in virtual reality comes with its own unique challenges. What works for the moderation of text and video doesn?t neatly translate into VR. In late June, Facebook?s Horizon, a VR social space still in beta testing, released an update to prevent its blocking feature from creating ghosts. That might sound hyperbolic, but it is a perfectly apt description of the feature?s effect in Horizon prior to the update. In the earlier build, both the blocker and the blocked were made invisible to one another, but allowed to continue interacting with the same virtual world. While they couldn?t see one another, they could see each other?s effects on their shared environment. If someone blocked you, your obscene gestures might be invisible to them, but you could still move the furniture about and rattle chains ? practically becoming a poltergeist.

Improvements to Blocking in Horizon

We?re beginning to roll out changes to how blocking works in Horizon. These changes are based on people?s feedback, and are designed to improve people?s experience and make Horizon a safer and more welcoming place.

Previously, when you blocked someone in Horizon, both you and the person you blocked became invisible to each other. We heard feedback from people that this was confusing, for example when the other person continued interacting with objects in the same space.

Now, both the person who has been blocked and the person who blocked them will be able to see each other?s username tag, while keeping their avatars invisible to each other. This update allows both people to know they?re present, but blocked and muted.

You?ll also be able to see the people you?ve blocked in your menu (such as in the People Nearby list) instead of them being completely hidden. This means you can see who you?ve blocked without having to interact with them. You can also visit the settings page and see a block list, where you can see people you?ve blocked and choose to unblock them if you want.

As the patch notes explain, when used in VR, the traditional approach to blocking caused unintended problems. Unlike static social media profiles, users embody their avatars. The user?s digital representation mimics their motions and gestures as it moves through a shared virtual world. On traditional social media, blocking another user hides your speech from their view and limits their ability to reply. Hiding your avatar from their view is a logical translation of this policy to virtual reality. However, because the invisible-to-one-another blocker and blocked still shared the same virtual world, a malicious user could potentially block someone to haunt them or spy unobserved. Tagging speech from blocked users would be unnecessary on traditional social media, as their speech is already excluded from the blocker?s conversations. However, in a shared virtual environment, it becomes a necessary component of a useful blocking feature.

While these are far from life-threatening abuses, they illustrate why best practices for traditional content moderation can?t always be easily applied to VR. In many ways, Facebook Horizon?s moderation challenges look more like those of a video game, especially a massively multiplayer online game (MMO), than those of a traditional social network. In both cases, players interact through avatars, and can simultaneously affect the same virtual world.
In either a game or a shared VR world, the properties of the digital environment govern player interactions as much, if not more than, rules about players? speech. This often introduces tradeoffs between antiharassment measures and realism or interactivity. If a game models fire realistically, a malicious player might kick a campfire into another?s tent and set it ablaze. This can be avoided by either limiting players? ability to interact with fire (stopping them from kicking it), or the properties of the fire itself (preventing it from burning the tent). Environmental design choices in games or VR somewhat resemble architectural choices faced by traditional platforms – whether to create retweet or quote tweet functions, or to allow users to control who can reply to their tweets. However, creating an interactive virtual world requires making many more of these decisions.

MMOs are typified as either ?theme park? or ?sandbox? games. In the former, designers set fixed goals for players to compete or cooperate towards, justifying referee-like governance. The latter offers players a set of tools, and expects them to make their own fun, limiting the need for intercession by designers. Conflict between players with different goals is an expected part of the fun.

While platforms for knitting patterns or neighborhood conversation have purposes that recommend some rules over others, more open-ended platforms have struggled to justify their rules. YouTube is a home for video content. Which video content? Who?s to say? VR is, for the time-being, mostly used for gaming. However, as social and commercial applications of the technology become more popular, this question of purpose will become politically relevant, as it has for YouTube.

Horizon?s chief product is a framework for users to create their own virtual worlds. Horizon exists not to provide a Facebook designed environment, but to offer users the ability to create their own environments. This gives Horizon some guiding purpose, and relieves its designers of pressure to make one-size-fits-all decisions. Because most worlds within Horizon are created by users, these users can set the rules of interactivity. Facebook has neither the time nor the resources to govern the behavior and use of every virtual tennis racket across myriad virtual spaces. However, the creators of these little worlds know whether they?re creating a virtual tennis club or a garden party fighting game, and can set the rules of the environment accordingly.
This will not be the first time Facebook finds that a rule that works for text and video publishing platforms falls flat in virtual reality. However, its response to the unintended effects of the block feature shows a willingness to appreciate the new demands of the medium.

Will Duffield is a Policy Analyst at the Cato Institute

Filed Under: , , , , ,
Companies: facebook

Rate this comment as insightful
Rate this comment as funny
You have rated this comment as insightful
You have rated this comment as funny
Flag this comment as abusive/trolling/spam
You have flagged this comment
The first word has already been claimed
The last word has already been claimed
Insightful Lightbulb icon Funny Laughing icon Abusive/trolling/spam Flag icon Insightful badge Lightbulb icon Funny badge Laughing icon Comments icon

Comments on “Learning About Content Moderation From Ghosts In Virtual Reality”

Subscribe: RSS Leave a comment

Add Your Comment

Your email address will not be published. Required fields are marked *

Have a Techdirt Account? Sign in now. Want one? Register here

Comment Options:

Make this the or (get credits or sign in to see balance) what's this?

What's this?

Techdirt community members with Techdirt Credits can spotlight a comment as either the "First Word" or "Last Word" on a particular comment thread. Credits can be purchased at the Techdirt Insider Shop »

Follow Techdirt

Techdirt Daily Newsletter

Techdirt Insider Discord
The latest chatter on the Techdirt Insider Discord channel...
Older Stuff
13:40 It's Great That Winnie The Pooh Is In The Public Domain; But He Should Have Been Free In 1982 (Or Earlier) (35)
12:06 Norton 360 Now Comes With Crypto Mining Capabilities And Sketchy Removal Process (28)
10:45 Chinese Government Dragnet Now Folding In American Social Media Platforms To Silence Dissent (14)
10:40 Daily Deal: The 2022 Ultimate Cybersecurity Analyst Preparation Bundle (0)
09:29 A Fight Between Facebook And The British Medical Journal Highlights The Difficulty Of Moderating 'Medical Misinformation' (9)
06:29 Court Ruling Paves The Way For Better, More Reliable Wi-Fi (4)
20:12 Eighth Circuit (Again) Says There's Nothing Wrong With Detaining Innocent Minors At Gunpoint (15)
15:48 China's Regulatory War On Its Gaming Industry Racks Up 14k Casualties (10)
13:31 Chinese Government Fines Local Car Dealerships For Surveilling While Not Being The Government (5)
12:08 Eric Clapton Pretends To Regret The Decision To Sue Random German Woman Who Listed A Bootleg Of One Of His CDs On Ebay (29)
10:44 ICE Is So Toxic That The DHS's Investigative Wing Is Asking To Be Completely Separated From It (29)
10:39 Daily Deal: The 2022 Complete Raspberry Pi And Arduino Developer Bundle (0)
09:31 Google Blocked An Article About Police From The Intercept... Because The Title Included A Phrase That Was Also A Movie Title (24)
06:22 Wireless Carriers Balk At FAA Demand For 5G Deployment Delays Amid Shaky Safety Concerns (16)
19:53 Tenth Circuit Denies Qualified Immunity To Social Worker Who Fabricated A Mother's Confession Of Child Abuse (35)
15:39 Sci-Hub's Creator Thinks Academic Publishers, Not Her Site, Are The Real Threat To Science, And Says: 'Any Law Against Knowledge Is Fundamentally Unjust' (34)
13:32 Federal Court Tells Proud Boys Defendants That Raiding The Capitol Building Isn't Covered By The First Amendment (25)
12:14 US Courts Realizing They Have A Judge Alan Albright Sized Problem In Waco (17)
10:44 Boston Police Department Used Forfeiture Funds To Hide Purchase Of Surveillance Tech From City Reps (16)
10:39 Daily Deal: The Ultimate Microsoft Excel Training Bundle (0)
09:20 NY Senator Proposes Ridiculously Unconstitutional Social Media Law That Is The Mirror Opposite Of Equally Unconstitutional Laws In Florida & Texas (25)
06:12 Telecom Monopolies Are Exploiting Crappy U.S. Broadband Maps To Block Community Broadband Grant Requests (7)
12:00 Funniest/Most Insightful Comments Of 2021 At Techdirt (17)
10:00 Gaming Like It's 1926: Join The Fourth Annual Public Domain Game Jam (6)
09:00 New Year's Message: The Arc Of The Moral Universe Is A Twisty Path (33)
19:39 DHS, ICE Begin Body Camera Pilot Program With Surprisingly Good Policies In Place (7)
15:29 Remembering Techdirt Contributors Sherwin And Elliot (1)
13:32 DC Metro PD's Powerful Review Panel Keeps Giving Bad Cops Their Jobs Back (6)
12:11 Missouri Governor Still Expects Journalists To Be Prosecuted For Showing How His Admin Leaked Teacher Social Security Numbers (39)
10:48 Oversight Board Overturning Instagram Takedown Of Ayahuasca Post Demonstrates The Impossibility Of Content Moderation (10)
More arrow
This site, like most other sites on the web, uses cookies. For more information, see our privacy policy. Got it