NSA's Massive Utah Datacenter Having Serious Electrical Problems: Has Already Had 10 Fiery Explosions

from the frying-our-data dept

It’s no secret that government computing projects tend to be something of a boondoggle for government contractors. There are way too many stories of projects that are massively over-budget while never actually working. It’s almost to be expected these days. Still, when it came to the NSA’s infamous Utah data center they’ve been building over the past few years, you would have thought that maybe these guys would plan things out a little more carefully. While we can mock the NSA for the lies and misleading statements they make to the public, most people agree that they do have pretty damn good technical skills.

But, no, it appears that the Bluffdale data center is a complete mess. The data center, which was supposed to open up last month, has apparently been massively delayed due to major electrical problems — and we’re not just talking about some issues with not having enough power, but with setting stuff on fire:


According to the Wall Street Journal, the data center’s electrical problems include “arc failures,” a.k.a. “a flash of lightning inside a 2-foot box,” which results in fiery explosions, melted metal and circuit failure. More terrifying, this has happened ten times, most recently on September 25, reports the WSJ, which reviewed project documents and reports and talked to contractors involved. The report blames the NSA “fast tracking” the Utah project and thus bypassing “regular quality controls in design and construction.” Whoops.

Whoops indeed. Apparently the NSA was in such a rush to store all our data that it almost burned down its own data center. Good thing they’re getting a tax break on all that electricity they’re using.

Also, it appears that there’s a fair bit of sniping going on, as some people claim they knew this was going to happen all along, while others say they have no idea why it’s happening:


Worse, it sounds from the WSJ’s reporting as if the contractors — architectural firm KlingStubbins which designed the electrical system, along with construction companies Balfour Beatty Construction, DPR Construction and Big-D Construction Corp — are still scrambling to figure out what’s causing the problems. The Army Corps of Engineers sent its “Tiger Team” to sort things out this summer but they were unable to pinpoint exactly what’s wrong.

“The problem, and we all know it, is that they put the appliances too close together,” a person familiar with the database construction told FORBES, describing the arcs as creating “kill zones.” “They used wiring that’s not adequate to the task. We all talked about the fact that it wasn’t going to work.”

So, while the NSA has all sorts of code-breaking specialists, it appears that they’re a bit understaffed on electrical engineers… Meanwhile, how long until peeved Iranian government officials pretend that they did this in response to the NSA creating Stuxnet to mess with their nuclear processing powers…

Filed Under: , , , , , ,

Rate this comment as insightful
Rate this comment as funny
You have rated this comment as insightful
You have rated this comment as funny
Flag this comment as abusive/trolling/spam
You have flagged this comment
The first word has already been claimed
The last word has already been claimed
Insightful Lightbulb icon Funny Laughing icon Abusive/trolling/spam Flag icon Insightful badge Lightbulb icon Funny badge Laughing icon Comments icon

Comments on “NSA's Massive Utah Datacenter Having Serious Electrical Problems: Has Already Had 10 Fiery Explosions”

Subscribe: RSS Leave a comment
50 Comments
art guerrillasays:

Re: Re:

of course, the very un-funny point about your joke, is that repugs, faux news propagandists, xtian water carriers, etc, would make that exact ‘argument’, were it to be some ‘liberal’ building of some sort (social security bldg? planned parenthood HQ?) that had MUCH less worse issues…

(un)funny how that doesn’t work when the shoe is on the other foot…

(10!? 10 arc-fires ! dog damn, tesla woulda been proud!)

a faux-biblical quote comes to mind:
none so blind, as those who will not see…

art guerrilla
aka ann archy
eof

Internet Zen Mastersays:

Would never happen... I think...

Anyone want to bet that the NSA might conduct an “investigation” and then claim that all these problems and failures were the result of sabotage by none other than… wait for it… EDWARD SNOWDEN. And if anyone asks questions about their investigative methods, they will respond with: “Trust us. We’re the NSA. Now stop asking questions.”

This is a feature, not a bug

Anyone who has been paying attention knows that the NSA and all the other three-letter agencies have since the Reagan administration been little more than vacuum hoses designed to siphon money out of taxpayers’ pockets into the bank accounts of the connected ultra-wealthy who own the contracting companies. All this money being spent on surveillance isn’t about security at all. That’s just the lie told to justify it to outsiders. Screwups like this just mean more money for the contractors that fix them, usually the same ones who screwed up in the first place.

Anonymoussays:

2 foot box x 10 wow.. small 'problem'

have you seen the size of that complex ??

10 2 foot boxes flashing over, is probably LESS than what I would have expect from a place that large.

it is NOT very much..

it’s a SMALL switch board that sits inside a 2 foot box, and ANY switch will arc with switched wile carrying current.
Thus the “flashes of lightning”.

They are not talking about wiring meltdown, or switchboard fires.

In fact only 10 small boxes have failed (or might have failed) is next to nothing..

But just keep feeding us background noise, that way any real story is lost in the noise.

Anonymoussays:

Re: Re: Re: Re: 2 foot box x 10 wow.. small 'problem'

if the wiring is sub-standard, then why are the switchboards arcing over. And why not cable fires ?

Why only 10, and they are really small switchboards indeed most are the size of a large room.

again, this is a lost in noise non-story, but it does have NSA in it….

Chronno S. Triggersays:

Re: Re: Re: Re: Re: Re: 2 foot box x 10 wow.. small 'problem'

” a.k.a. “a flash of lightning inside a 2-foot box,” which results in fiery explosions, melted metal and circuit failure.

You seem to be missing parts. If the description of your electrical failure involves the words “fiery explosions” then you’re doing something wrong.

If these people cannot be trusted to wire power correctly, they cannot be trusted to spy on the entirety of the United States. This is not a non-story, this is just more proof that these assholes cannot follow the rules.

DBsays:

My guess is that they are using DC power distribution.

With AC power, the voltage crosses zero 120 times a second and a spark tends to self-extinguish. The ionized air that might sustain a spark gets pushed in the opposite direction, and the voltage doesn’t rise fast enough to start a fresh arc.

With DC power, there is no zero cross and the ionized air stays in place, sustaining an arc.

A switch or relay that has a AC voltage rating of 250V might only have a DC voltage rating 24V. Specialized high voltage DC relays typically combine several techniques to extinguish the arc that forms when contacts open. They always have contacts that open at high speed, and they usually use a ‘blowout’ mechanism. There might be several contacts in series, opened simultaneously, to effectively increase the opening speed. The might have the contacts in a vacuum or under high gas pressure. The blow-out might be a “magnetic blowout” which uses a magnetic field to push the arc into a longer path, a blast of compressed air, or even a blank shotgun shell to blow the ionized path away from the contacts.

Back to the point: design engineers that are used to HVAC systems usually get it wrong when they assume that they can use their knowledge with much lower voltage DC systems.

Anonymoussays:

I’m going to make the guess they got scared with the Snowden stuff flying around and the Amish proposal and decided to hurry it up before the money ran out. Don’t worry about the quality control, we’ll fix that later type thing. I think they were in a hurry to get it up and running while still having boodles of money to throw at it.

Pragmaticsays:

Meanwhile, how long until peeved Iranian government officials pretend that they did this in response to the NSA creating Stuxnet to mess with their nuclear processing powers…

About five minutes before some drunk-with-power politician announces that they are in fact responsible and this is why we should nuke ’em from orbit. Just to make sure.

Add Your Comment

Your email address will not be published. Required fields are marked *

Have a Techdirt Account? Sign in now. Want one? Register here

Comment Options:

Make this the or (get credits or sign in to see balance) what's this?

What's this?

Techdirt community members with Techdirt Credits can spotlight a comment as either the "First Word" or "Last Word" on a particular comment thread. Credits can be purchased at the Techdirt Insider Shop »

Follow Techdirt

Techdirt Daily Newsletter

Techdirt Deals
Report this ad??|??Hide Techdirt ads
Techdirt Insider Discord
The latest chatter on the Techdirt Insider Discord channel...
Loading...
Older Stuff
12:25 Australian Privacy Commissioner Says 7-Eleven Broke Privacy Laws By Scanning Customers' Faces At Survey Kiosks (6)
10:50 Missouri Governor Doubles Down On 'View Source' Hacking Claim; PAC Now Fundraising Over This Bizarrely Stupid Claim (45)
10:45 Daily Deal: The All-in-One Microsoft, Cybersecurity, And Python Exam Prep Training Bundle (0)
09:43 Want To Understand Why U.S. Broadband Sucks? Look At Frontier Communications In Wisconsin, West Virginia (8)
05:36 Massachusetts College Decides Criticizing The Chinese Government Is Hate Speech, Suspends Conservative Student Group (71)
19:57 Le Tigre Sues Barry Mann To Stop Copyright Threats Over Song, Lights Barry Mann On Fire As Well (21)
16:07 Court Says City Of Baltimore's 'Heckler's Veto' Of An Anti-Catholic Rally Violates The First Amendment (15)
13:37 Two Years Later, Judge Finally Realizes That A CDN Provider Is Not Liable For Copyright Infringement On Websites (21)
12:19 Chicago Court Gets Its Prior Restraint On, Tells Police Union Head To STFU About City's Vaccine Mandate (158)
10:55 Verizon 'Visible' Wireless Accounts Hacked, Exploited To Buy New iPhones (8)
10:50 Daily Deal: The MacOS 11 Course (0)
07:55 Suing Social Media Sites Over Acts Of Terrorism Continues To Be A Losing Bet, As 11th Circuit Dumps Another Flawed Lawsuit (11)
02:51 Trump Announces His Own Social Network, 'Truth Social,' Which Says It Can Kick Off Users For Any Reason (And Already Is) (100)
19:51 Facebook AI Moderation Continues To Suck Because Moderation At Scale Is Impossible (26)
16:12 Content Moderation Case Studies: Snapchat Disables GIPHY Integration After Racist 'Sticker' Is Discovered (2018) (11)
13:54 Arlo Makes Live Customer Service A Luxury Option (8)
12:05 Delta Proudly Announces Its Participation In The DHS's Expanded Biometric Collection Program (5)
11:03 LinkedIn (Mostly) Exits China, Citing Escalating Demands For Censorship (14)
10:57 Daily Deal: The Python, Git, And YAML Bundle (0)
09:37 British Telecom Wants Netflix To Pay A Tax Simply Because Squid Game Is Popular (32)
06:41 Report: Client-Side Scanning Is An Insecure Nightmare Just Waiting To Be Exploited By Governments (35)
20:38 MLB In Talks To Offer Streaming For All Teams' Home Games In-Market Even Without A Cable Subscription (10)
15:55 Appeals Court Says Couple's Lawsuit Over Bogus Vehicle Forfeiture Can Continue (15)
13:30 Techdirt Podcast Episode 301: Scarcity, Abundance & NFTs (0)
12:03 Hollywood Is Betting On Filtering Mandates, But Working Copyright Algorithms Simply Don't Exist (66)
10:45 Introducing The Techdirt Insider Discord (4)
10:40 Daily Deal: The Dynamic 2021 DevOps Training Bundle (0)
09:29 Criminalizing Teens' Google Searches Is Just How The UK's Anti-Cybercrime Programs Roll (19)
06:29 Canon Sued For Disabling Printer Scanners When Devices Run Out Of Ink (41)
20:51 Copyright Law Discriminating Against The Blind Finally Struck Down By Court In South Africa (7)
More arrow