April 13, 2009 4:00 AM PDT

How secure is the U.S. communications network?

by Marguerite Reardon
  • Font size
  • Print
  • 23 comments

A simple snip of a few fiber-optic communications cables left thousands of people in Silicon Valley and throughout parts of the San Francisco Bay Area without phone, Internet, or wireless service for more than 12 hours on Thursday.

The San Jose Police Department is investigating the incidents, which took place in two different locations in San Jose and San Carlos and classified as acts of vandalism. Now that the network is up and running again, people are asking how difficult is it to take down the nation's communications network? And should we be more worried about the fiber optic cables that ring our communities and crisscross the country carrying all of our communications?

"A couple of well-placed attacks could do a lot of damage to the communications network," said Sam Greenholtz, co-founder and principal of Telecom Pragmatics, a consulting and research firm specializing in the telecommunications market. "And it's not really that hard to figure out where the fiber optic cables are laid and to get access to them."

That said, Sgt. Ronnie Lopez of the San Jose Police Department said there is no reason yet to suspect terrorism in this case. But the FBI has been briefed on the case.

AT&T is offering a $250,000 reward to anyone who can provide information that leads to the arrest and conviction of the vandals.

"We are aggressively working with law enforcement authorities to see that those responsible for this willful act are apprehended and prosecuted to the fullest extent of the law," the company said in a statement Friday.

AT&T also said in a press release that following the terrorist attacks of September 11, 2001, its networks were declared National Critical Infrastructures, which means that anyone who tampers with, destroys, or disrupts the company's network or its components is in violation of both federal and state laws.

Wondering about vulnerabilities
Still, with recent reports that our nation's electrical grid has gotten less secure due to technological advances, incidents such as this one leaves many wondering how vulnerable the communications network really is.

I talked to a few experts about how telecommunications networks are built and how they operate. And I've concluded that while it's somewhat easy to figure out where fiber is laid and to gain access to the fiber infrastructure in the ground, it's much harder to actually cause major damage unless you know what you're doing.

Let me explain. In the AT&T fiber cut case, it was fairly easy for the perpetrator to access the fiber-optic cables that were eventually cut. Sgt. Lopez said that it appeared that whoever cut the fibers simply lifted the manhole cover, went down the ladder, and cut two cables.

But knowing exactly which manhole cover to open and which cables to cut that would cause widespread damage to the network is another story.

Greenholtz, who was a former manager in the Planning and Engineering Group at Verizon where he worked for nearly 28 years, said that causing a network outage of this magnitude was likely orchestrated by someone who not only knew which manholes provided access to AT&T fibers, but also knew which places on the network were most vulnerable and could cause the most damage.

"The manhole covers are not locked," he said. "Anybody can open them and go down there. But most of these networks have redundancy and diversity built-in to the architecture, so if you cut a cable, it reroutes itself and recovers."

Greenholtz explained that someone with knowledge of the network would know the most vulnerable points in the network and could pinpoint those areas.

Built in rings
AT&T declined to discuss specifics of the company's network architecture, but experts say that the Baby Bell phone companies, such AT&T's predecessor SBC Communications, typically built their regional fiber networks in rings. The rings themselves would help provide protection against an outage, because if a line were cut, the traffic could just reverse itself in less than 50 milliseconds and go the other direction around the ring.

But the phone companies also typically ran redundant lines that are spaced some distance apart from each other, so that if one line is cut, there is also a separate fiber carrying the traffic. And to ensure that the redundant line can handle excess traffic in an emergency, most phone companies run these systems at 50 percent capacity.

(Credit: Google Maps)

The fiber-optic cables that were cut in San Carlos, which were owned by Sprint Nextel, appear to have worked in this way. The traffic was quickly rerouted to another path, and service to Sprint's business customers was not interrupted.

Unlike regional networks, which have multiple fiber rings running through and between cities, undersea cables that connect continents do not have this type of redundant architecture because it's much too expensive to build it that way. This means that undersea cables are particularly vulnerable to fiber cuts. But because they are deployed beneath the ocean floor, they tend to be more difficult to tamper with. That said, cables are severed and massive outages do occur from time to time.

By contrast, some networks in highly trafficked regions or networks that service critical customers have even more redundancy built into them. Michael Howard, a principal analyst at telecommunications research firm Infonetics Research, said that carriers such as Deutsche Telekom have begun building meshed networks so that there is a third path for traffic if fibers are cut or there is some other disruption on the network.

"The more traffic there is on the route, the more redundancy the carrier provides," he said. "There are usually two aspects to a backup plan for networks. One is providing a diversity of virtual routes for the traffic, but the other is providing physically separate routes on separate fibers. I'd have to say the outage that occurred in Silicon Valley seems odd, given the traditional network architecture."

An inside job?
Indeed, AT&T's network failure seems to suggest that at least one other path that would have rerouted the traffic was also damaged or cut. Given that the police indicated that the incidents occurred in only two locations, San Jose and San Carlos, it seems likely that there was already some damage or issue happening on AT&T's network at the time the fiber was cut or the vandals managed to cut the ring in two places.

Of course, neither I nor any other expert could know this for sure. But the fact is that fibers are cut all the time in regional networks, and rarely do they cause massive outages that shut down entire regions for hours. Most of these incidents are accidents. Someone might be landscaping a yard and a back-hoe severs a cable. Or another utility worker accidentally damages a cable while working in the same manhole where communication cables are located.

"Fiber cuts happen more often than people realize," said Crystal Davis, a spokeswoman for Sprint Nextel. "It happens by accident all the time when someone is drilling or digging up a street. Or they're doing regular maintenance. We know this, and that's why traffic can be quickly rerouted."

This is also why Greenholtz believes that the AT&T fibers were likely cut by someone who knew the network and its potential weaknesses.

"If there was an ongoing maintenance issue on one side of the fiber ring that hadn't been addressed," he said. "And then the other side is cut, it would cause a major outage like the one AT&T experienced. But in order to cause that much damage, someone would have to know that. Otherwise, it was just a very lucky vandal."

More theories
This line of thinking has caused some bloggers to suspect that the vandal was a disgruntled former or current AT&T employee.

And some have even gone so far as to suggest that the perpetrator could be an unhappy union worker. AT&T is currently in contract negotiations with its largest union the Communications Workers of America, which represents some 80,000 workers at AT&T. Workers have already voted to strike if a new contract can't be agreed upon. So far, no date has been set for a strike, and Candice Johnson, a spokeswoman for the union said that the two sides are still negotiating.

But Johnson also said that the union was not involved in the vandalism and that claims that its members might be involved are unfounded.

"There is no basis for speculation that our members were involved in this act of vandalism," she said. "We are cooperating with authorities. We are currently at the bargaining table with AT&T management, and our workers are on the job. Our goal is to get a contract renewed."

Sgt. Lopez from the San Jose Police Department said that it's still too early in the investigation to talk about suspects or motives.

Regardless of whether the cables were cut by disgruntled employees or random vandals, the recent incident highlights the potential for such an attack to be undertaken on a broader scale by foreign terrorists, who may infiltrate our nation's telephone companies or gain access to information about the country's communications network. But Greenholtz and other experts say that because these networks have always been built with redundancy in mind, it would take a massive coordinated effort to target individual manholes and to cut fibers.

"If you really want to take down the communications network and cause damage, you'd probably target a central office," Greenholtz said.

A central office is the nerve center of a telecommunications network. It houses all the switching equipment and billing data for a particular region of the network. As an example, Greenholtz said that if a terrorist was able to damage Verizon's central office on 38th Street in Manhattan, communications services on Wall Street could be wiped out not just for a few hours, but likely for days, weeks, or even a month. Because these facilities are so critical, he said all the major phone companies have tight security.

"Those places have tons of security," he said. "You'd probably need Jack Bauer (of the TV show '24') to help you get in there."

Marguerite Reardon has been a CNET News reporter since 2004, covering cell phone services, broadband, citywide Wi-Fi, the Net neutrality debate, as well as the ongoing consolidation of the phone companies. E-mail Maggie.
Recent posts from Wireless
Q&A: Researcher Karsten Nohl on mobile eavesdropping
Online holiday sales hit $27 billion
Amazon touts top products of 2009
Leaked Nexus One documents: $530 unlocked, $180 with T-Mobile
Nokia hits Apple with latest patent complaint
Android and iPhone users not so different after all
AT&T resumes online iPhone sales in NY
GSM crypto code cracked, engineer says
Add a Comment (Log in or register) (23 Comments)
  • prev
  • 1
  • next
by ti99_forever April 13, 2009 5:25 AM PDT
Gee, we get fiber cuts every few months in Atlanta, a major hub for the southeast U.S., and nobody says a thing.
If it happens in California, look out! Here come all the stupid stories about "is our communications network safe?"
No, it isn't.
Reply to this comment
by MadLyb April 13, 2009 6:22 AM PDT
Exactly.

Forget the data centers, just look for the orange stake on the side of the road and start digging.
by gsigas April 13, 2009 7:23 AM PDT
Our communications networks are relatively safe (i.e. as safe as they need to be in relation to their importance). It takes specialized knowledge to disrupt service for several hours to thousands of people. This is low priority in terms of infrastructure security, protecting millions of people from weeks of outage (as the article mentions is being done by securing the central offices) is a much better use of resources. Water and power security are more important.
Reply to this comment
by shootfirst April 13, 2009 8:11 AM PDT
You really think the networks are safe, I find that highly funny. If you have enough time on your hands and the willpower you can find exactly what every cable is doing. It isn't that hard to take down multiple fiber connections in multiple areas with just people who can coordinate. The serious lack of willing to do maintenance on our infrastructure makes it easy. Probably why everyone thinks the networks are safe is that everyone in the US is just too lazy to do it, we'd have to import foreign workers to make it happen.
Reply to this comment
by bobiuryus April 13, 2009 8:26 AM PDT
When Marguerite Reardon went on to suggest a unhappy union worker
possibly committed the crime the true nature of this Article became
apparent, just another excuse to vilify America's labor unions.

I hope they catch the criminal or criminals, and that person or persons gets a life prison sentence without the possibility of
parole. A lot of life's where put in danger.

If Marguerite Reardon can do a little hack journalism, so can I.

Heres a example:

Before long senators and congressmen will be legislating for manhole cover laws.
I can see it now....United States Senator John McCain shouting "My friends, A safe manhole is a locked manhole, My friends!"

Or maybe they will vote to outlaw manhole covers altogether.

Maybe a manhole lock company salesman committed the crime, hoping to increase the need for manhole cover locks.

Has Marguerite Reardon herself ever been a member of a Union, or is currently a member of a Union?
I think we need to get United States Senator John McCain to have open hearings on this!

I think someone should get Jack Bauer (of the TV show '24')or Stan Smith (of the TV show 'American Dad!') working on this.

I think we need to call on Lieutenant Columbo, who has since changed his name
to Peter Falk to investigate why AT&T is only offering a $250,000 reward.

Maybe a White Collar Criminal committed the crime, you know some disgruntled executive, angry they didn't get enough of a executive bonus or didn't get any Tarp bailout money?

We do know that Bernie Madoff didn't commit the crime because hes in the Metropolitan Correctional Center pending sentencing.

We do know that Kenneth Lee "Ken" Lay ex CEO and chairman of Enron, didn't do it because hes in a witness protection program, has had a sex change and is now a
waitress in high class night club in Nassau .


Before long senators and congressmen will be legislating for manhole cover laws.
I can see it now....United States Senator John McCain shouting "My friends, A safe manhole is a locked manhole, My friends!"

Or maybe they will vote to outlaw manhole covers altogether.

Maybe a manhole lock company salesman committed the crime, hoping to increase the need for manhole cover locks.

Has Marguerite Reardon herself ever been a member of a Union, or is currently a member of a Union?
I think we need to get United States Senator John McCain to have open hearings on this!

I think someone should get Jack Bauer (of the TV show '24')or Stan Smith (of the TV show 'American Dad!') working on this.

I think we need to call on Lieutenant Columbo, who has since changed his name
to Peter Falk to investigate why AT&T is only offering a $250,000 reward.

Maybe a White Collar Criminal committed the crime, you know some disgruntled executive, angry they didn't get enough of a executive bonus or didn't get any Tarp bailout money?

We do know that Bernie Madoff didn't commit the crime because hes in the Metropolitan Correctional Center pending sentencing.

We do know that Kenneth Lee "Ken" Lay ex CEO and chairman of Enron, didn't do it because hes in a witness protection program, has had a sex change and is now a
waitress in high class night club in Nassau .
Reply to this comment
by bonesbautista April 13, 2009 9:03 AM PDT
Chiming in here only to point out the blog isn't suggesting that union workers are or were responsible.

Dozens of other articles and blogs have suggested it, and I was reading them within hours of the apparent sabotage. This blog's clearly putting out there that others are suggesting it, and she's fair in referring an official source indicating that it's too early to talk about suspects or motives and she included a statement that the unions are not involved.

The blog's about the overall security of the communications system, not about union bashing. I'm not bashing you or the unions either - I work with union employees and I'm fair to them. Be fair to the writer's content.
by Farthing Haypenny April 13, 2009 11:58 AM PDT
What's the problem with Unions? They are only government backed labor monopolies just like the Cable Companies and Phone Companies are government backed telecommunications monopolies. I'm sure we are all happy to pay more for worse service so that Union workers can get paid more, just as we are happy to pay more for worse service from our ISP's so that they can make bigger profits, or stay in business when a company with their debt load (from massive acquisitions) would normally be bankrupted. This country is all about the underdog, we will not let our outdated labor unions go down in that Darwinian struggle known as Capitalism any more than we'd allow our bloated telecommunications monopolies go down. The fact that their replacements would provide better products at cheaper prices doesn't enter into the equation, as companies and labor unions not already in possession of massive market share cannot afford to bribe the government to do their bidding.
by Dalkorian April 13, 2009 3:00 PM PDT
Forget about that moronic Jack Bauer hack - Stan Smith will have this solved in 15 minutes!
;-)
by yankeeforever April 13, 2009 8:29 AM PDT
AT&T does not have good service, at least in my area. I have a cell phone account with them and they are impossible when help is needed.
Reply to this comment
by Bill_I April 13, 2009 9:17 AM PDT
Get Verizon Wireless when your contract expires. CDMA sounds better, and the time of day displayed on your phone is spot-on.
by Dalkorian April 13, 2009 3:03 PM PDT
AT&T
Your World.
Delivered.
To the NSA, the RIAA and whoever else we feel like.
Who are you to question the rulers of the Death Star?
OBEY YOUR MASTER!
Give us your money and shut up already, slave!
by ps_dunne April 13, 2009 9:47 AM PDT
We're in Morgan Hill and our business was down cold the entire day.

No Internet. No phones. No cellular service--and we all use different carriers, ranging from AT&T, Verizon, T-Mobile, Sprint.

How does one explain that? The only thing that was working was SATELLITE services.

Something to consider...
Reply to this comment
by MD_Willington April 13, 2009 9:49 AM PDT
No infrastructure will ever be 100% secure...

We can secure comms for the electrical grid and phone networks, but one drunken driver can physically ruin that in an instant.
Reply to this comment
by ps_dunne April 13, 2009 10:00 AM PDT
We're in Morgan Hill and our business was down cold the entire day.

No Internet. No phones. No cellular service--and we all use different carriers, ranging from AT&T, Verizon, T-Mobile, Sprint. How does one explain that? Cable internet (Charter) was also down in the area.

The only thing that was working was SATELLITE services. Something to consider...
Reply to this comment
by pjk0 April 13, 2009 10:56 AM PDT
The reason the other cellular networks were down is because ATT is the local ILEC (telco) in the SF Bay Area, therefore the other cellular networks rely to a large extent on the local ILEC's telecom infrastructure to backhaul their cellular traffic from their towers to their own networks. (In some locations they might be using their own microwave links, but in most cases cellular towers are interconnected via the local ILEC copper/fiber network)

For example - if this had occurred in New York state instead, then chances are the local ILEC would have been Verizon, so cutting ATT fiber would have been less critical there.
by Khurt April 13, 2009 10:49 AM PDT
I can now see some politician requiring more background checks on utility workers. Meanwhile, executives and other white collar types escape scrutiny despite repeatedly fracking over the economy.
Reply to this comment
by cohaver April 13, 2009 11:37 AM PDT
Redundant Network it that simple Most Construction on AT&T was done by contractors the maintenance of network is done by employees. Communication between nodes had to be poor in order for such failure. So both Employees and Contractors would have information to a networks weakness all would be subject to investigation. Every business that needs communication that bad should have a Redundant communications system. Utility Locations Services would also know Network Layout . If the plan was filed at a zoning office so would they. Local Police would have that information. Today's information is not 100 % secure .
Reply to this comment
by Stellacharli April 13, 2009 1:04 PM PDT
Where is Atlanta??????
Reply to this comment
by Dalkorian April 13, 2009 3:06 PM PDT
This comment must be in jest, right? You can figure out how to turn on your computer, connect to a blog and make a comment but you can't think to look at a map?
by gggg sssss April 13, 2009 2:39 PM PDT
terrorists, unions, same mindset, same effect
Reply to this comment
by Dalkorian April 13, 2009 3:07 PM PDT
You must be a classmate to Stellacharli above.

Two proofs that our school system has failed us.
by gggg sssss April 13, 2009 3:24 PM PDT
@ Dalkorian google att union sabotage. And what daycare did you / are you going to?
Reply to this comment
by Steve_KTG April 13, 2009 11:00 PM PDT
A little nerve racking to say the least. At least Obama has mentioned Cyber Security and the millions of tangents off of that are a priority, as discussed at this link http://www.justaskgemalto.com/en/news/obama-gets-sort-serious-cyber-security. The title says it all really. At least they are past Step 1: Admit you have a problem.
Reply to this comment
(23 Comments)
  • prev
  • 1
  • next
advertisement

15 sites that went kaput in 2009

Web sites launch all the time, but they also shut their doors. We highlight 15 that bit the dust this year.

Top 10 news stories of the decade

Let the debate begin: Was the iPhone more important than iTunes? Was anything bigger than Google finding a great business model? CNET offers its list of the 10 most important stories of the '00s.

About Wireless

Check out the latest wireless news on CNET News, featuring the latest news on cell phones, mobile gear, VOIP, and internet access via broadband and wireless connections.

Add this feed to your online news reader

Wireless topics

advertisement
advertisement

Inside CNET News

Scroll Left Scroll Right