The Los Alamos National Lab has shut down two of its largest supercomputers, as wildfires continue to burn near this sprawling New Mexico facility.
There were no wildfires on laboratory property, but smoke is prevalent throughout the area. The National Weather Service has called air quality "potentially unhealthy," and Los Alamos residents are being urged to minimise exposure to it. The lab will be closed through Thursday.
A Los Alamos spokeswoman said the laboratory conducted an "orderly shutdown" of two of its largest supercomputers, IBM's Roadrunner, the first the break the petaflop barrier in 2008, and now the 10th ranked most powerful supercomputer in the world, and Cielo, a Craig system that is ranked No. 6 on the Top500 list.
The supercomputer shutdowns were conducted "early on," but an exact day or reason for the action wasn't clear. The laboratory was first closed on Monday in response to wildfires that have now burned more than 100 square miles.
Smoke is a potential threat to data centres and IT equipment. It can trigger a shutdown of air handling systems and IT equipment. Particulates from smoke can damage components. And this has been a record year for smoke-producing wildfires.
According to the National Climate Data Center, there were 6,625 fires which burned approximately 1.1 million acres in May, the most acres ever burned during that month since records began. The amount of acreage burned so far this year is 3.45 million acres, "the largest in the 12 year period of record," the climate centre said.
The problem with smoke is that it "is so fine that it can get into things like your hard drive, it can get between your processors and your motherboards, it can get in between your ram and motherboards," said Jason Burnett, the director of infrastructure at NeoSpire, a managed hosting provider.
Texas has experienced some big wildfires, and it also had a lot of heat, which is why NeoSpire uses internally air-conditioned air for cooling and not external air, in what's called a closed loop system. "For our specific purposes I wouldn't be affected [by wildfires] at all because I don't take any air from the outside in," Burnett said.
He said his air cooling approach is a common one in the southwest because of hot temperatures.
In more northern and cooler climates, data centres are increasingly using outside air, or airside economisers. These designs typically include sufficient filtration to address external issues, said Tad Davies, executive vice president of the Bick Group, a company whose work includes data centre design.
In the case of wild fire activity, the data centre would resort to a backup closed loop system. If smoke has infiltrated the building, the smoke detectors will shut down the air handling units.
Once the cooling systems are shut down "you are kind of done," said Vince Renaud, managing principal and vice president of the Uptime Institute. Meaning that once cooling systems turn off, the IT equipment will hit their temperature thresholds rather quickly. At that point, systems have to be shut down, he said.
Jeff Pederson, vice president of data recovery operations at Kroll Ontrack, said the threat of smoke is more of an issue for small businesses that aren't running traditional data centres with monitoring equipment. Pederson said he sees problems in businesses and in homes with cigarette smokers, where the smoke affects performance and increases the likelihood of a physical crash.
But Burnett does expect to see more wildfires in Texas. He said he grew up in the country, on a cattle ranch out in south Texas, and sees the population getting closer to rural areas and places which don't have same firefighting equipment available in developed areas.
"I think [wildfires] are going to be a lot more prevalent as the urban creep keeps happening," Burnett said.