Computation scientists prepare to support collider research through grid computingBy Steve Koppes
Sometime in 2007, the largest scientific instrument ever built will begin flowing massive quantities of data into an international network of computer centers, including one the University is operating jointly with Indiana University. The first phase of the Chicago-Indiana center, formally known as the Midwest Tier-2 center, is now up and running, crunching test data in preparation for the real thing.
The Chicago-Indiana system is one of five Tier-2 (regional) centers in the United States that will receive data from one of four massive detectors at the Large Hadron Collider at CERN, the particle physics laboratory located in Geneva, Switzerland. When the new instrument begins operating late next year, protons will collide 40 million times a second, and each of those collisions will produce approximately 30 interactions between various types of subatomic particles.
“Understanding what’s interesting and useful to record from those interactions is quite a challenge, because there is far more information than one is able to record for leisurely analysis,” said James Pilcher, Professor in Physics and the College.
Pilcher is among the physicists at 158 institutions in 35 nations who will harness the unprecedented power of the new collider in the ATLAS (A Toroidal Large Hadron Collider Apparatus) experiment at CERN. One of the goals will be to look for the long-sought Higgs boson, the theoretical particle that endows all objects in the universe with mass. Another goal: search for evidence of supersymmetric particles, which could lead to the discovery of extra dimensions.
Physicists at Chicago and Indiana built components for the ATLAS particle detector with the search for the Higgs boson and supersymmetry in mind. The University’s Computation Institute and Indiana University’s Information Technology Services also collaborate on scientific grid-computing projects that provide high-speed network computer power on demand, much the way a power grid provides electricity.
“In high-energy physics as in many disciplines, the computers and software used to analyze experimental data are now as vital to scientific success as the experimental apparatus that generate the data,” said Ian Foster, Director of the Computation Institute and a pioneer of grid computing. “This new Tier-2 center emphasizes the strengths that we have developed within the Computation Institute in creating and applying innovative computational infrastructure.”
Data from the ATLAS experiment will first flow to Tier-0, the main computational center at CERN. Tier-0 will then transmit the data to 11 Tier-1 centers worldwide, including Brookhaven National Laboratory on Long Island, N.Y. Brookhaven will, in turn, distribute portions of the CERN data to the various Tier-2 centers.
The Chicago-Indiana Tier-2 center will serve physicists from around the world, said Robert Gardner, Senior Research Associate in the Computation Institute and the project’s principal investigator. “It’s really driven not so much by where the physicists come from, but what their interests are,” Gardner said.
The Chicago-Indiana Tier 2 center is connected to a national computing infrastructure called the Open Science Grid, a national network dedicated to large-scale, computing-intensive research projects. “We run jobs from anyone who’s participating in this Open Science Grid,” Gardner said, whether their research involves particle physics, biology or some other topic.
Sites connected to the Open Science Grid include Fermi National Accelerator Laboratory in Illinois. Fermilab also is a Tier-1 center of the Large Hadron Collider’s Compact Muon Solenoid experiment. Fermilab is operated for the U.S. Department of Energy by Fermi Research Alliance, which consists of the University and Universities Research Association, Inc.
The initial set of computer servers, data storage and networking equipment of the multiyear project has been deployed in the basement of the Research Institutes building at Chicago and at the Indianapolis campus of Indiana University, both of which will serve ATLAS data over the Open Science Grid. This month, the sites will begin to bring to the national infrastructure computing power that is equivalent to 300 personal computers, via wide-area connections that can transfer data at 10 gigabits per second. This speed would be much the same as exchanging all the music stored on one iPod within a second or two.
Nevertheless, the Tier-2 managers at both institutions regard the center as a single entity. “If our users apply for an account, we go through a security protocol that meets the common requirements for both universities, nationally for the Open Science Grid and internationally for ATLAS, but we have them do that once. They don’t have to do it twice,” said Frederick Luehring, a senior research scientist at Indiana University. And if a hardware problem arises at Chicago, an Indiana technician may address the problem, or vice versa. It is a philosophy inspired by the culture of high-energy physics that physicists enjoy at CERN.
The National Science Foundation provides funding to the Chicago-Indiana Tier-2 center with annual $600,000 grants. The project also was made possible by previous investments from the states of Illinois and Indiana in I-WIRE (Illinois Wired/Wireless Infrastructure for Research and Education), and I-Light (Indiana’s high-speed fiber optic network for higher education and research).
“They’re common infrastructure projects for the research community in the United States,” Gardner said. “We’re going to be early beneficiaries of these investments.”