SciNet’s Infiniband Upgrade on The HPC Rich Report

June 16, 2012 in blog, blog-general, in_the_news

Our CTO, Dr. Chris Loken, was on this week’s Rich Report HPC podcast with Gilad Shainer of Mellanox and the HPC Advisory Council describing our recent Infiniband upgrade and the improvements that means for our user community; the podcast was also featured on Inside HPC.

 Using Mellanox end-to-end InfiniBand solutions, SciNet has improved reliability and stability of their file systems, greatly improving the performance of parallel user jobs and user efficiency. SciNet is experiencing at least 15-20% increased performance out their upgraded cluster and expects to be high on the TOP500 list when the update is issued at ISC.

SciNet at the University of Toronto Selects NextIO vCORE™ Express 2070 GPU Computing Solutions

April 5, 2011 in in_the_news, news

Pioneer in rack-level IO consolidation and virtualization solutions at SciNet:

SciNet at the University of Toronto Selects NextIO vCORE™ Express 2070 GPU Computing Solutions

NextIO, the pioneer in rack-level IO consolidation and virtualization solutions, today announced that The SciNet Consortium at the University of Toronto has selected the company’s vCORE Express 2070 GPU systems to power scientific research in a variety of academic areas including astrophysics, aerospace, cosmology simulations and computational combustion.

For more information please visit: MRO Magazine

 

HPCS and ORION in the News

May 21, 2010 in in_the_news, news

HPC community converges at HPCS2010

Supercomputers help Canada address world’s top research challenges

TORONTO – Canada’s supercomputing community, responsible for some of the country’s most exciting scientific discoveries and global research collaborations, will soon converge in Toronto to address how best to support some of the world’s greatest research challenges.
HPCS 2010 (High Performance Computing Symposium), hosted by SciNet and Compute Canada at the University of Toronto June 5 to 9, is Canada’s largest gathering of HPC researchers.
One of the goals of the conference is to raise awareness of HPC and the researchers who use these technologies to address some of the most important research “grand challenges” of our times, from finding the cure for cancer, to deciphering the mysteries of the universe.
“It’s important to appreciate the benefits of Canada’s HPC-enabled research and scientific collaborations. They have a direct relationship to our ability to compete and innovate and to create and sustain jobs in our new economy,” says Chris Loken, Chief Technical Officer of SciNet, Canada’s fastest supercomputer and one of the world’s top HPC facilities.
ORION, which provides the enabling high-speed network infrastructure which allows some 30 Ontario institutions to engage in shared and distributed HPC resources and collaborations, is a major sponsor of HPCS 2010.
“Canada is making significant contributions to global research,” says Phil Baker, President and CEO of ORION. “You can say that our HPC resources are helping Canada punch above its weight when it comes to significant and meaningful scientific discoveries, especially in the areas of the environment and climate change, physics and cancer research,” he says.
Across Canada and around the world, research is increasingly dependent on access to high performance computing, dedicated high-speed research networks and data resources and tools. In Canada, these integrated resources represent close to a petaflop of computing capability and online and long term storage, with access and retrieval over Canada’s national, provincial and territorial high-performance networks.
Suzanne Fortier, president of the Natural Sciences and Engineering Research Council of Canada (NSERC) is among the keynotes addressing the conference, which is co-presented by Compute Canada, the national organization that is implementing a powerful national HPC platform for research with seven partner consortia across the country.
Attending are research leaders from the consortia, including ACEnet (Atlantic Computational Excellence Network), CLUMEQ (Consortium Laval, Université du Québec, McGill and Eastern Québec), RQCHP (Réseau québécois de calcul de haute performance), HPCVL (High Performance Computing Virtual Laboratory – Queen’s University), SciNet (University of Toronto); SHARCNET (Shared Hierarchical Academic Research Computing Network – Ontario); and WestGrid (Western Canada Research Grid).
Delegates will include computational researchers from all disciplines in industry and academia, computer scientists and vendors, including IBM, Intel, Dell and Microsoft among others.
Canada’s extended research and education community, as well as partners from business and industry who want to learn more about the current state and future direction of HPC technologies and their capabilities, are invited to attend the conference.

Learn more at www.hpcs.ca  / www.computecanada.org / www.orion.on.ca

The Bulletin: University of Toronto supercomputer among 20 fastest machines in the world

June 23, 2009 in in_the_news, news

Link to the Bulletin article on SciNet

Tuesday June 23rd 2009
http://www.news.utoronto.ca/media-releases/university-of-toronto/university-of-toronto-supercomputer-among-20-fastest-machines-in-the-world.html

University of Toronto supercomputer among 20 fastest machines in the world

Canada’s fastest and most powerful supercomputer, located at the University of Toronto and built by IBM, has been ranked 16th on the top 500 list of the most powerful commercially available computer systems in the world. The top 500 list was announced today at the annual International Supercomputing Conference in Hamburg, Germany.

“With a high-performance computer that is among the top 20 on the planet, the University of Toronto has become one of the world’s premier computational research institutions,” said Professor Paul Young, vice-president (research) “The supercomputer will attract researchers from around the world and will enable us to conduct research in a variety of disciplines that will have a direct and positive impact on society.”

Designed by IBM and SciNet, a consortium that includes the University of Toronto and affiliated research hospitals, the IBM System x iDataPlex is part of a supercomputer facility that pioneers an innovative hybrid design containing two systems that can work together or independently, connected to a massive five petabyte storage complex able to store the contents of more than one million DVDs – which would stack more than twice the height of the CN Tower. The iDataPlex server is specifically designed for data centres that require high performance, yet are constrained on physical space, power and cooling infrastructure.

With more compute power than existed on Earth at the end of 2001, the iDataPlex is capable of performing over 300 trillion calculations per second – more than 10 times faster than any other research system in Canada. “If you gave a calculator to every single man, woman and child in Canada and had them each do one calculation per second, it would take the entire country four months to do what this machine does every second,” said Chris Loken, chief technical officer at SciNet. It is the world’s fourth most powerful system built on a university campus and the second most powerful university system outside the United States. The extraordinary speed of the iDataPlex comes from the 7,500 Intel Xeon© Processor 5500 series 2.53 GHz processors inside. This model outperforms the previous generation Intel Xeon© Processor 5400 series by over 2.25 times within a similar power configuration.

“Congratulations to the University of Toronto’s SciNet installation being recognized as the largest and most powerful supercomputer in Canada,” said Richard Dracott, Intel’s general manager of high performance computing. “We are honoured to have platforms based on the Intel Xeon© processor 5500 series to drive Scinet’s objectives to solve some of the most complex challenges facing our planet.”

The iDataPlex system will enhance U of T’s competitive position in global research projects in aerospace, astrophysics, bioinformatics, chemical physics, medical imaging and climate change prediction by analysing high-resolution global models to predict future risks, including the faster-melting Artic sea ice. Another immediate project is the construction of regional climate change predictions for Ontario and the Great Lakes watershed region.

The system will also play a key role in the global ATLAS project, using data collected by the Large Hadron Collider in Geneva to explore the modern scientific mystery of why matter has mass and what constitutes the mass of the universe. Because of its hybrid design, the system is extremely flexible and capable of running a wide range of software at a high level of performance.

The system provides up to five times the density versus competitive offerings and can regulate the data centre’s temperature 70 per cent more efficiently with IBM’s Rear Door Heat Exchanger and is entirely water cooled. Intel technologies like Integrated Power Gates, which automatically turn off any processors when not in use, will further assist in energy savings, making the system among the most efficient. The state-of-the-art design saves enough energy to power more than 700 homes for a year.

“We are particularly proud of the cooling system, which makes this one of the most energy-efficient supercomputer installations in the world,” Loken said. “Typically, 40 to 70 per cent of the energy going into a data centre is used for cooling or is lost for other reasons, while we expect our non-computing overhead to be reduced to 16 per cent. The data centre’s design makes use of free cooling for roughly one-third of the year.”

The iDataPlex system adds to SciNet’s existing supercomputer capability, which includes an IBM Power 575 system with 3,328 POWER6 processing cores with peak performance of more than 60 trillion calculations per second. SciNet is one of seven consortia that comprise Compute/Calcul Canada, a national high-performance computing resource for academic institutions. Funding for SciNet has been provided by the Canada Foundation for Innovation’s National Platforms Fund, in partnership with the Government of Ontario and the University of Toronto.

TOP500 Ranking: Net’s GPC ranks higher than previously forecasted

June 23, 2009 in in_the_news, news

The SciNet GPC- iDataplex system, which had been forecasted to rank in the top 25, comes in at a staggering #16 on the TOP500 List of the world’s top supercomputers.  The TCS- Power6 system, which was ranked at #53 in the November list still stays in the running at #80 this summer.

The Globe and Mail: Canada’s monster computer roars to life

June 18, 2009 in in_the_news, news

Link to Globe and Mail article on Scinet

Thursday June 18 2009:
http://www.theglobeandmail.com/news/technology/canadas-monster-computer-roars-to-life/article1186431/

The Globe and Mail: Canada’s monster computer roars to life

It has taken a year and $50-million to put together, and its brain takes up as much room as a warehouse full of refrigerators.

Today, the monster finally opens its eyes, as the University of Toronto’s newest supercomputer – the fastest such machine in Canada – goes online.

There’s no shortage of beastly metrics by which this computer’s power can be measured: It can perform more than 300 trillion calculations a second, simulate the Earth’s climate 100 years into the future in four days and help researchers study cosmic background radiation, a calculation-intensive task that offers a glimpse into what the universe looked like 13 billion years ago.

“This positions us on a world research stage at a whole new level,” said Chris Pratt, strategic initiatives executive at IBM Canada. “This isn’t one step or two steps; this is like, ‘Wow.’”

A small part of the IBM System x iDataPlex server has been operating since late last year, humming away in a Vaughan-area warehouse. But today, the machine’s full power is unleashed.

Almost everything about the system sounds improbable.

It uses the same amount of energy, at peak consumption, as 4,000 homes. It is about 30 times more powerful than the next-fastest research computer in Canada. It can whirl data through its digital veins at the rate equal to about two DVD movies a second. It is among the 15 fastest computers in the world, and the fastest outside the United States.

Or think of it this way: If you’ve purchased a decent home computer lately, it may have come with a relatively fast 2.53 gigahertz processor. Or maybe you shelled out more for a fast, top-of-the-line “quad core” system, which runs on four such processors.

U of T’s new toy runs on 30,240 of them.

For a system that’ll suck up at least $1-million worth of energy a year, it seems odd to describe the computer as energy efficient, but, in the superlative-laden world of supercomputers, it is.

The computer monitors its individual units continuously, and shuts off any that aren’t in use for more than about 10 minutes.

IBM’s designers also came up with what seems like a pretty obvious way to reduce cooling costs: let the Canadian winter do it. Every time the outdoor temperature drops below a certain point, the computer uses the cold from the air to chill out. In total, IBM estimates the same supercomputer’s energy use would be equivalent to that of about 750 more homes if it were designed using traditional methods.

“It’s a really impressive, world-class facility,” said Chris Loken, the chief technical officer for the SciNet consortium, which is responsible for getting the supercomputer built. “It’s going to give a lot of scientists access to some really powerful resources.”

The supercomputer’s uses, Mr. Loken notes, vary from planetary physics to aerospace research to medicine. For example, the machine will act as a data centre for the Large Hadron Collider – the world’s largest atom smasher, located underground near Geneva – which can generate more than 40-million collisions a second. Researchers are already using some of the computer’s capacity to study cosmic background radiation.

But even for a computer as powerful and expensive as this one, its reign among the world’s heavyweights will be short-lived. Both Mr. Loken and Mr. Pratt admit that, given the pace at which technology is moving, U of T’s supercomputer will be eclipsed by several faster machines in the next few years.

“It will not be in the top 20 systems next year,” Mr. Loken said. “But there’s still going to be a lot of awfully good research that can be done on it.

“There’s really good science being done now on number 100 and number 500.”

The Toronto Star: U of T supercomputer probes origins of the universe

June 18, 2009 in in_the_news, news

Link to Toronto Star article on SciNet

Jun 18, 2009:
http://www.thestar.com/article/652745

U of T supercomputer probes origins of the universe
Go on. Ask this IBM System x iDataPlex to do as many calculations as there are stars in our Milky Way Galaxy.  Hold on. It won’t take a second. Not even close to one.Although its name may be ungainly, the University of Toronto’s new supercomputer performs so elegantly it can churn through 300 trillion pieces of information in the time it took Jamaican sprinter Usain Bolt to run 10 metres at a Toronto track meet last week.And with a measly 200 to 400 billion stars in the Milky Way, galactic-sized calculations will be child’s play.But the new computer – which vaults to the position of Canada’s most powerful upon having its last piece fired up today – will be charged with solving both astronomical and earthbound problems.

“This is to computing what the CN Tower was to architecture in Canada,” says Chris Pratt, an executive with IBM Canada.

“It has the ability to simulate and predict about 1,000 years of the Earth’s climate in about four days.”

Built for U of T’s SciNet Consortium, which includes the school’s research hospitals, the computer will be working on everything from medical imaging and the likely progress of climate change to the forces at play as the universe dawned some 13 billion years ago.

The system, which began operating in stages last year, puts some 30,240 of the world’s most powerful Intel processors together in 45 file-like stacks. It can run as many of those processors as required.

And, according to the latest TOP500 ranking of supercomputers, it enters full service as the world’s 12th most powerful.

That ranking has already helped SciNet attract world-class research, including a share of the work on the origins of the universe that will be conducted by the Large Hadron Collider project in Geneva in September. The collider will smash protons together at near-light speeds, to try to emulate conditions around the time of the big bang.

The new Toronto computer won a prestigious place among a select group of similar facilities across the globe that will try to find the big bang signatures among billions and billions of such daily collisions.

It will also be used to simulate protein creation and interactions, and help crunch the numbers on ice cap melting and weather conditions that will come with climate change.

Such computing prowess requires a correspondingly impressive input of energy – enough to power as many as 4,000 homes, Pratt says. The resulting heat generation would fry both the computer and the building in which it’s housed, but for the computer’s unique, water-based cooling system.

The system pipes water via tubes strung throughout the computer, often down to the microchip level, and dissipates it through heat exchangers on the roof.

CBC News: Toronto team completes Canada’s most powerful supercomputer

June 18, 2009 in in_the_news, news

CBC News article on SciNet

Thursday, June 18, 2009:
http://www.cbc.ca/technology/story/2009/06/18/tech-090618-ibm-supercomputer-scinet-toronto.html

Toronto team completes Canada’s most powerful supercomputer
A supercomputer that can complete more than 300 trillion calculations per second — the most powerful in Canada — has been completed at the University of Toronto’s SciNet facility.

The IBM iDataPlex cluster computer would be one of the top 15 most powerful supercomputers in the world, based on the online Top 500 list, said a release Thursday announcing the supercomputer’s completion.

The project was a collaboration between SciNet, IBM Corp. and Compute Canada, an umbrella group that represents academic high-performance computing groups across the country.

Researchers hope to use the machine’s vast computing power to:

  • Analyze data from the Large Hadron Collider, the world’s most powerful particle accelerator.
  • Analyze high-resolution climate change models, including ones that predict the decrease in Arctic sea ice and regional climate change predictions from Ontario and the Great Lakes watershed region.
  • Conduct research on aerospace, astrophycis, bioinformatics, chemical physics, medical imaging, and the ATLAS research project on forces that govern the universe.

The cluster uses 30,240 Intel processor 5500 series 2.53 GHz processor cores and is cooled using water.

TechKnowFile

May 26, 2009 in in_the_news, news

Canada’s Fastest Supercomputers: Daniel Gruner and Chris Loken, SciNet Consortium

SciNet is a new High-Performance Computing consortium based at University of Toronto which operates Canada’s two fastest supercomputers in a new, highly energy-efficient datacentre. We will discuss the challenges of designing, building and operating a cluster with 30,000 cores and the surrounding infrastructure as well as the software systems.

TechKnowFile: http://techknowfile.org/

IBM: Canada’s most powerful Supercomputer

May 8, 2009 in in_the_news, news

Learn about how IBM and the University of Toronto’s SciNet Consortium built Canada’s most powerful and energy efficient supercomputer in this video created by IBM.
Video located on the right side of page: http://www-03.ibm.com/systems/deepcomputing/
The video does not work in Firefox on all machines, please use Internet Explorer if you’re having trouble viewing.