Magellan: Experiences From A Science Cloud

This is the title of a paper presented  by Lavanya Ramakrishnan et al. at the ScienceCloud2011 workshop (paper; slides). Magellan is a project funded through the Department of Energy’s (DOE) Advanced Scientific Computing Research (ASCR) program, to investigatethe use of cloud computing for science at the Argonne Leadership Computing Facility (ALCF) and the National Energy Research Scientic Computing Facility
(NERSC).  Ramakrishnan et al. describe their experiences in using Magellan to support science applications chosen from Genome Sequencing of Soil Sampling, Climate Change and the STAR nuclear physics experiment.

STAR Nuclear Physics Analysis on Magellan

STAR Nuclear Physics Analysis on Magellan

They used a testbed that contained virtualization software such as Eucalyptus, Open-Stack, and Hadoop (an open source implementation of MapReduce) to study issues such as whether open-source cloud software stacks are clouds are ready for DOE science applications.

Their conclusions:

  • Current day cloud computing solutions have gaps for science:
  • performance, reliability, stability need to improve
  • programming models are difficult to apply to  legacy apps
  • security mechanisms need to improve (e.g.root privileges for untrained users may be serious risk)
  • Nevertheless, HPC centers can improve service and policies by adopt some of the technologies and mechanisms used by Magellan:
  •  support for data-intensive workloads
  • allow custom software environments
  •  provide different levels of service
This entry was posted in Cloud computing, cyberinfrastructure, High Energy Physics, High performance computing, information sharing, Parallelization, programming, software engineering, software maintenance, software sustainability and tagged , , , , , , , , , , . Bookmark the permalink.

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s