Category Archives: High performance computing

Scientific Workflows for Science and the Science of Scientific Workflows

In this era of compute intensive astronomy, tools for managing complex workflows are becoming a crucial part of our science infrastructure. This video offers a fine introduction to the Pegasus workflow manager by the team leader, Ewa Deelman (ISI, USC). … Continue reading

Posted in astroinformatics, Astronomy, Cloud computing, computer modeling, computer videos, Computing, computing videos, cyberinfrastructure, Grid Computing, High performance computing, informatics, information sharing, Parallelization, programming, Scientific computing, software engineering, software maintenance, software sustainability, Uncategorized, workflows | Tagged , , , | 1 Comment

Best Practices for HPC Software Developers

This is a series of seven videos describing best software engineering practices. I would recommend it to all  HPC software engineers. The series was the result of a collaboration between the IDEAS project, Argonne Leadership Computing Facility, NERSC, and Oak … Continue reading

Posted in astroinformatics, computer modeling, computer videos, Computing, computing videos, cyberinfrastructure, High performance computing, informatics, information sharing, Parallelization, programming, Scientific computing, software engineering, software maintenance, software sustainability | Tagged , , , | Leave a comment

Community Building Through Software Design

This the title of a very interesting talk (which I wish I had given myself!) by Jed Brown of CU Boulder at the 2017 NSF SI2 meeting. Jed is involved in writing code for the Portable, Extensible Toolkit for Scientific … Continue reading

Posted in astroinformatics, Computing, cyberinfrastructure, Data Science, High performance computing, informatics, information sharing, programming, Scientific computing, software engineering, software maintenance, software sustainability, Uncategorized, user communities | Tagged , , | Leave a comment

Spherical Panoramas for Astrophysical Data Visualization

This is the title of a paper by Brian Kent (NRAO), which has been accepted for publication in the PASP Special Focus Issue: Techniques and Methods for Astrophysical Data Visualization. You can download the paper from arXiv at https://arxiv.org/abs/1701.08807 .(I … Continue reading

Posted in Astronomy, computer videos, Computing, computing videos, cyberinfrastructure, High performance computing, information sharing, Milky Way, Montage, programming, publishing, Scientific computing, software engineering, visualization, workflows | Tagged , , , , , , | Leave a comment

From The Front Lines of SPIE Astronomical Telescopes and Instrumentation 2016

I attended the SPIE meeting on Astronomical Telescopes and Instrumentation in Edinburgh, Scotland from June 26 through July 1, and I am sharing my views on the conference presentations. Approximately 2,000 astronomers, software engineers and instrumentation specialists crowded the Edinburgh … Continue reading

Posted in astroinformatics, Astronomy, computer modeling, cyberinfrastructure, Data Management, databases, Gemini, Grid Computing, High performance computing, informatics, information sharing, programming, Scientific computing, software engineering, software maintenance, software sustainability, TMT, user communities, Virtual Observatory, visualization, W. M. Keck Observatory | Tagged , , , , , , , , , , , , | 2 Comments

The Pegasus Workflow Manager and the Discovery of Gravitational Waves

We have all heard so much about the wonderful discovery of Gravitational Waves – and with just cause! In today’s post, I want to give a shout-out to the Pegasus Workflow Manager, one of the crucial pieces of software used in … Continue reading

Posted in astroinformatics, Astronomy, Black Holes, Computing, cyberinfrastructure, Gravitational waves, High performance computing, informatics, LIGO, Operations, Parallelization, programming, Scientific computing, software engineering, software maintenance, workflows | Tagged , , , , , , , , , , , , , , | Leave a comment

The SAMI Data Archive: A Prototype of An Archive of the Future?

Astronomy data sets are not simply exploding in size – they are exploding in complexity too. Witness the data sets obtained from integral-field spectroscopy (IFS).  While the Sydney-AAO Multi-object Integral-field spectrograph (SAMI) survey has exceeded measurements of 1,000 galaxies, surveys such … Continue reading

Posted in astroinformatics, Astronomy, astronomy surveys, Computing, cyberinfrastructure, data archives, Data formats, Data Management, Data mining, databases, FITS, HDF5, High performance computing, informatics, information sharing, Open Source, Python, Scientific computing, software engineering, software maintenance, software sustainability, Uncategorized | Tagged , , , , , , , , , , , , | Leave a comment