Category Archives: Data mining

The SAMI Data Archive: A Prototype of An Archive of the Future?

Astronomy data sets are not simply exploding in size – they are exploding in complexity too. Witness the data sets obtained from integral-field spectroscopy (IFS).  While the Sydney-AAO Multi-object Integral-field spectrograph (SAMI) survey has exceeded measurements of 1,000 galaxies, surveys such … Continue reading

Posted in astroinformatics, Astronomy, astronomy surveys, Computing, cyberinfrastructure, data archives, Data formats, Data Management, Data mining, databases, FITS, HDF5, High performance computing, informatics, information sharing, Open Source, Python, Scientific computing, software engineering, software maintenance, software sustainability, Uncategorized | Tagged , , , , , , , , , , , , | Leave a comment

How Does An Astronomer Become A Data Scientist?

I have been asked this question by several junior colleagues, so I thought my answer might be valuable to a broader audience. In particular, these young scientists were keen to learn how their skills might be transferable to another field. … Continue reading

Posted in astroinformatics, Astronomy, Career Advice, careers, computer modeling, computing videos, Data Management, Data mining, Data Science, databases, High performance computing, informatics, information sharing, programming, R, Scientific computing, software engineering, software maintenance, software sustainability, statistical analysis, statistics, Uncategorized | Tagged , , , , , , , , , , , , , , , , , | Leave a comment

Interactive Visualization of Billion-Point Data Sets: Nanocubes

One of the most interesting talks I heard at the “Tools for Astronomical Big Data” Meeting I attended in March was by Carlos Scheidegger (University of Arizona) on “How do you look at a billion data points? Exploratory Visualization for Big Data.”  It was … Continue reading

Posted in astroinformatics, computer videos, Computing, cyberinfrastructure, Data mining, informatics, information sharing, time series data, visualization | Tagged , , , , , , , , | Leave a comment

Tools For Astronomical Big Data

This week, I attended the Tools for Astronomical Big Data Workshop, held in Tucson from March 9 -11 and sponsored by NOAO. Over 100 practitioners gathered to “survey the present state of the art in addressing the challenges of conducting … Continue reading

Posted in astroinformatics, Astronomy, astronomy surveys, Catalogs, Cloud computing, cyberinfrastructure, Data Management, Data mining, databases, DBMS, Grid Computing, High performance computing, image mosaics, informatics, information sharing, Montage, Observatories, Parallelization, programming, Scientific computing, SDSS, social networking, software engineering, software maintenance, software sustainability, Uncategorized, user communities, visualization, XSEDE | Tagged , , , , , , , , , , , , , , , , , , | Leave a comment

From The Front Lines of ADASS 2014 – Visualization

Visualization technology is undergoing a transformation these days, and the October 7 morning session was devoted to advances in visualization. Here I will give a synopsis of some of the talks. Chris Beaumont described Glue as a “Hackable User Interface,” … Continue reading

Posted in astroinformatics, Astronomy, Computing, Data mining, High performance computing, informatics, information sharing, programming, publishing, Scientific computing, software engineering, software maintenance, visualization | Tagged , , , , , , | Leave a comment

SciPy2014 videos on-line

This year’s annual Scientific Computing with Python conference, SciPy2014, was held in Austin ,TX, July 6-12 2014.  This conference “… allows participants from academic, commercial, and governmental organizations to showcase their latest Scientific Python projects, learn from skilled users and developers, … Continue reading

Posted in astroinformatics, Astronomy, computer modeling, computer videos, Computing, computing videos, cyberinfrastructure, Data mining, High performance computing, informatics, information sharing, Parallelization, Python, Scientific computing, SciPy2014, social media, social networking, software engineering, software maintenance, software sustainability, user communities | Tagged , , , , , , , , , , , , | Leave a comment

The CAVE2 Immersive Visualisation Platform at Monash University

The availability of massive data sets is driving the development of new large-scale visualization systems. One such is the CAVE2 Immersive Visualisation Platform built at Monash University. Described as a next-generation immersive hybrid 2D and 3D virtual reality environment, this … Continue reading

Posted in astroinformatics, Astronomy, computer videos, Computing, computing videos, cyberinfrastructure, Data mining, High performance computing, image mosaics, informatics, information sharing, Parallelization, programming, software engineering, visualization | Tagged , , , , , , , , , , | Leave a comment