- This topic has 1 reply, 2 voices, and was last updated 16 minutes ago by
.
-
Posts
-
After several years of observing, I’ve accumulated a huge amount of astronomical data in FITS format. I’m curious how others organize and index their collections. Are there any good software tools that handle this well and keep large datasets properly organized and searchable?
After several years of observing, I’ve accumulated a huge amount of astronomical data in FITS format. I’m curious how others organize and index their collections. Are there any good software tools that handle this well and keep large datasets properly organized and searchable?
I use a PostgreSQL database to hold all the metadata for my collection of images, almost all of which is in the form of FITS-format images. My collection now has just short of 45K images in the database, with a similar amount yet to be processed. I do not know whether that is huge by your standards but PostgreSQL can certainly manage several orders of magnitude more than that. PostgreSQL is OS-agnostic and is used by many professional sites to handle databases — up to at least a terabyte..
Being a command-line geek, I tend to search it through direct SQL commands. A number of pointy-click GUI applications are readily available, again OS-agnostic.
Very willing to provide the schema and associated software to anyone who would like it. If it is of general interest we can continue the discussion here. If not, please contact me by PM or email.
Works well for me. YMMV.
Paul
- You must be logged in to reply to this topic.