DM work package : Characterisation Data Model

!!!New page(Feb 2010)!!! Work in progress : Site under re construction


This workpackage is aiming at defining the high level metadata necessary to describe the astronomical data sets on their physical axes, either observed or simulated, for various types of data like 2D-images, data cubes, X-ray event lists, IFU data, etc.. The goal is to provide an abstraction which contains structured information for all these types of data so that discovery and interpretation is feasible in a general framework, and can be used jointly for science cases. The model aims at facilitating the manipulation of heterogeneous data in VO portals. A VO Characterization instance can include descriptions of the data axes, the range of coordinates covered by the data, and information on the data sampling and resolution on each axis. These descriptions are in terms of physical variables, with the specific instrumental signature abstracted away.

Characterisation 1 Legacy

* Characterisation Data Model effort led to a publication of a version 1 of the Data Model in 2008 (see legacy page)

Towards Characterisation version 2

From September 2007 on, a new effort started to take into account both dissemination of the model in Data centers and completion of the model for some complex use cases.

List of participants

Mireille.Louys, Alberto.Micol, Igor.Chilingarian, Peter.Skoda, Fabien.Chereau, Carlos.Rodrigo, Miguel.Cervino, Juan De Santander, François Bonnarel, Anita Richards, J.Mc Dowell, Gerard Lemson. After October 2008 Interop meeting work mainly involved I.Chilingarian , M. Louys and F.Bonnarel

Sorting out the issues

In April May 2008 we started to discuss the issues and Fabien proposed a new definition of the characterisation concept.

Building Examples

A couple of examples in XML were developed by extending Characterisation schema 1.11 to fullfill following use cases:

* Polarization images : with 3 flux axes (xml,Grid view)

* Polarization images : with one complex flux axis

* Complex characterisation (CCD mosaic case)

Discussion on these examples can be read there.

Model Simplification

The discussion also enhanced the difficulties to implement the data models in services and archives due to ill-definition of some concepts, complexity of xml definition or lack of protocols to transport model-consistent metadata. Summary of the discussion can be found here. Fabien Chereau presented his own views at the baltimore Interop, and some JSON serialisation of the characterisation datamodel has been proposed by T.Boch.

Topic attachments
I Attachment History Action Size Date Who Comment
PDFpdf AfterTrieste.pdf r1 manage 51.0 K 2010-02-19 - 18:38 FrancoisBonnarel Characterisation Issues Spring 2008
Texttxt CharacInJSON.txt r1 manage 2.4 K 2010-03-12 - 17:52 FrancoisBonnarel example of characterisation in JSON format
PDFpdf Chereau.pdf r1 manage 193.2 K 2010-02-22 - 11:04 FrancoisBonnarel Staistical Characterisation definition
PNGpng Grid-polarization.xml.png r1 manage 105.4 K 2010-02-22 - 15:06 FrancoisBonnarel polarization char grid
XMLxml MPFS-v1.11.xml r1 manage 6.9 K 2011-10-17 - 04:51 MireilleLouys XML serialisation of MPFS data set
XMLxml MPFSVOt-v1.11.xml r1 manage 14.4 K 2011-10-17 - 04:43 MireilleLouys serialisation example for MPFS data in VOTable
PDFpdf NewChar2.pdf r2 r1 manage 569.3 K 2011-08-23 - 09:25 FrancoisBonnarel  
XMLxml polarization.xml r1 manage 9.4 K 2010-02-22 - 13:25 FrancoisBonnarel Polarized image data characterization example 1
XMLxml polarizationbis.xml r1 manage 7.2 K 2010-02-22 - 13:26 FrancoisBonnarel Polarized image data characterisation example 2
Edit | Attach | Watch | Print version | History: r29 < r28 < r27 < r26 < r25 | Backlinks | Raw View | Raw edit | More topic actions
Topic revision: r29 - 2011-10-17 - MireilleLouys
This site is powered by the TWiki collaboration platform Powered by Perl This site is powered by the TWiki collaboration platformCopyright © 2008-2024 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback