IVOA Data Model Working Group

Introduction

The role of the Data Modeling group is to provide a framework for the description of metadata attached to observed or simulated data.
The activity of the Data Model WG activity focuses on logical relationships between these metadata, examines how an astronomer wants to retrieve, process and interpret astronomical data, and provides an architecture to handle them. What is defined in this WG can then be re-used in the protocols defined by the DAL WG or in VO aware applications .

Participation

Membership of this working group is informal as people and projects come and go. To join see our page on How to participate

Virtual Progress Meetings

During the Covid period, periodic virtual progress meeting are proposed: Meeting Page

Mailing-list

dm@ivoa.net

• info - subscribe/unsubscribe/edit: listinfo form
• Working group discussions: archive

Projects

Here is a summary of the ongoing activities in the data modeling WG:

Overview / general presentations on the DM modeling effort

Here are general presentations you can re-use about the data modeling effort in the VO .

DataModels in the Virtual Observatory Framework

Active projects

Idle or Inactive projects

WG Roadmap

• See the TCG roadmap

Standards and Documents

Here is a graphic illustrating the dependencies between data models used in the IVOA framework.

Topic Pages

• Source and Catalog Requirement survey
• Mapping hands-on session page (May 2018)
• Source DM and Workshop 2021: see here
• Running meeting 02/2022 : see here
• Run meeting 06/2022 (SDM IPAC): see here
• High Energy physics data modeled & serialised with VO tools page
• Running meeting AstrPyVO MIVOT page
• Obscore 1.1-Next wiki page

Implementation Requirements for Data Models

The "IVOA Document Standards" standard has a broad outline of the implementation requirements for IVOA standards. These requirements fit best into the higher level standards for applications and protocols than for data models themselves. At the Oct 2017 interop in Trieste, the following implementation requirements for Data Model Standards was agreed upon, which allow the models to be vetted against their requirements and use cases, without needing full science use cases to be implemented.

• VO-DML models must validate against schema
• Serializations which touch each entity of the model. These serializations may be 'fake' (ie: not based on actual data files), and are to be produced by the modeler as unit tests/examples.
• Real world serializations covering use cases, produced by others following the model, in a mutually agreed upon format.
• Software which interprets these serializations and demonstrates proper interpretation of the content.

Latest Adopted standards for Data Modeling

• Provenance 1.0
• ObsCore 1.1
• Photometry 1.0
• VODML 1.0

Latest Documents (proposed standards and implementations)

• Spectral DM 2.0 PR CANCELED
• DataSet DM WD
• Cube DM WD
• SSLDM-2.0

Older IVOA Drafts and Related Documents

• Quantity model current drafts (.ps, .pdf)
• Quantity model serialization examples (.html)
• Observation model current drafts (.ps, .pdf)
• 2004 Linear STC: linear (command line) implementation of STC (v1.2).
• 2002 IDHA Data Model for Astronomical Images: modeling of the acquisition process and data products
• 2005 Characterisation_Note_20051129.pdf: Characterization DM draft Note
• spec96d.pdf: Spectrum DM version 0.96 latest (Victoria)
• spec97d.pdf: Alternative Spectrum DM with STC
• SourceDM_Moscow_2006.pdf: Source Catalog Data Model Moscow Sept 2006
• CharacterisationWDversion1.0.pdf: Characterisation Data Model
• update of CharacterisationIvoadraft-v1.1.pdf: Characterisation Model Working draft version 1.1
• ivoa_char_2d_image_tutorial_1.0.pdf: User's guide for Characterisation DM by Alberto Micol
• CharacterisationImplementationv1.1.pdf: Implementations of the Characterisation DM v1.1

Virtual Observatory Projects working on Data models and their implementations should list themselves here. * to fill and update***

• ObservatoireStrasbourg
  • SAADA CharDM and ObsCore

• CDS
  1. Aladin portal
  2. CAMEA, an interactive tool for Characterisation metadata publishing
  3. Vizier + Saada: interface for products associated with Vizier sources
• Lerma- Paris
  1. Aspid-SR CharDM

Meetings

Most of our face-to-face activity takes place during IVOA Interoperabiltiy Meetings. Follow the Data Model Page links to locate agendas, presentation slides, and action items.

Involved People

Please put your name here if you wish ...

Other DM Meetings

• ADASS 2021: BoF TAP and the data models TapandTheDMs
• Check the above Interop pages for DM WG sessions
• ESO/Garching, Jan 2004: Data Model Technical Meeting 4 Draft 0.1 of Observation model
• Baltimore, Dec 2003: Data Model Technical Meeting 3 (no minutes yet; see draft 0.2 of Quantity)
• ESO/Garching on Jan. 23/24, 2003: Data Model Sessions minutes (WG creation and planning)
• Cambridge MA, Oct 2002: Data Model Technical Meeting 1 presentations & minutes

• Data Model Dependency graphic: