Difference: IvoaDataModel (177 vs. 178)

Revision 1782017-10-11 - MarkCresitelloDittmar

 
META TOPICPARENT name="WebHome"

IVOA Data Model Working Group

Introduction

The role of the Data Modeling group is to provide a framework for the description of metadata attached to observed or simulated data.
The activity of the Data Model WG activity focuses on logical relationships between these metadata, examines how an astronomer wants to retrieve, process and interpret astronomical data, and provides an architecture to handle them. What is defined in this WG can then be re-used in the protocols defined by the DAL WG or in VO aware applications .

Participation

Membership of this working group is informal as people and projects come and go. To join see our page on How to participate

Mailing-list

$ dm@ivoa.net Working Group discussions (archive):::::

Projects

Here is a summary of the ongoing activities in the data modeling WG:

Deleted:
<
<

Active projects

Project State
Characterisation v2.0  
VODML RFC
VODML-Mapping WD
Translation of DMs to VODML  
CubeDM v1.0 WD
DatasetMetadataDM v1.0 WD
Provenance: RFC page WG page] WD
STC v2.0 WD
SourceDataModel pre-WD
 

Overview / general presentations on the DM modeling effort

Here are general presentations you can re-use about the data modeling effort in the VO .

DataModels in the Virtual Observatory Framework

Added:
>
>

Active projects

Project State
VODML RFC
Provenance: RFC page WG page WD
Cube v1.0 WD - pending STC2
DatasetMetadata v1.0 WD - pending STC2
STC v2.0 WD
VODML-Mapping WD
Translation of DMs to VODML/VODML modeling utilities  
 

Idle or Inactive projects

Project State
UTYPEs discussion page  
ImageDM v1.0 replaced by Dataset/Cube models
SedDM idle
TimeSeries candidate for Spectral v3.0
Echelle Spectra candidate for Spectral v3.0
SpectralDM v2.0 postponed for review post NDCube
Added:
>
>
Characterisation v2.0 idle pending vo-dml v1.0
SourceDataModel idle
 

WG Roadmap

  • Roadmap for 2017; italic = projected
Project Ver Pre-WD WD Stable PR RFC TCG Rec Note
VODML 1.0 2012/13 Feb 2015 May 2016 Sep 2016 Oct 2016/June 2017 June 2017 Oct 2017  
Changed:
<
<
STC 2.0 Apr 2014 May 2017 Oct 2017 Oct 2017     May 2018  
>
>
STC 2.0 Apr 2014 May 2017 Oct 2017 Oct 2017     May 2018  
 
DatasetMetadata 1.0 Nov 2013 Oct 2014   May 2016     May 2018 lien on STC2 WD
NDCube 1.0 Nov 2013 Oct 2014   May 2016     May 2018 lien on STC2/Dataset
Provenance 1.0   Nov 2016            

Standards and Documents

Here is a graphic illustrating the dependencies between data models used in the IVOA framework.

DataModelDependencyGraphic.png

Specifications

For a full list of the DM specifications, please go to: IVOA Docs

Added:
>
>

Implementation Requirements for Data Models

The "IVOA Document Standards" standard has a broad outline of the implementation requirements for IVOA standards. These requirements fit best into the higher level standards for applications and protocols than for data models themselves. At the Oct 2017 interop in Trieste, the following implementation requirements for Data Model Standards was agreed upon, which allow the models to be vetted against their requirements and use cases, without needing full science use cases to be implemented.

  • VO-DML models must validate against schema
  • Serializations which touch each entity of the model. These serializations may be 'fake' (ie: not based on actual data files), and are to be produced by the modeler as unit tests/examples.
  • Real world serializations covering use cases, produced by others following the model, in a mutually agreed upon format.
  • Software which interprets these serializations and demonstrates proper interpretation of the content.
 

Latest Adopted standards for Data Modeling

Latest Documents (proposed standards and implementations)

Older IVOA Drafts and Related Documents

Projects using data models

Virtual Observatory Projects working on Data models and their implementations should list themselves here. * to fill and update***

  • CDS
    1. Aladin portal
    2. CAMEA, an interactive tool for Characterisation metadata publishing
    3. Vizier + Saada: interface for products associated with Vizier sources
  • Lerma- Paris
    1. Aspid-SR CharDM

Meetings

Most of our face-to-face activity takes place during IVOA Interoperabiltiy Meetings. Follow the Data Model Page links to locate agendas, presentation slides, and action items.

 
Interop Main page DM pageRole
Shanghai, China (15-19 May 2017) InterOpMay2017 InterOpMay2017-DM
Trieste, Italy (21-23 Oct 2016) InterOpOct2016 InteropOct2016DM
Cape Town, Sth Africa (9-13 May 2016) InterOpMay2016 InterOpMay2016
Sydney, Australia(30/10 - 01/11 2016) InterOpOct2015 InteropOct2015DM
Sesto, Italy (14-19 Jun 2015) InterOpJune2015 InterOpJune2015DM
Banff, Canada (10-12 Oct 2014) InterOpOct2014 InterOpOct2014DM
Madrid, Spain (18-23 May 2014) InterOpMay2014 InterOpMay2014DM
Heidelberg, Germany (12-17 May 2013) InterOpMay2013 InterOpMay2013DM
Sao Paulo, Brazil (22-26 Oct 2012) InterOpOct2012 InterOpOct2012DM
Urbana, USA (21-25 May 2012) InterOpMay2012 InterOpMay2012DM
Pune, India (17-21 Oct 2011) InterOpOct2011 InterOpOct2011DM
Naples, Italy (16-20 May 2011) InterOpMay2011 InterOpMay2011DM
Nara, Japan (7-11 Dec 2010) InterOpDec2010 InterOpDec2010DataModel
Victoria, Canada (17-21 May 2010) InterOpMay2010 InterOpMay2010DM
Strasbourg, France(19-23 May 2009) InterOpMay2009 DMInteropStrasbourg
Garching, Germany(19-23 Nov 2009) InterOpNov2009 InterOpNov2009DM
Trieste, Italy (19-23 May 2008) InterOpMay2008 InterOpMay2008DataModels
Cambridge, UK (27-28 Sep 2007) InterOpSep2007 InterOpSep2007DataModel
Beijing, China (14-18 May 2007) InterOpMay2007 InterOpMay2007DataModel
Moscow, Russia (18-21 Sep 2006) InterOpSep2006 InterOpSep2006DM
Victoria, Canada (14-19 May 2006) InterOpMay2006 InterOpMay2006DataModel
Madrid, Spain (6-7 Oct 2005) InterOpOct2005 InterOpOct2005DataModel
Kyoto, Japan (16-20 May 2005) InterOpMay2005 InterOpMay2005DataModel
Pune, India (27-29 Sept 2004) InterOpSep2004 InterOpSep2004DataModel
Cambridge, Mass. USA (23-28 May 2004) InterOpMay2004 InterOpMay2004DataModel
Strasbourg (16-17 Oct 2003) InterOpOct2003 InterOpOct2003Registry
Cambridge, UK (12-16 May 2003) InterOpMay2003 InterOpMay2003DataModel

Involved People

Name Country Organization Role
Jonathan McDowell USA CfA, Boston
Francois Bonnarel France CDS Strasbourg
Igor Chilingarian USA CFA
Marie Lise Dubernet France Paris Observatory
Mireille Louys France CDS/LSIIT Strasbourg
Gerard Lemson USA JHU
Alberto Micol Germany ESO
Nicolas Moreau France Paris Observatory
Pedro Osuna Spain European Space Agency / ESAC
ArnoldRots USA CfA, Boston
Anita Richards UK Jodrell Bank
Jesus Salgado Spain ESA/ESAC
J.D. Santander-Vela Germany ESO / Archive dpt
Arancha Delgado Germany ESO / Archive dpt
Petr Skoda Czech Rep. Astron Inst. of Acad. Sciences
OmarLaurino USA Harvard-Smithsonian
KristinRiebe Germany GAVO, AIP, Potsdam (Germany)
Mark Cresitello-Dittmar USA CfA, Boston Chair
Laurent Michel France SSC XMM-Newton, Strasbourg Vice-Chair
Michele Sanguillon France Montpellier

Please put your name here if you wish ...

Other DM Meetings

  • Check the above Interop pages for DM WG sessions
  • ESO/Garching, Jan 2004: Data Model Technical Meeting 4 Draft 0.1 of Observation model
  • Baltimore, Dec 2003: Data Model Technical Meeting 3 (no minutes yet; see draft 0.2 of Quantity)
  • ESO/Garching on Jan. 23/24, 2003: Data Model Sessions minutes (WG creation and planning)
  • Cambridge MA, Oct 2002: Data Model Technical Meeting 1 presentations & minutes
<--  
-->
SpectralDM2.Spectral2RFCr2

  • Data Model Dependency graphic:

META FILEATTACHMENT attr="" comment="Rough and incomplete first draft" date="1075363059" name="DomainModelv0.9.1.doc" path="F:\work\Datamodeling\doc\Domain Model\DomainModel v0.9.1.doc" size="1774592" user="GerardLemson" version="1.1"
META FILEATTACHMENT attr="" comment="[QUANTITY] draft" date="1078877796" name="qty.v0.2.ps" path="qty.v0.2.ps" size="630912" user="JonathanMcDowell" version="1.1"
META FILEATTACHMENT attr="" comment="[QUANTITY] draft (pdf)" date="1078877905" name="qty.v0.2.pdf" path="qty.v0.2.pdf" size="371913" user="JonathanMcDowell" version="1.1"
META FILEATTACHMENT attr="" comment="[OBSERVATION] draft" date="1078878204" name="obs.v0.2.ps" path="obs.v0.2.ps" size="3375894" user="JonathanMcDowell" version="1.1"
META FILEATTACHMENT attr="" comment="[OBSERVATION] draft (pdf)" date="1078878277" name="obs.v0.2.pdf" path="obs.v0.2.pdf" size="298292" user="JonathanMcDowell" version="1.1"
META FILEATTACHMENT attr="h" comment="[OBSERVATION] obsolete draft" date="1078883445" name="dmtm2.pdf" path="dmtm2.pdf" size="149453" user="JonathanMcDowell" version="1.1"
META FILEATTACHMENT attr="" comment="DM WG Tech Meeting 4 minutes" date="1078884153" name="dmtm4.pdf" path="dmtm4.pdf" size="160457" user="JonathanMcDowell" version="1.1"
META FILEATTACHMENT attr="" comment="[OBSERVATION] STC description" date="1081644992" name="stc-jcm.v1.pdf" path="stc-jcm.v1.pdf" size="144655" user="JonathanMcDowell" version="1.1"
META FILEATTACHMENT attr="" comment="[SPECTRA] Draft DM for SSAP" date="1085457306" name="spec0.5.pdf" path="spec0.5.pdf" size="154049" user="JonathanMcDowell" version="1.1"
META FILEATTACHMENT attr="" comment="[OBSERVATION] STC description V2" date="1085457403" name="stc-jcm.v2.pdf" path="stc-jcm.v2.pdf" size="155102" user="JonathanMcDowell" version="1.1"
META FILEATTACHMENT attr="" comment="[QUANTITY] revised draft" date="1085457662" name="qty23.pdf" path="qty23.pdf" size="201646" user="JonathanMcDowell" version="1.1"
META FILEATTACHMENT attr="" comment="[OBSERVATION] draft V0.23" date="1085458618" name="obs23.pdf" path="obs23.pdf" size="255368" user="JonathanMcDowell" version="1.1"
META FILEATTACHMENT attr="" comment="[MAPPING] Draft v0.51" date="1085461455" name="map51.pdf" path="map51.pdf" size="125751" user="JonathanMcDowell" version="1.1"
META FILEATTACHMENT attr="" comment="NOAO Science Archive Domain Model (snapshot)" date="1093039967" name="NSA-DM-v0.4.0.pdf" path="NSA-DM-v0.4.0.pdf" size="182913" user="PhillipWarner" version="1.1"
META FILEATTACHMENT attr="" comment="[CATALOGUE]Kick-off presentation at Poona 2004" date="1107255400" name="Poona_2004_Catalogue_DM.pdf" path="Poona_2004_Catalogue_DM.pdf" size="71222" user="PedroOsuna" version="1.1"
META FILEATTACHMENT attr="h" comment="Characterization DM draft Note" date="1133288796" name="ncharFBmir21Nov.pdf" path="ncharFBmir21Nov.pdf" size="1280466" user="FrancoisBonnarel" version="1.1"
META FILEATTACHMENT attr="" comment="Characterization DM draft Note" date="1135209048" name="Characterisation_Note_20051129.pdf" path="Characterisation_Note_20051129.pdf" size="1280466" user="FrancoisBonnarel" version="1.1"
META FILEATTACHMENT attr="" comment="Spectrum DM version 0.96 latest (Victoria)" date="1147566682" name="spec96d.pdf" path="spec96d.pdf" size="213485" user="JonathanMcDowell" version="1.1"
META FILEATTACHMENT attr="h" comment="Ignore this version" date="1147566734" name="spec97c.pdf" path="spec97c.pdf" size="206753" user="JonathanMcDowell" version="1.1"
META FILEATTACHMENT attr="" comment="Alternative Spectrum DM with STC" date="1147600195" name="spec97d.pdf" path="spec97d.pdf" size="216303" user="JonathanMcDowell" version="1.1"
META FILEATTACHMENT attr="" comment="Revised Spectrum DM" date="1157463845" name="spec98c.pdf" path="spec98c.pdf" size="222395" user="JonathanMcDowell" version="1.3"
META FILEATTACHMENT attr="" comment="Source Catalog Data Model Moscow Sept 2006" date="1158663795" name="SourceDM_Moscow_2006.pdf" path="C:\IVOA Moscow06\SourceDM_Moscow_2006.pdf" size="440792" user="InakiOrtiz" version="1.1"
META FILEATTACHMENT attr="" comment="Characterisation Data Model" date="1161366269" name="CharacterisationWDversion1.0.pdf" path="CharacterisationWDversion1.0.pdf" size="1805160" user="MireilleLouys" version="1.1"
META FILEATTACHMENT attr="" comment="Note on STC Implementation Status" date="1176456590" name="stcimp.txt" path="stcimp.txt" size="2504" user="JonathanMcDowell" version="1.1"
META FILEATTACHMENT attr="" comment="Overview on data model dependencies and re-use" date="1307094095" name="imageDM.png" path="imageDM.png" size="5007" user="MireilleLouys" version="1.1"
META FILEATTACHMENT attr="" comment="Overview on data model dependencies and re-use" date="1330439971" name="ImageDMcomments.png" path="ImageDMcomments.png" size="72961" user="MireilleLouys" version="1.4"
META FILEATTACHMENT attachment="DataModelDependencyGraphic.png" attr="" comment="Data Model Dependency graphic" date="1476308020" name="DataModelDependencyGraphic.png" path="DataModelDependencyGraphic.png" size="68236" user="MarkCresitelloDittmar" version="1"
META FILEATTACHMENT attachment="Louys_Mireille_30876-finale.pptx" attr="" comment="ADASS Talk %22Datamodels in the IVOA Framework%22/names corrected" date="1477055137" name="Louys_Mireille_30876-finale.pptx" path="Louys_Mireille_30876-finale.pptx" size="3202245" user="MireilleLouys" version="2"
META FILEATTACHMENT attachment="Louys_Mireille_30876-AdassTalk.pdf" attr="" comment="ADASS Talk %22Datamodels in the IVOA Framework%22 pdf version" date="1482262223" name="Louys_Mireille_30876-AdassTalk.pdf" path="Louys_Mireille_30876-AdassTalk.pdf" size="1404700" user="MireilleLouys" version="1"
META TOPICMOVED by="MarcoLeoni" date="1037266614" from="IVOA.IvoaStandards" to="IVOA.IvoaDataModel"
 
This site is powered by the TWiki collaboration platform Powered by Perl This site is powered by the TWiki collaboration platformCopyright © 2008-2024 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback