(r45) ObsDMCoreComponents < IVOA

IVOA Web>IvoaDataModel>ObsDMCoreComponents (revision 45) (raw view)~~EditAttach~~

   +Description of Core components for the Observation Data Model (!ObsCore)

   ++News /draft /reports
(TBU)
New release of the !ObsTAP draft is [[][here]].
We plan to deliver updates every Monday during the working group discussion period , from 01 March to 02 April 2011. 

Some topics still need discussion and are summarised in the twiki pages gathered here: ObsTAPdraftDiscussion

   1. DataProduct Type and Subtype
   1. Best FormatforUtype string: for humans, for DB systems 
   1. FreeFormat data model fields : _obs_title_
   1. AccessFormat
   1. Various uses and possibilities for [[PubDataLink][_obs_publisher_did_ ]]

   ++Previous drafts

First official draft version was %GREEN%WD-ObsCore-v1.0-20101207.pdf%ENDCOLOR% and can be found [[%ATTACHURL%/WD-ObsCore-v1.0-20101207.pdf][here]].
The corresponding original Tex file is attached below and currently updated following inputs during the Nara meeting.

   ++Goal 

 This model is meant to gather all queriable metadata that play a role in the discovery of observation data.
It is meant to be implemented using the Utypes derived from this model in a TAP/Schema implementation at various archives sites.
This exercise focuses on the capability to serve 80% of the data , with reduced / reasonable implementation costs at the archive side.
   ++ Uses cases 
A list of Use- cases for data queries on all possible data types has been collected by David Schade , CVO and collaborators on behalf of the IVOA Uptake committee.
see the document [[http://www.ivoa.net/internal/IVOA/ObsDMCoreComponents/TAPObsDM_ScienceUseCasesv6.doc][here]].

   ++ UML Model
   v0.1 
   This is the first version of the UML diagram describing the main components for this Observation DM.
The compressed archive file contains a bunch of webpages that describes the various packages and classes of the model.
see the archive compressed file in 7zip [[http://www.ivoa.net/internal/IVOA/ObsDMCoreComponents/docCoreObsUML.7z ][here]] , in zip [[http://www.ivoa.net/internal/IVOA/ObsDMCoreComponents/docCoreModelUML.zip ][there]] .

These are hyperlinked pages: to start with the top level , launch the index.html file and you will navigate in the various elements of the model.

   !ObsCoreDM v1.0 / Feb 2011 to be uploaded soon.
 

   ++ UTypes 
   
   From the UML classes and attributes names, one can derive Utypes strings as described in the current UTYPES draft ( [[http://www.ivoa.net/internal/IVOA/Utypes/WD-Utypes-0.3-20090522.pdf][Utypes WD]]).
  Utypes are built up accordingly for !ObsDMCoreComponents and can be used as unique labels for each piece of information represented in the the data model. These Utype strings can be used in the TAP implementation of the model.

For most of the query mentionned in the Use-Case document [[http://www.ivoa.net/internal/IVOA/ObsDMCoreComponents/FirstScienceUseCasesv6withUtypes23Jul.pdf][here]] there is an item in the model covering the corresponding concept with a Utype string representing this data model element.

      + v0.11: 
A set of Utypes has been identified by the !Obs/TAP focus group  as 'mandatory' for any service that supports an !Obs/TAP discovery protocol. They are avaiblable in [[http://www.ivoa.net/internal/IVOA/ObsDMCoreComponents/ObsCorelistMandatory-v1.3Table.pdf][Table 1]].
Column-names will be mapped to these Utypes and used in ADQL queries.
Other Utypes supported in the model and useful to identify the piece of metadata in the response of an Obs/Tap service have been listed in [[http://www.ivoa.net/internal/IVOA/ObsDMCoreComponents/ObsCorelistMandatory-v1.3Table.pdf][Table 2]]. 

     + v0.2: 
Just one list of elements for the data model with corrected Utypes, Mandatory fields are shown in green.
see the full table [[http://www.ivoa.net/internal/IVOA/ObsDMCoreComponents/ObsTAP-DMlistV0_2.pdf][here]]
      + v1.0 /Feb 2011: 
Utype defined for the ObsCoreDM are listed in the TAP_SCHEMA.columns decription in Appendic C of the ObsTap WD [[http://www.ivoa.net/internal/IVOA/ObsDMCoreComponents/???][here]]

   ++ XML serialisation
The !ObsCore Model may also be implemented using XML serialisation.
Here are some preliminary examples of XML documents and a first version of the XML Schema.
   1 [[http://www.ivoa.net/internal/IVOA/ObsDMCoreComponents/Obs_4.xml ][Obs_4.xml]] xml document example 
   1 [[http://www.ivoa.net/internal/IVOA/ObsDMCoreComponents/Observation3.xsd][Observation xml schema]], an attempt of serializing the Observation data model in XML. 

Click [[http://www.ivoa.net/internal/IVOA/ObsDMCoreComponents/Observation3.png][here]] to see the validation of this example with Oxygen.
This requires upload of the updated version of the [[http://www.ivoa.net/internal/IVOA/ObsDMCoreComponents/Characterisation-v1.9.xsd][new characterization schema]] which will be documented on the characterization page.

   ++ Registering !ObsTAP services

Since !ObsCore is just another table in an otherwise normal TAP service, the current notion is that support for !ObsCore will be advertised via a flag in the TAP Capability extension.  This is being discussed at TAPRegExt.


   ++ ObsTap Discussion 

Details on the model and its implementtaion have been discussed in various meetings and summarised in the notes attached below.
Summary in the ObsTap page.








<br/>
<!--
      * Set ALLOWTOPICRENAME = %MAINWEB%.TWikiAdminGroup
-->

   * [[%ATTACHURL%/ObsCore.zip][ObsCore.zip]]: Use Cases, Utypes an UML Diagram

   * [[%ATTACHURL%/Obs_4.xml][Obs_4.xml]]: Xml example of observation metadata

   * [[%ATTACHURL%/Observation3.xsd][Observation3.xsd]]: Observation model Xml schema

   * [[%ATTACHURL%/Observation3.png][Observation3.png]]: PNG view of Observation XML schema

Attachments

Topic attachments
I	Attachment	History	Action	Size	Date	Who	Comment
xsd	Characterisation-v1.9.xsd	r1	manage	64.6 K	2009-08-01 - 09:09	FrancoisBonnarel	New characterization Xml schema
xls	DataModelv1.xls	r1	manage	30.0 K	2009-07-10 - 11:38	MireilleLouys	keywords summary for listed UseCases - D. Schade
doc	FirstScienceUseCasesv6withUtypes.doc	r1	manage	37.0 K	2009-07-10 - 12:19	MireilleLouys	First Use cases with Utypes attached
doc	FirstScienceUseCasesv6withUtypes2Oct19.doc	r1	manage	80.0 K	2009-11-02 - 15:57	MireilleLouys	word version for first usecases
pdf	FirstScienceUseCasesv6withUtypes2Oct19.pdf	r1	manage	418.2 K	2009-11-02 - 15:56	MireilleLouys	update: Use cases / utypes constraints proposals
zip	ObsCore.zip	r2 r1	manage	75.8 K	2009-07-24 - 16:04	MireilleLouys	UML model for ObsDMCoreComponents
xml	ObsCoreExample.xml	r1	manage	7.0 K	2010-01-22 - 15:19	FrancoisBonnarel	Mandatory Obstap response example
xml	ObsCoreExtExamplel.xml	r1	manage	16.0 K	2010-01-22 - 15:20	FrancoisBonnarel	mandatory and optional fields Obstap Resp example
pdf	ObsCorelistMandatory-v1.2.pdf	r2 r1	manage	103.2 K	2009-11-02 - 15:45	MireilleLouys	v1.2 : update for Utypes for Mandatory fields
pdf	ObsCorelistMandatory-v1.3Table.pdf	r1	manage	87.1 K	2009-11-09 - 09:10	MireilleLouys
pdf	ObsTAP-DMlistV0_2.pdf	r1	manage	224.1 K	2010-05-18 - 21:47	MireilleLouys	elements and Utypes of ObsCore v0.2
xlsx	ObsTAP-DMlistV2_0.xlsx	r1	manage	18.5 K	2010-05-18 - 21:42	MireilleLouys	elements and Utypes of ObsCore v0.2
xml	Obs_4.xml	r1	manage	6.2 K	2009-08-01 - 09:05	FrancoisBonnarel	Xml example of observation metadata
jpg	Observation3.jpg	r1	manage	228.2 K	2009-09-08 - 16:39	MireilleLouys	jpeg representation for Observation3 XML schema
png	Observation3.png	r1	manage	92.1 K	2009-08-01 - 09:11	FrancoisBonnarel	PNG view of Observation XML schema
xsd	Observation3.xsd	r1	manage	10.9 K	2009-08-01 - 09:08	FrancoisBonnarel	Observation model Xml schema
doc	TAPObsDM_ScienceUseCasesv6.doc	r1	manage	79.0 K	2009-07-10 - 11:12	MireilleLouys	Usecases description - D. Schade
pdf	WD-ObsCore-1.0-20100521.pdf	r1	manage	633.1 K	2010-05-22 - 17:29	MireilleLouys	New updated Version
pdf	WD-ObsCore-v1.0-20101207.pdf	r1	manage	1366.0 K	2010-12-08 - 03:33	MireilleLouys	WD presented and discussed in Nara
zip	WD-ObsCoreDM-0.1-2010Jan15.pdf.zip	r1	manage	931.2 K	2010-01-15 - 16:08	MireilleLouys	ObsCoreComponents DM version 0.2
pdf	WD-ObsCoreDM-0.2-20100517.pdf	r2 r1	manage	601.9 K	2010-05-19 - 05:42	MireilleLouys	ObsCore draft with detailed implementation section
zip	docCoreModelUML.zip	r1	manage	99.3 K	2009-07-10 - 11:48	MireilleLouys	UML diagrams for Core DM - prototype
7z	docCoreObsUML.7z	r1	manage	67.4 K	2009-07-10 - 11:49	MireilleLouys	UML diagram for Core Obs Model - 7zip format
pdf	optionalObstap-v1.2.pdf	r1	manage	180.8 K	2009-11-02 - 15:46	MireilleLouys	update : Utypes for optional fields in Obs/tap
pdf	optionalObstap-v1.2tab.pdf	r1	manage	204.5 K	2009-11-09 - 09:46	MireilleLouys
pdf	optionalObstapT2.pdf	r1	manage	133.1 K	2009-10-28 - 23:01	MireilleLouys	Utypes for optional fields in Obs/tap services
zip	vNara.zip	r1	manage	2318.3 K	2010-12-09 - 13:47	MireilleLouys	archive with .tex original+ images+xsl files