Difference: InterOpApr2022DM (1 vs. 18)

Revision 182022-04-28 - LaurentMichel

 
META TOPICPARENT name="InterOpApr2022"

DM Sessions Schedule - IVOA Apr 2022 Interoperability Meeting

[back to main programme page]

Changed:
<
<

** DRAFT in good progress *

>
>

Interop Closed, see you next North Fall

 
Schedule Summary
Session DateTime UTC UTC-07:00 UTC-04:00 UTC+02:00 UTC+08:00 UTC+10:00
Victoria BC/Pasadena Washington DC Strasbourg Perth/Beijing Canberra
DM 1 Apr 27 15:00 Apr 27 08:00 Apr 27 11:00 Apr 27 17:00 Apr 27 23:00 Apr 28 01:00
DM 2 Apr 28 05:00 Apr 27 22:00 Apr 28 01:00 Apr 28 07:00 Apr 28 13:00 Apr 28 15:00

Notes and session video recording are linked below each session schedule table.

DM 1: Data Models

Time: Apr 27 15:00 [session #10]

Speaker Title Time Material
Paul Harrison DM Tooling 12 + 3
Mathieu Servillat Last Step Provenance 12 + 3
Paul Harrison Observation Proposal DM 12 + 3
Francois Bonnarel Instrument Field of View DM and mapping in VOT 12 + 3
Changed:
<
<
Moderator: Laurent, Notetaker: Jesus
>
>
Moderator: Laurent , Notetaker: Jesus
 
Changed:
<
<
notes: etherpad notes (link to live notes, should expire around end of April 2023)
>
>
notes: etherpad notes (link to live notes, should expire around end of April 2023)
 

DM 2 : VOTable Annotation

Time: Apr 28 05:00 [session #13]

Speaker Title Time Material
Laurent Michel Annotation Syntax 12+ 3 2022-DMMapping-LockTown5.pdf
Mireille Louys Annotating TAP Responses on the Fly 12 + 3 InteropDMApr22-ModelAnnotationOnTheFlyInTap.pdf
Laurent Michel Implementation Status, issues and Prospects   2022-DMMappingAPI-LockTown5.pdf
       
Changed:
<
<
Moderator: Laurent, Notetaker: Jesus
>
>
Moderator: Francois, Notetaker: Jesus
 
Changed:
<
<
notes: etherpad notes (link to live notes, should expire around end of April 2023)
>
>
notes: etherpad notes (link to live notes, should expire around end of April 2023)
 

Abstracts

DM Tooling (Paul Harrison)

Recent updates to the tools for data model authors will be discussed. The tools are now driven by gradle and can be found in https://github.com/ivoa/vo-dml

Last Step Provenance (Mathieu Servillat)

We propose a simplified structure to describe the immediate provenance of an entity as a single record, based on the IVOA Provenance Data Model, in order to facilitate its use and adoption.
We thus define a flat list of attributes to describe the last activity that led to the generation of an entity, in the particular case of digital dataset generation.

The note can be accessed here : 2022-04-14_IVOA_Note___Last_step_provenance.pdf

Observation Proposal DM (Paul Harrison)

A data model for creating and managing observing proposals is being created in https://github.com/ivoa/ProposalDM. The current status and future plans will be presented. It should be noted that there will be a hack-a-thon session for those wishing to learn more and be able to contribute to the model.

Instrument Field of View DM and mapping in VOT (François Bonnarel)

The field of views descriptors used by Aladin are currently coded in VOTable in a way that is not standardized by the VO and are understood only by Aladin and a few others.
The Model Instance in VOtable (MIVOT) standard is being recommended to encode in VOTable annotations to associate data models with tabular data.
We propose to replace the current field of view encoding in Aladin with an encoding based on MIVOT rendering an "instrument field of view" data model reusing some VO model components such as coords.

Annotation Syntax (Laurent Michel)

VO mode annotation syntax proposes a syntax to map VOTable data on any model serialized in VO-DML. MIVOT annotations are grouped in a single XML block located in the resource head. The annotations operate as a bridge between the data and the model. It can denote the way data are connected to each other as well as different tables can be joined together. It is also able to carry data or meta-data that are missing in the VOTable. The annotation block is made of bricks that facilitate both annotation process and model instance reconstruction. it has been designed so as not to alter the original VOTable content, thus limiting its impact on legacy clients.

Annotating TAP Response on the Fly (Mireille Louys)

Currently the TAP protocol presents table data and metadata via a {TAP\_SCHEMA} describing the served tables with their columns and possible joins between them.

We explore here how to add an information layer, so that values within table columns can be used to instanciate objects defined in a selected IVOA data model like Photometry, Coords, Measure or the proposed MANGO container model. This information layer is provided through annotation tags which tell how the columns' values can be interpreted as attributes of instances of that model.

Then when a TAP query is processed, our server add-on interprets the ADQL query string and produces on-the-fly, when possible, the TAP response as an annotated VOTable document. The FIELD elements in the table response are mapped to corresponding model elements templated for this service. This has been prototyped in Java, using the VOLLT package library and a template annotation document representing elements from the MANGO data model. Examples on Vizier and Chandra catalogs will be shown.

Annotation: Implementation Status, Issues and Prospects (Laurent Michel)

The Model Instance in VOtable standard needs reference implementations to be validated. These reference implementations are based on annotated VOtables; they must also demonstrate that code reading VOtable data through a model view is both feasible and useful. We will present a Python based demonstrator exploring different ways to design model-based APIs. This talk is connected with the first hack-a-thon topic

[back to main programme page]

-- LaurentMichel - 2022-04-21

<--  
-->

META FILEATTACHMENT attachment="2022-04-14_IVOA_Note___Last_step_provenance.pdf" attr="" comment="2022-04-14 IVOA_Note___Last_step_provenance" date="1650899760" name="2022-04-14_IVOA_Note___Last_step_provenance.pdf" path="2022-04-14_IVOA_Note___Last_step_provenance.pdf" size="380104" user="MathieuServillat" version="1"
META FILEATTACHMENT attachment="ProposalDM2-PAH.pdf" attr="" comment="Proposal DM Slides" date="1651064865" name="ProposalDM2-PAH.pdf" path="ProposalDM2-PAH.pdf" size="2729358" user="PaulHarrison" version="1"
META FILEATTACHMENT attachment="VO-DML_TOOLS_Update_PAH.pdf" attr="" comment="VO-DML Tooling update slides" date="1651064924" name="VO-DML_TOOLS_Update_PAH.pdf" path="VO-DML_TOOLS_Update_PAH.pdf" size="4084867" user="PaulHarrison" version="1"
META FILEATTACHMENT attachment="2022-04-27_Last-step_provenance_IVOA.pdf" attr="" comment="" date="1651070706" name="2022-04-27_Last-step_provenance_IVOA.pdf" path="2022-04-27_Last-step_provenance_IVOA.pdf" size="2009542" user="MathieuServillat" version="1"
META FILEATTACHMENT attachment="InstrumentFoV-DMMIVOT.pdf" attr="" comment="Instrument Field of View DM and mapping in VOT" date="1651072196" name="InstrumentFoV-DMMIVOT.pdf" path="InstrumentFoV-DMMIVOT.pdf" size="2049660" user="FrancoisBonnarel" version="1"
META FILEATTACHMENT attachment="ModelAnnotationOnTheFlyInTap-Louys.pdf" attr="" comment="Model annotation in TAP service using MIVOT mapping syntax" date="1651095509" name="ModelAnnotationOnTheFlyInTap-Louys.pdf" path="ModelAnnotationOnTheFlyInTap-Louys.pdf" size="282987" user="MireilleLouys" version="1"
META FILEATTACHMENT attachment="2022-DMMapping-LockTown5.pdf" attr="" comment="" date="1651119151" name="2022-DMMapping-LockTown5.pdf" path="2022-DMMapping-LockTown5.pdf" size="2076561" user="LaurentMichel" version="1"
META FILEATTACHMENT attachment="2022-DMMappingAPI-LockTown5.pdf" attr="" comment="API proposal for processing annotated data" date="1651119202" name="2022-DMMappingAPI-LockTown5.pdf" path="2022-DMMappingAPI-LockTown5.pdf" size="641838" user="LaurentMichel" version="1"
META FILEATTACHMENT attachment="InteropDMApr22-ModelAnnotationOnTheFlyInTap.pdf" attr="" comment="Model annotation in TAP service using MIVOT mapping syntax" date="1651134838" name="InteropDMApr22-ModelAnnotationOnTheFlyInTap.pdf" path="InteropDMApr22-ModelAnnotationOnTheFlyInTap.pdf" size="283010" user="MireilleLouys" version="1"
Added:
>
>
META FILEATTACHMENT attachment="IVOA_Apr22_DM-365days.txt" attr="" comment="" date="1651151274" name="IVOA_Apr22_DM-365days.txt" path="IVOA_Apr22_DM-365days.txt" size="8098" user="LaurentMichel" version="1"
 

Revision 172022-04-28 - MireilleLouys

 
META TOPICPARENT name="InterOpApr2022"

DM Sessions Schedule - IVOA Apr 2022 Interoperability Meeting

[back to main programme page]

** DRAFT in good progress *

Schedule Summary
Session DateTime UTC UTC-07:00 UTC-04:00 UTC+02:00 UTC+08:00 UTC+10:00
Victoria BC/Pasadena Washington DC Strasbourg Perth/Beijing Canberra
DM 1 Apr 27 15:00 Apr 27 08:00 Apr 27 11:00 Apr 27 17:00 Apr 27 23:00 Apr 28 01:00
DM 2 Apr 28 05:00 Apr 27 22:00 Apr 28 01:00 Apr 28 07:00 Apr 28 13:00 Apr 28 15:00

Notes and session video recording are linked below each session schedule table.

DM 1: Data Models

Time: Apr 27 15:00 [session #10]

Speaker Title Time Material
Paul Harrison DM Tooling 12 + 3
Mathieu Servillat Last Step Provenance 12 + 3
Paul Harrison Observation Proposal DM 12 + 3
Francois Bonnarel Instrument Field of View DM and mapping in VOT 12 + 3

Moderator: Laurent, Notetaker: Jesus

notes: etherpad notes (link to live notes, should expire around end of April 2023)

DM 2 : VOTable Annotation

Time: Apr 28 05:00 [session #13]

Speaker Title Time Material
Laurent Michel Annotation Syntax 12+ 3 2022-DMMapping-LockTown5.pdf
Changed:
<
<
Mireille Louys Annotating TAP Responses on the Fly 12 + 3 ModelAnnotationOnTheFlyInTap-Louys.pdf
>
>
Mireille Louys Annotating TAP Responses on the Fly 12 + 3 InteropDMApr22-ModelAnnotationOnTheFlyInTap.pdf
 
Laurent Michel Implementation Status, issues and Prospects   2022-DMMappingAPI-LockTown5.pdf
       

Moderator: Laurent, Notetaker: Jesus

notes: etherpad notes (link to live notes, should expire around end of April 2023)

Abstracts

DM Tooling (Paul Harrison)

Recent updates to the tools for data model authors will be discussed. The tools are now driven by gradle and can be found in https://github.com/ivoa/vo-dml

Last Step Provenance (Mathieu Servillat)

We propose a simplified structure to describe the immediate provenance of an entity as a single record, based on the IVOA Provenance Data Model, in order to facilitate its use and adoption.
We thus define a flat list of attributes to describe the last activity that led to the generation of an entity, in the particular case of digital dataset generation.

The note can be accessed here : 2022-04-14_IVOA_Note___Last_step_provenance.pdf

Observation Proposal DM (Paul Harrison)

A data model for creating and managing observing proposals is being created in https://github.com/ivoa/ProposalDM. The current status and future plans will be presented. It should be noted that there will be a hack-a-thon session for those wishing to learn more and be able to contribute to the model.

Instrument Field of View DM and mapping in VOT (François Bonnarel)

The field of views descriptors used by Aladin are currently coded in VOTable in a way that is not standardized by the VO and are understood only by Aladin and a few others.
The Model Instance in VOtable (MIVOT) standard is being recommended to encode in VOTable annotations to associate data models with tabular data.
We propose to replace the current field of view encoding in Aladin with an encoding based on MIVOT rendering an "instrument field of view" data model reusing some VO model components such as coords.

Annotation Syntax (Laurent Michel)

VO mode annotation syntax proposes a syntax to map VOTable data on any model serialized in VO-DML. MIVOT annotations are grouped in a single XML block located in the resource head. The annotations operate as a bridge between the data and the model. It can denote the way data are connected to each other as well as different tables can be joined together. It is also able to carry data or meta-data that are missing in the VOTable. The annotation block is made of bricks that facilitate both annotation process and model instance reconstruction. it has been designed so as not to alter the original VOTable content, thus limiting its impact on legacy clients.

Annotating TAP Response on the Fly (Mireille Louys)

Currently the TAP protocol presents table data and metadata via a {TAP\_SCHEMA} describing the served tables with their columns and possible joins between them.

We explore here how to add an information layer, so that values within table columns can be used to instanciate objects defined in a selected IVOA data model like Photometry, Coords, Measure or the proposed MANGO container model. This information layer is provided through annotation tags which tell how the columns' values can be interpreted as attributes of instances of that model.

Then when a TAP query is processed, our server add-on interprets the ADQL query string and produces on-the-fly, when possible, the TAP response as an annotated VOTable document. The FIELD elements in the table response are mapped to corresponding model elements templated for this service. This has been prototyped in Java, using the VOLLT package library and a template annotation document representing elements from the MANGO data model. Examples on Vizier and Chandra catalogs will be shown.

Annotation: Implementation Status, Issues and Prospects (Laurent Michel)

The Model Instance in VOtable standard needs reference implementations to be validated. These reference implementations are based on annotated VOtables; they must also demonstrate that code reading VOtable data through a model view is both feasible and useful. We will present a Python based demonstrator exploring different ways to design model-based APIs. This talk is connected with the first hack-a-thon topic

[back to main programme page]

-- LaurentMichel - 2022-04-21

<--  
-->

META FILEATTACHMENT attachment="2022-04-14_IVOA_Note___Last_step_provenance.pdf" attr="" comment="2022-04-14 IVOA_Note___Last_step_provenance" date="1650899760" name="2022-04-14_IVOA_Note___Last_step_provenance.pdf" path="2022-04-14_IVOA_Note___Last_step_provenance.pdf" size="380104" user="MathieuServillat" version="1"
META FILEATTACHMENT attachment="ProposalDM2-PAH.pdf" attr="" comment="Proposal DM Slides" date="1651064865" name="ProposalDM2-PAH.pdf" path="ProposalDM2-PAH.pdf" size="2729358" user="PaulHarrison" version="1"
META FILEATTACHMENT attachment="VO-DML_TOOLS_Update_PAH.pdf" attr="" comment="VO-DML Tooling update slides" date="1651064924" name="VO-DML_TOOLS_Update_PAH.pdf" path="VO-DML_TOOLS_Update_PAH.pdf" size="4084867" user="PaulHarrison" version="1"
META FILEATTACHMENT attachment="2022-04-27_Last-step_provenance_IVOA.pdf" attr="" comment="" date="1651070706" name="2022-04-27_Last-step_provenance_IVOA.pdf" path="2022-04-27_Last-step_provenance_IVOA.pdf" size="2009542" user="MathieuServillat" version="1"
META FILEATTACHMENT attachment="InstrumentFoV-DMMIVOT.pdf" attr="" comment="Instrument Field of View DM and mapping in VOT" date="1651072196" name="InstrumentFoV-DMMIVOT.pdf" path="InstrumentFoV-DMMIVOT.pdf" size="2049660" user="FrancoisBonnarel" version="1"
META FILEATTACHMENT attachment="ModelAnnotationOnTheFlyInTap-Louys.pdf" attr="" comment="Model annotation in TAP service using MIVOT mapping syntax" date="1651095509" name="ModelAnnotationOnTheFlyInTap-Louys.pdf" path="ModelAnnotationOnTheFlyInTap-Louys.pdf" size="282987" user="MireilleLouys" version="1"
META FILEATTACHMENT attachment="2022-DMMapping-LockTown5.pdf" attr="" comment="" date="1651119151" name="2022-DMMapping-LockTown5.pdf" path="2022-DMMapping-LockTown5.pdf" size="2076561" user="LaurentMichel" version="1"
META FILEATTACHMENT attachment="2022-DMMappingAPI-LockTown5.pdf" attr="" comment="API proposal for processing annotated data" date="1651119202" name="2022-DMMappingAPI-LockTown5.pdf" path="2022-DMMappingAPI-LockTown5.pdf" size="641838" user="LaurentMichel" version="1"
Added:
>
>
META FILEATTACHMENT attachment="InteropDMApr22-ModelAnnotationOnTheFlyInTap.pdf" attr="" comment="Model annotation in TAP service using MIVOT mapping syntax" date="1651134838" name="InteropDMApr22-ModelAnnotationOnTheFlyInTap.pdf" path="InteropDMApr22-ModelAnnotationOnTheFlyInTap.pdf" size="283010" user="MireilleLouys" version="1"
 

Revision 162022-04-28 - LaurentMichel

 
META TOPICPARENT name="InterOpApr2022"

DM Sessions Schedule - IVOA Apr 2022 Interoperability Meeting

[back to main programme page]

** DRAFT in good progress *

Schedule Summary
Session DateTime UTC UTC-07:00 UTC-04:00 UTC+02:00 UTC+08:00 UTC+10:00
Victoria BC/Pasadena Washington DC Strasbourg Perth/Beijing Canberra
DM 1 Apr 27 15:00 Apr 27 08:00 Apr 27 11:00 Apr 27 17:00 Apr 27 23:00 Apr 28 01:00
DM 2 Apr 28 05:00 Apr 27 22:00 Apr 28 01:00 Apr 28 07:00 Apr 28 13:00 Apr 28 15:00

Notes and session video recording are linked below each session schedule table.

DM 1: Data Models

Time: Apr 27 15:00 [session #10]

Speaker Title Time Material
Paul Harrison DM Tooling 12 + 3
Mathieu Servillat Last Step Provenance 12 + 3
Paul Harrison Observation Proposal DM 12 + 3
Francois Bonnarel Instrument Field of View DM and mapping in VOT 12 + 3

Moderator: Laurent, Notetaker: Jesus

notes: etherpad notes (link to live notes, should expire around end of April 2023)

DM 2 : VOTable Annotation

Time: Apr 28 05:00 [session #13]

Speaker Title Time Material
Changed:
<
<
Laurent Michel Annotation Syntax 12+ 3  
>
>
Laurent Michel Annotation Syntax 12+ 3 2022-DMMapping-LockTown5.pdf
 
Mireille Louys Annotating TAP Responses on the Fly 12 + 3 ModelAnnotationOnTheFlyInTap-Louys.pdf
Changed:
<
<
Laurent Michel Implementation Status, issues and Prospects    
>
>
Laurent Michel Implementation Status, issues and Prospects   2022-DMMappingAPI-LockTown5.pdf
 
       

Moderator: Laurent, Notetaker: Jesus

notes: etherpad notes (link to live notes, should expire around end of April 2023)

Abstracts

DM Tooling (Paul Harrison)

Recent updates to the tools for data model authors will be discussed. The tools are now driven by gradle and can be found in https://github.com/ivoa/vo-dml

Last Step Provenance (Mathieu Servillat)

We propose a simplified structure to describe the immediate provenance of an entity as a single record, based on the IVOA Provenance Data Model, in order to facilitate its use and adoption.
We thus define a flat list of attributes to describe the last activity that led to the generation of an entity, in the particular case of digital dataset generation.

The note can be accessed here : 2022-04-14_IVOA_Note___Last_step_provenance.pdf

Observation Proposal DM (Paul Harrison)

A data model for creating and managing observing proposals is being created in https://github.com/ivoa/ProposalDM. The current status and future plans will be presented. It should be noted that there will be a hack-a-thon session for those wishing to learn more and be able to contribute to the model.

Instrument Field of View DM and mapping in VOT (François Bonnarel)

The field of views descriptors used by Aladin are currently coded in VOTable in a way that is not standardized by the VO and are understood only by Aladin and a few others.
The Model Instance in VOtable (MIVOT) standard is being recommended to encode in VOTable annotations to associate data models with tabular data.
We propose to replace the current field of view encoding in Aladin with an encoding based on MIVOT rendering an "instrument field of view" data model reusing some VO model components such as coords.

Annotation Syntax (Laurent Michel)

VO mode annotation syntax proposes a syntax to map VOTable data on any model serialized in VO-DML. MIVOT annotations are grouped in a single XML block located in the resource head. The annotations operate as a bridge between the data and the model. It can denote the way data are connected to each other as well as different tables can be joined together. It is also able to carry data or meta-data that are missing in the VOTable. The annotation block is made of bricks that facilitate both annotation process and model instance reconstruction. it has been designed so as not to alter the original VOTable content, thus limiting its impact on legacy clients.

Annotating TAP Response on the Fly (Mireille Louys)

Currently the TAP protocol presents table data and metadata via a {TAP\_SCHEMA} describing the served tables with their columns and possible joins between them.

We explore here how to add an information layer, so that values within table columns can be used to instanciate objects defined in a selected IVOA data model like Photometry, Coords, Measure or the proposed MANGO container model. This information layer is provided through annotation tags which tell how the columns' values can be interpreted as attributes of instances of that model.

Then when a TAP query is processed, our server add-on interprets the ADQL query string and produces on-the-fly, when possible, the TAP response as an annotated VOTable document. The FIELD elements in the table response are mapped to corresponding model elements templated for this service. This has been prototyped in Java, using the VOLLT package library and a template annotation document representing elements from the MANGO data model. Examples on Vizier and Chandra catalogs will be shown.

Annotation: Implementation Status, Issues and Prospects (Laurent Michel)

The Model Instance in VOtable standard needs reference implementations to be validated. These reference implementations are based on annotated VOtables; they must also demonstrate that code reading VOtable data through a model view is both feasible and useful. We will present a Python based demonstrator exploring different ways to design model-based APIs. This talk is connected with the first hack-a-thon topic

[back to main programme page]

-- LaurentMichel - 2022-04-21

<--  
-->

META FILEATTACHMENT attachment="2022-04-14_IVOA_Note___Last_step_provenance.pdf" attr="" comment="2022-04-14 IVOA_Note___Last_step_provenance" date="1650899760" name="2022-04-14_IVOA_Note___Last_step_provenance.pdf" path="2022-04-14_IVOA_Note___Last_step_provenance.pdf" size="380104" user="MathieuServillat" version="1"
META FILEATTACHMENT attachment="ProposalDM2-PAH.pdf" attr="" comment="Proposal DM Slides" date="1651064865" name="ProposalDM2-PAH.pdf" path="ProposalDM2-PAH.pdf" size="2729358" user="PaulHarrison" version="1"
META FILEATTACHMENT attachment="VO-DML_TOOLS_Update_PAH.pdf" attr="" comment="VO-DML Tooling update slides" date="1651064924" name="VO-DML_TOOLS_Update_PAH.pdf" path="VO-DML_TOOLS_Update_PAH.pdf" size="4084867" user="PaulHarrison" version="1"
META FILEATTACHMENT attachment="2022-04-27_Last-step_provenance_IVOA.pdf" attr="" comment="" date="1651070706" name="2022-04-27_Last-step_provenance_IVOA.pdf" path="2022-04-27_Last-step_provenance_IVOA.pdf" size="2009542" user="MathieuServillat" version="1"
META FILEATTACHMENT attachment="InstrumentFoV-DMMIVOT.pdf" attr="" comment="Instrument Field of View DM and mapping in VOT" date="1651072196" name="InstrumentFoV-DMMIVOT.pdf" path="InstrumentFoV-DMMIVOT.pdf" size="2049660" user="FrancoisBonnarel" version="1"
META FILEATTACHMENT attachment="ModelAnnotationOnTheFlyInTap-Louys.pdf" attr="" comment="Model annotation in TAP service using MIVOT mapping syntax" date="1651095509" name="ModelAnnotationOnTheFlyInTap-Louys.pdf" path="ModelAnnotationOnTheFlyInTap-Louys.pdf" size="282987" user="MireilleLouys" version="1"
Added:
>
>
META FILEATTACHMENT attachment="2022-DMMapping-LockTown5.pdf" attr="" comment="" date="1651119151" name="2022-DMMapping-LockTown5.pdf" path="2022-DMMapping-LockTown5.pdf" size="2076561" user="LaurentMichel" version="1"
META FILEATTACHMENT attachment="2022-DMMappingAPI-LockTown5.pdf" attr="" comment="API proposal for processing annotated data" date="1651119202" name="2022-DMMappingAPI-LockTown5.pdf" path="2022-DMMappingAPI-LockTown5.pdf" size="641838" user="LaurentMichel" version="1"
 

Revision 152022-04-27 - MireilleLouys

 
META TOPICPARENT name="InterOpApr2022"

DM Sessions Schedule - IVOA Apr 2022 Interoperability Meeting

[back to main programme page]

** DRAFT in good progress *

Schedule Summary
Session DateTime UTC UTC-07:00 UTC-04:00 UTC+02:00 UTC+08:00 UTC+10:00
Victoria BC/Pasadena Washington DC Strasbourg Perth/Beijing Canberra
DM 1 Apr 27 15:00 Apr 27 08:00 Apr 27 11:00 Apr 27 17:00 Apr 27 23:00 Apr 28 01:00
DM 2 Apr 28 05:00 Apr 27 22:00 Apr 28 01:00 Apr 28 07:00 Apr 28 13:00 Apr 28 15:00

Notes and session video recording are linked below each session schedule table.

DM 1: Data Models

Time: Apr 27 15:00 [session #10]

Speaker Title Time Material
Paul Harrison DM Tooling 12 + 3
Mathieu Servillat Last Step Provenance 12 + 3
Paul Harrison Observation Proposal DM 12 + 3
Francois Bonnarel Instrument Field of View DM and mapping in VOT 12 + 3

Moderator: Laurent, Notetaker: Jesus

notes: etherpad notes (link to live notes, should expire around end of April 2023)

DM 2 : VOTable Annotation

Time: Apr 28 05:00 [session #13]

Speaker Title Time Material
Laurent Michel Annotation Syntax 12+ 3  
Changed:
<
<
Mireille Louys Annotating TAP Responses on the Fly 12 + 3  
>
>
Mireille Louys Annotating TAP Responses on the Fly 12 + 3 ModelAnnotationOnTheFlyInTap-Louys.pdf
 
Laurent Michel Implementation Status, issues and Prospects    
       

Moderator: Laurent, Notetaker: Jesus

notes: etherpad notes (link to live notes, should expire around end of April 2023)

Abstracts

DM Tooling (Paul Harrison)

Recent updates to the tools for data model authors will be discussed. The tools are now driven by gradle and can be found in https://github.com/ivoa/vo-dml

Last Step Provenance (Mathieu Servillat)

We propose a simplified structure to describe the immediate provenance of an entity as a single record, based on the IVOA Provenance Data Model, in order to facilitate its use and adoption.
We thus define a flat list of attributes to describe the last activity that led to the generation of an entity, in the particular case of digital dataset generation.

The note can be accessed here : 2022-04-14_IVOA_Note___Last_step_provenance.pdf

Observation Proposal DM (Paul Harrison)

A data model for creating and managing observing proposals is being created in https://github.com/ivoa/ProposalDM. The current status and future plans will be presented. It should be noted that there will be a hack-a-thon session for those wishing to learn more and be able to contribute to the model.

Instrument Field of View DM and mapping in VOT (François Bonnarel)

The field of views descriptors used by Aladin are currently coded in VOTable in a way that is not standardized by the VO and are understood only by Aladin and a few others.
The Model Instance in VOtable (MIVOT) standard is being recommended to encode in VOTable annotations to associate data models with tabular data.
We propose to replace the current field of view encoding in Aladin with an encoding based on MIVOT rendering an "instrument field of view" data model reusing some VO model components such as coords.

Annotation Syntax (Laurent Michel)

VO mode annotation syntax proposes a syntax to map VOTable data on any model serialized in VO-DML. MIVOT annotations are grouped in a single XML block located in the resource head. The annotations operate as a bridge between the data and the model. It can denote the way data are connected to each other as well as different tables can be joined together. It is also able to carry data or meta-data that are missing in the VOTable. The annotation block is made of bricks that facilitate both annotation process and model instance reconstruction. it has been designed so as not to alter the original VOTable content, thus limiting its impact on legacy clients.

Annotating TAP Response on the Fly (Mireille Louys)

Currently the TAP protocol presents table data and metadata via a {TAP\_SCHEMA} describing the served tables with their columns and possible joins between them.

We explore here how to add an information layer, so that values within table columns can be used to instanciate objects defined in a selected IVOA data model like Photometry, Coords, Measure or the proposed MANGO container model. This information layer is provided through annotation tags which tell how the columns' values can be interpreted as attributes of instances of that model.

Then when a TAP query is processed, our server add-on interprets the ADQL query string and produces on-the-fly, when possible, the TAP response as an annotated VOTable document. The FIELD elements in the table response are mapped to corresponding model elements templated for this service. This has been prototyped in Java, using the VOLLT package library and a template annotation document representing elements from the MANGO data model. Examples on Vizier and Chandra catalogs will be shown.

Annotation: Implementation Status, Issues and Prospects (Laurent Michel)

The Model Instance in VOtable standard needs reference implementations to be validated. These reference implementations are based on annotated VOtables; they must also demonstrate that code reading VOtable data through a model view is both feasible and useful. We will present a Python based demonstrator exploring different ways to design model-based APIs. This talk is connected with the first hack-a-thon topic

[back to main programme page]

-- LaurentMichel - 2022-04-21

<--  
-->
Deleted:
<
<
 
META FILEATTACHMENT attachment="2022-04-14_IVOA_Note___Last_step_provenance.pdf" attr="" comment="2022-04-14 IVOA_Note___Last_step_provenance" date="1650899760" name="2022-04-14_IVOA_Note___Last_step_provenance.pdf" path="2022-04-14_IVOA_Note___Last_step_provenance.pdf" size="380104" user="MathieuServillat" version="1"
META FILEATTACHMENT attachment="ProposalDM2-PAH.pdf" attr="" comment="Proposal DM Slides" date="1651064865" name="ProposalDM2-PAH.pdf" path="ProposalDM2-PAH.pdf" size="2729358" user="PaulHarrison" version="1"
META FILEATTACHMENT attachment="VO-DML_TOOLS_Update_PAH.pdf" attr="" comment="VO-DML Tooling update slides" date="1651064924" name="VO-DML_TOOLS_Update_PAH.pdf" path="VO-DML_TOOLS_Update_PAH.pdf" size="4084867" user="PaulHarrison" version="1"
META FILEATTACHMENT attachment="2022-04-27_Last-step_provenance_IVOA.pdf" attr="" comment="" date="1651070706" name="2022-04-27_Last-step_provenance_IVOA.pdf" path="2022-04-27_Last-step_provenance_IVOA.pdf" size="2009542" user="MathieuServillat" version="1"
META FILEATTACHMENT attachment="InstrumentFoV-DMMIVOT.pdf" attr="" comment="Instrument Field of View DM and mapping in VOT" date="1651072196" name="InstrumentFoV-DMMIVOT.pdf" path="InstrumentFoV-DMMIVOT.pdf" size="2049660" user="FrancoisBonnarel" version="1"
Added:
>
>
META FILEATTACHMENT attachment="ModelAnnotationOnTheFlyInTap-Louys.pdf" attr="" comment="Model annotation in TAP service using MIVOT mapping syntax" date="1651095509" name="ModelAnnotationOnTheFlyInTap-Louys.pdf" path="ModelAnnotationOnTheFlyInTap-Louys.pdf" size="282987" user="MireilleLouys" version="1"
 

Revision 142022-04-27 - FrancoisBonnarel

 
META TOPICPARENT name="InterOpApr2022"

DM Sessions Schedule - IVOA Apr 2022 Interoperability Meeting

[back to main programme page]

** DRAFT in good progress *

Schedule Summary
Session DateTime UTC UTC-07:00 UTC-04:00 UTC+02:00 UTC+08:00 UTC+10:00
Victoria BC/Pasadena Washington DC Strasbourg Perth/Beijing Canberra
DM 1 Apr 27 15:00 Apr 27 08:00 Apr 27 11:00 Apr 27 17:00 Apr 27 23:00 Apr 28 01:00
DM 2 Apr 28 05:00 Apr 27 22:00 Apr 28 01:00 Apr 28 07:00 Apr 28 13:00 Apr 28 15:00

Notes and session video recording are linked below each session schedule table.

DM 1: Data Models

Time: Apr 27 15:00 [session #10]

Speaker Title Time Material
Paul Harrison DM Tooling 12 + 3
Mathieu Servillat Last Step Provenance 12 + 3
Paul Harrison Observation Proposal DM 12 + 3
Changed:
<
<
Francois Bonnarel Instrument Field of View DM and mapping in VOT 12 + 3

>
>
Francois Bonnarel Instrument Field of View DM and mapping in VOT 12 + 3
  Moderator: Laurent, Notetaker: Jesus

notes: etherpad notes (link to live notes, should expire around end of April 2023)

DM 2 : VOTable Annotation

Time: Apr 28 05:00 [session #13]

Speaker Title Time Material
Laurent Michel Annotation Syntax 12+ 3  
Mireille Louys Annotating TAP Responses on the Fly 12 + 3  
Laurent Michel Implementation Status, issues and Prospects    
       

Moderator: Laurent, Notetaker: Jesus

notes: etherpad notes (link to live notes, should expire around end of April 2023)

Abstracts

DM Tooling (Paul Harrison)

Recent updates to the tools for data model authors will be discussed. The tools are now driven by gradle and can be found in https://github.com/ivoa/vo-dml

Last Step Provenance (Mathieu Servillat)

We propose a simplified structure to describe the immediate provenance of an entity as a single record, based on the IVOA Provenance Data Model, in order to facilitate its use and adoption.
We thus define a flat list of attributes to describe the last activity that led to the generation of an entity, in the particular case of digital dataset generation.

The note can be accessed here : 2022-04-14_IVOA_Note___Last_step_provenance.pdf

Observation Proposal DM (Paul Harrison)

A data model for creating and managing observing proposals is being created in https://github.com/ivoa/ProposalDM. The current status and future plans will be presented. It should be noted that there will be a hack-a-thon session for those wishing to learn more and be able to contribute to the model.

Instrument Field of View DM and mapping in VOT (François Bonnarel)

The field of views descriptors used by Aladin are currently coded in VOTable in a way that is not standardized by the VO and are understood only by Aladin and a few others.
The Model Instance in VOtable (MIVOT) standard is being recommended to encode in VOTable annotations to associate data models with tabular data.
We propose to replace the current field of view encoding in Aladin with an encoding based on MIVOT rendering an "instrument field of view" data model reusing some VO model components such as coords.

Annotation Syntax (Laurent Michel)

VO mode annotation syntax proposes a syntax to map VOTable data on any model serialized in VO-DML. MIVOT annotations are grouped in a single XML block located in the resource head. The annotations operate as a bridge between the data and the model. It can denote the way data are connected to each other as well as different tables can be joined together. It is also able to carry data or meta-data that are missing in the VOTable. The annotation block is made of bricks that facilitate both annotation process and model instance reconstruction. it has been designed so as not to alter the original VOTable content, thus limiting its impact on legacy clients.

Annotating TAP Response on the Fly (Mireille Louys)

Currently the TAP protocol presents table data and metadata via a {TAP\_SCHEMA} describing the served tables with their columns and possible joins between them.

We explore here how to add an information layer, so that values within table columns can be used to instanciate objects defined in a selected IVOA data model like Photometry, Coords, Measure or the proposed MANGO container model. This information layer is provided through annotation tags which tell how the columns' values can be interpreted as attributes of instances of that model.

Then when a TAP query is processed, our server add-on interprets the ADQL query string and produces on-the-fly, when possible, the TAP response as an annotated VOTable document. The FIELD elements in the table response are mapped to corresponding model elements templated for this service. This has been prototyped in Java, using the VOLLT package library and a template annotation document representing elements from the MANGO data model. Examples on Vizier and Chandra catalogs will be shown.

Annotation: Implementation Status, Issues and Prospects (Laurent Michel)

The Model Instance in VOtable standard needs reference implementations to be validated. These reference implementations are based on annotated VOtables; they must also demonstrate that code reading VOtable data through a model view is both feasible and useful. We will present a Python based demonstrator exploring different ways to design model-based APIs. This talk is connected with the first hack-a-thon topic

[back to main programme page]

-- LaurentMichel - 2022-04-21

<--  
-->

META FILEATTACHMENT attachment="2022-04-14_IVOA_Note___Last_step_provenance.pdf" attr="" comment="2022-04-14 IVOA_Note___Last_step_provenance" date="1650899760" name="2022-04-14_IVOA_Note___Last_step_provenance.pdf" path="2022-04-14_IVOA_Note___Last_step_provenance.pdf" size="380104" user="MathieuServillat" version="1"
META FILEATTACHMENT attachment="ProposalDM2-PAH.pdf" attr="" comment="Proposal DM Slides" date="1651064865" name="ProposalDM2-PAH.pdf" path="ProposalDM2-PAH.pdf" size="2729358" user="PaulHarrison" version="1"
META FILEATTACHMENT attachment="VO-DML_TOOLS_Update_PAH.pdf" attr="" comment="VO-DML Tooling update slides" date="1651064924" name="VO-DML_TOOLS_Update_PAH.pdf" path="VO-DML_TOOLS_Update_PAH.pdf" size="4084867" user="PaulHarrison" version="1"
META FILEATTACHMENT attachment="2022-04-27_Last-step_provenance_IVOA.pdf" attr="" comment="" date="1651070706" name="2022-04-27_Last-step_provenance_IVOA.pdf" path="2022-04-27_Last-step_provenance_IVOA.pdf" size="2009542" user="MathieuServillat" version="1"
Added:
>
>
META FILEATTACHMENT attachment="InstrumentFoV-DMMIVOT.pdf" attr="" comment="Instrument Field of View DM and mapping in VOT" date="1651072196" name="InstrumentFoV-DMMIVOT.pdf" path="InstrumentFoV-DMMIVOT.pdf" size="2049660" user="FrancoisBonnarel" version="1"
 

Revision 132022-04-27 - MathieuServillat

 
META TOPICPARENT name="InterOpApr2022"

DM Sessions Schedule - IVOA Apr 2022 Interoperability Meeting

[back to main programme page]

** DRAFT in good progress *

Schedule Summary
Session DateTime UTC UTC-07:00 UTC-04:00 UTC+02:00 UTC+08:00 UTC+10:00
Victoria BC/Pasadena Washington DC Strasbourg Perth/Beijing Canberra
DM 1 Apr 27 15:00 Apr 27 08:00 Apr 27 11:00 Apr 27 17:00 Apr 27 23:00 Apr 28 01:00
DM 2 Apr 28 05:00 Apr 27 22:00 Apr 28 01:00 Apr 28 07:00 Apr 28 13:00 Apr 28 15:00

Notes and session video recording are linked below each session schedule table.

DM 1: Data Models

Time: Apr 27 15:00 [session #10]

Speaker Title Time Material
Paul Harrison DM Tooling 12 + 3
Changed:
<
<
Mathieu Servillat Last Step Provenance 12 + 3  
>
>
Mathieu Servillat Last Step Provenance 12 + 3
 
Paul Harrison Observation Proposal DM 12 + 3
Changed:
<
<
Francois Bonnarel Instrument Field of View DM and mapping in VOT 12 + 3  
>
>
Francois Bonnarel Instrument Field of View DM and mapping in VOT 12 + 3

  Moderator: Laurent, Notetaker: Jesus

notes: etherpad notes (link to live notes, should expire around end of April 2023)

DM 2 : VOTable Annotation

Time: Apr 28 05:00 [session #13]

Speaker Title Time Material
Laurent Michel Annotation Syntax 12+ 3  
Mireille Louys Annotating TAP Responses on the Fly 12 + 3  
Laurent Michel Implementation Status, issues and Prospects    
       

Moderator: Laurent, Notetaker: Jesus

notes: etherpad notes (link to live notes, should expire around end of April 2023)

Abstracts

DM Tooling (Paul Harrison)

Recent updates to the tools for data model authors will be discussed. The tools are now driven by gradle and can be found in https://github.com/ivoa/vo-dml

Last Step Provenance (Mathieu Servillat)

We propose a simplified structure to describe the immediate provenance of an entity as a single record, based on the IVOA Provenance Data Model, in order to facilitate its use and adoption.
We thus define a flat list of attributes to describe the last activity that led to the generation of an entity, in the particular case of digital dataset generation.

The note can be accessed here : 2022-04-14_IVOA_Note___Last_step_provenance.pdf

Observation Proposal DM (Paul Harrison)

A data model for creating and managing observing proposals is being created in https://github.com/ivoa/ProposalDM. The current status and future plans will be presented. It should be noted that there will be a hack-a-thon session for those wishing to learn more and be able to contribute to the model.

Instrument Field of View DM and mapping in VOT (François Bonnarel)

The field of views descriptors used by Aladin are currently coded in VOTable in a way that is not standardized by the VO and are understood only by Aladin and a few others.
The Model Instance in VOtable (MIVOT) standard is being recommended to encode in VOTable annotations to associate data models with tabular data.
We propose to replace the current field of view encoding in Aladin with an encoding based on MIVOT rendering an "instrument field of view" data model reusing some VO model components such as coords.

Annotation Syntax (Laurent Michel)

VO mode annotation syntax proposes a syntax to map VOTable data on any model serialized in VO-DML. MIVOT annotations are grouped in a single XML block located in the resource head. The annotations operate as a bridge between the data and the model. It can denote the way data are connected to each other as well as different tables can be joined together. It is also able to carry data or meta-data that are missing in the VOTable. The annotation block is made of bricks that facilitate both annotation process and model instance reconstruction. it has been designed so as not to alter the original VOTable content, thus limiting its impact on legacy clients.

Annotating TAP Response on the Fly (Mireille Louys)

Currently the TAP protocol presents table data and metadata via a {TAP\_SCHEMA} describing the served tables with their columns and possible joins between them.

We explore here how to add an information layer, so that values within table columns can be used to instanciate objects defined in a selected IVOA data model like Photometry, Coords, Measure or the proposed MANGO container model. This information layer is provided through annotation tags which tell how the columns' values can be interpreted as attributes of instances of that model.

Then when a TAP query is processed, our server add-on interprets the ADQL query string and produces on-the-fly, when possible, the TAP response as an annotated VOTable document. The FIELD elements in the table response are mapped to corresponding model elements templated for this service. This has been prototyped in Java, using the VOLLT package library and a template annotation document representing elements from the MANGO data model. Examples on Vizier and Chandra catalogs will be shown.

Annotation: Implementation Status, Issues and Prospects (Laurent Michel)

The Model Instance in VOtable standard needs reference implementations to be validated. These reference implementations are based on annotated VOtables; they must also demonstrate that code reading VOtable data through a model view is both feasible and useful. We will present a Python based demonstrator exploring different ways to design model-based APIs. This talk is connected with the first hack-a-thon topic

[back to main programme page]

-- LaurentMichel - 2022-04-21

<--  
-->
Added:
>
>
 
META FILEATTACHMENT attachment="2022-04-14_IVOA_Note___Last_step_provenance.pdf" attr="" comment="2022-04-14 IVOA_Note___Last_step_provenance" date="1650899760" name="2022-04-14_IVOA_Note___Last_step_provenance.pdf" path="2022-04-14_IVOA_Note___Last_step_provenance.pdf" size="380104" user="MathieuServillat" version="1"
META FILEATTACHMENT attachment="ProposalDM2-PAH.pdf" attr="" comment="Proposal DM Slides" date="1651064865" name="ProposalDM2-PAH.pdf" path="ProposalDM2-PAH.pdf" size="2729358" user="PaulHarrison" version="1"
META FILEATTACHMENT attachment="VO-DML_TOOLS_Update_PAH.pdf" attr="" comment="VO-DML Tooling update slides" date="1651064924" name="VO-DML_TOOLS_Update_PAH.pdf" path="VO-DML_TOOLS_Update_PAH.pdf" size="4084867" user="PaulHarrison" version="1"
Added:
>
>
META FILEATTACHMENT attachment="2022-04-27_Last-step_provenance_IVOA.pdf" attr="" comment="" date="1651070706" name="2022-04-27_Last-step_provenance_IVOA.pdf" path="2022-04-27_Last-step_provenance_IVOA.pdf" size="2009542" user="MathieuServillat" version="1"
 

Revision 122022-04-27 - PaulHarrison

 
META TOPICPARENT name="InterOpApr2022"

DM Sessions Schedule - IVOA Apr 2022 Interoperability Meeting

[back to main programme page]

** DRAFT in good progress *

Schedule Summary
Session DateTime UTC UTC-07:00 UTC-04:00 UTC+02:00 UTC+08:00 UTC+10:00
Victoria BC/Pasadena Washington DC Strasbourg Perth/Beijing Canberra
DM 1 Apr 27 15:00 Apr 27 08:00 Apr 27 11:00 Apr 27 17:00 Apr 27 23:00 Apr 28 01:00
DM 2 Apr 28 05:00 Apr 27 22:00 Apr 28 01:00 Apr 28 07:00 Apr 28 13:00 Apr 28 15:00

Notes and session video recording are linked below each session schedule table.

DM 1: Data Models

Time: Apr 27 15:00 [session #10]

Speaker Title Time Material
Changed:
<
<
Paul Harrison DM Tooling 12 + 3  
>
>
Paul Harrison DM Tooling 12 + 3
 
Mathieu Servillat Last Step Provenance 12 + 3  
Changed:
<
<
Paul Harrison Observation Proposal DM 12 + 3  
>
>
Paul Harrison Observation Proposal DM 12 + 3
 
Francois Bonnarel Instrument Field of View DM and mapping in VOT 12 + 3  

Moderator: Laurent, Notetaker: Jesus

notes: etherpad notes (link to live notes, should expire around end of April 2023)

DM 2 : VOTable Annotation

Time: Apr 28 05:00 [session #13]

Speaker Title Time Material
Laurent Michel Annotation Syntax 12+ 3  
Mireille Louys Annotating TAP Responses on the Fly 12 + 3  
Laurent Michel Implementation Status, issues and Prospects    
       

Moderator: Laurent, Notetaker: Jesus

notes: etherpad notes (link to live notes, should expire around end of April 2023)

Abstracts

DM Tooling (Paul Harrison)

Recent updates to the tools for data model authors will be discussed. The tools are now driven by gradle and can be found in https://github.com/ivoa/vo-dml

Last Step Provenance (Mathieu Servillat)

We propose a simplified structure to describe the immediate provenance of an entity as a single record, based on the IVOA Provenance Data Model, in order to facilitate its use and adoption.
We thus define a flat list of attributes to describe the last activity that led to the generation of an entity, in the particular case of digital dataset generation.

The note can be accessed here : 2022-04-14_IVOA_Note___Last_step_provenance.pdf

Observation Proposal DM (Paul Harrison)

A data model for creating and managing observing proposals is being created in https://github.com/ivoa/ProposalDM. The current status and future plans will be presented. It should be noted that there will be a hack-a-thon session for those wishing to learn more and be able to contribute to the model.

Instrument Field of View DM and mapping in VOT (François Bonnarel)

The field of views descriptors used by Aladin are currently coded in VOTable in a way that is not standardized by the VO and are understood only by Aladin and a few others.
The Model Instance in VOtable (MIVOT) standard is being recommended to encode in VOTable annotations to associate data models with tabular data.
We propose to replace the current field of view encoding in Aladin with an encoding based on MIVOT rendering an "instrument field of view" data model reusing some VO model components such as coords.

Annotation Syntax (Laurent Michel)

VO mode annotation syntax proposes a syntax to map VOTable data on any model serialized in VO-DML. MIVOT annotations are grouped in a single XML block located in the resource head. The annotations operate as a bridge between the data and the model. It can denote the way data are connected to each other as well as different tables can be joined together. It is also able to carry data or meta-data that are missing in the VOTable. The annotation block is made of bricks that facilitate both annotation process and model instance reconstruction. it has been designed so as not to alter the original VOTable content, thus limiting its impact on legacy clients.

Annotating TAP Response on the Fly (Mireille Louys)

Currently the TAP protocol presents table data and metadata via a {TAP\_SCHEMA} describing the served tables with their columns and possible joins between them.

We explore here how to add an information layer, so that values within table columns can be used to instanciate objects defined in a selected IVOA data model like Photometry, Coords, Measure or the proposed MANGO container model. This information layer is provided through annotation tags which tell how the columns' values can be interpreted as attributes of instances of that model.

Then when a TAP query is processed, our server add-on interprets the ADQL query string and produces on-the-fly, when possible, the TAP response as an annotated VOTable document. The FIELD elements in the table response are mapped to corresponding model elements templated for this service. This has been prototyped in Java, using the VOLLT package library and a template annotation document representing elements from the MANGO data model. Examples on Vizier and Chandra catalogs will be shown.

Annotation: Implementation Status, Issues and Prospects (Laurent Michel)

The Model Instance in VOtable standard needs reference implementations to be validated. These reference implementations are based on annotated VOtables; they must also demonstrate that code reading VOtable data through a model view is both feasible and useful. We will present a Python based demonstrator exploring different ways to design model-based APIs. This talk is connected with the first hack-a-thon topic

[back to main programme page]

-- LaurentMichel - 2022-04-21

<--  
-->

META FILEATTACHMENT attachment="2022-04-14_IVOA_Note___Last_step_provenance.pdf" attr="" comment="2022-04-14 IVOA_Note___Last_step_provenance" date="1650899760" name="2022-04-14_IVOA_Note___Last_step_provenance.pdf" path="2022-04-14_IVOA_Note___Last_step_provenance.pdf" size="380104" user="MathieuServillat" version="1"
Added:
>
>
META FILEATTACHMENT attachment="ProposalDM2-PAH.pdf" attr="" comment="Proposal DM Slides" date="1651064865" name="ProposalDM2-PAH.pdf" path="ProposalDM2-PAH.pdf" size="2729358" user="PaulHarrison" version="1"
META FILEATTACHMENT attachment="VO-DML_TOOLS_Update_PAH.pdf" attr="" comment="VO-DML Tooling update slides" date="1651064924" name="VO-DML_TOOLS_Update_PAH.pdf" path="VO-DML_TOOLS_Update_PAH.pdf" size="4084867" user="PaulHarrison" version="1"
 

Revision 112022-04-25 - MathieuServillat

 
META TOPICPARENT name="InterOpApr2022"

DM Sessions Schedule - IVOA Apr 2022 Interoperability Meeting

[back to main programme page]

** DRAFT in good progress *

Schedule Summary
Session DateTime UTC UTC-07:00 UTC-04:00 UTC+02:00 UTC+08:00 UTC+10:00
Victoria BC/Pasadena Washington DC Strasbourg Perth/Beijing Canberra
DM 1 Apr 27 15:00 Apr 27 08:00 Apr 27 11:00 Apr 27 17:00 Apr 27 23:00 Apr 28 01:00
DM 2 Apr 28 05:00 Apr 27 22:00 Apr 28 01:00 Apr 28 07:00 Apr 28 13:00 Apr 28 15:00

Notes and session video recording are linked below each session schedule table.

DM 1: Data Models

Time: Apr 27 15:00 [session #10]

Speaker Title Time Material
Paul Harrison DM Tooling 12 + 3  
Mathieu Servillat Last Step Provenance 12 + 3  
Paul Harrison Observation Proposal DM 12 + 3  
Francois Bonnarel Instrument Field of View DM and mapping in VOT 12 + 3  

Moderator: Laurent, Notetaker: Jesus

notes: etherpad notes (link to live notes, should expire around end of April 2023)

DM 2 : VOTable Annotation

Time: Apr 28 05:00 [session #13]

Speaker Title Time Material
Laurent Michel Annotation Syntax 12+ 3  
Mireille Louys Annotating TAP Responses on the Fly 12 + 3  
Laurent Michel Implementation Status, issues and Prospects    
       

Moderator: Laurent, Notetaker: Jesus

notes: etherpad notes (link to live notes, should expire around end of April 2023)

Abstracts

DM Tooling (Paul Harrison)

Recent updates to the tools for data model authors will be discussed. The tools are now driven by gradle and can be found in https://github.com/ivoa/vo-dml

Last Step Provenance (Mathieu Servillat)

Changed:
<
<
abstract
>
>
We propose a simplified structure to describe the immediate provenance of an entity as a single record, based on the IVOA Provenance Data Model, in order to facilitate its use and adoption.
We thus define a flat list of attributes to describe the last activity that led to the generation of an entity, in the particular case of digital dataset generation.
 
Added:
>
>
The note can be accessed here : 2022-04-14_IVOA_Note___Last_step_provenance.pdf
 Observation Proposal DM (Paul Harrison)

A data model for creating and managing observing proposals is being created in https://github.com/ivoa/ProposalDM. The current status and future plans will be presented. It should be noted that there will be a hack-a-thon session for those wishing to learn more and be able to contribute to the model.

Instrument Field of View DM and mapping in VOT (François Bonnarel)

The field of views descriptors used by Aladin are currently coded in VOTable in a way that is not standardized by the VO and are understood only by Aladin and a few others.
The Model Instance in VOtable (MIVOT) standard is being recommended to encode in VOTable annotations to associate data models with tabular data.
We propose to replace the current field of view encoding in Aladin with an encoding based on MIVOT rendering an "instrument field of view" data model reusing some VO model components such as coords.

Annotation Syntax (Laurent Michel)

VO mode annotation syntax proposes a syntax to map VOTable data on any model serialized in VO-DML. MIVOT annotations are grouped in a single XML block located in the resource head. The annotations operate as a bridge between the data and the model. It can denote the way data are connected to each other as well as different tables can be joined together. It is also able to carry data or meta-data that are missing in the VOTable. The annotation block is made of bricks that facilitate both annotation process and model instance reconstruction. it has been designed so as not to alter the original VOTable content, thus limiting its impact on legacy clients.

Annotating TAP Response on the Fly (Mireille Louys)

Currently the TAP protocol presents table data and metadata via a {TAP\_SCHEMA} describing the served tables with their columns and possible joins between them.

We explore here how to add an information layer, so that values within table columns can be used to instanciate objects defined in a selected IVOA data model like Photometry, Coords, Measure or the proposed MANGO container model. This information layer is provided through annotation tags which tell how the columns' values can be interpreted as attributes of instances of that model.

Then when a TAP query is processed, our server add-on interprets the ADQL query string and produces on-the-fly, when possible, the TAP response as an annotated VOTable document. The FIELD elements in the table response are mapped to corresponding model elements templated for this service. This has been prototyped in Java, using the VOLLT package library and a template annotation document representing elements from the MANGO data model. Examples on Vizier and Chandra catalogs will be shown.

Annotation: Implementation Status, Issues and Prospects (Laurent Michel)

The Model Instance in VOtable standard needs reference implementations to be validated. These reference implementations are based on annotated VOtables; they must also demonstrate that code reading VOtable data through a model view is both feasible and useful. We will present a Python based demonstrator exploring different ways to design model-based APIs. This talk is connected with the first hack-a-thon topic

[back to main programme page]

-- LaurentMichel - 2022-04-21

<--  
-->
Added:
>
>
META FILEATTACHMENT attachment="2022-04-14_IVOA_Note___Last_step_provenance.pdf" attr="" comment="2022-04-14 IVOA_Note___Last_step_provenance" date="1650899760" name="2022-04-14_IVOA_Note___Last_step_provenance.pdf" path="2022-04-14_IVOA_Note___Last_step_provenance.pdf" size="380104" user="MathieuServillat" version="1"
 

Revision 102022-04-23 - LaurentMichel

 
META TOPICPARENT name="InterOpApr2022"

DM Sessions Schedule - IVOA Apr 2022 Interoperability Meeting

[back to main programme page]

Changed:
<
<

** DRAFT in good progress *

>
>

** DRAFT in good progress *

 
Schedule Summary
Session DateTime UTC UTC-07:00 UTC-04:00 UTC+02:00 UTC+08:00 UTC+10:00
Victoria BC/Pasadena Washington DC Strasbourg Perth/Beijing Canberra
DM 1 Apr 27 15:00 Apr 27 08:00 Apr 27 11:00 Apr 27 17:00 Apr 27 23:00 Apr 28 01:00
DM 2 Apr 28 05:00 Apr 27 22:00 Apr 28 01:00 Apr 28 07:00 Apr 28 13:00 Apr 28 15:00

Notes and session video recording are linked below each session schedule table.

DM 1: Data Models

Time: Apr 27 15:00 [session #10]

Speaker Title Time Material
Paul Harrison DM Tooling 12 + 3  
Mathieu Servillat Last Step Provenance 12 + 3  
Paul Harrison Observation Proposal DM 12 + 3  
Francois Bonnarel Instrument Field of View DM and mapping in VOT 12 + 3  

Moderator: Laurent, Notetaker: Jesus

notes: etherpad notes (link to live notes, should expire around end of April 2023)

DM 2 : VOTable Annotation

Changed:
<
<
Time: Apr 28 05:00 [session #14]
>
>
Time: Apr 28 05:00 [session #13]
 
Speaker Title Time Material
Laurent Michel Annotation Syntax 12+ 3  
Mireille Louys Annotating TAP Responses on the Fly 12 + 3  
Laurent Michel Implementation Status, issues and Prospects    
       

Moderator: Laurent, Notetaker: Jesus

notes: etherpad notes (link to live notes, should expire around end of April 2023)

Abstracts

DM Tooling (Paul Harrison)

Recent updates to the tools for data model authors will be discussed. The tools are now driven by gradle and can be found in https://github.com/ivoa/vo-dml

Last Step Provenance (Mathieu Servillat)

abstract

Observation Proposal DM (Paul Harrison)

A data model for creating and managing observing proposals is being created in https://github.com/ivoa/ProposalDM. The current status and future plans will be presented. It should be noted that there will be a hack-a-thon session for those wishing to learn more and be able to contribute to the model.

Instrument Field of View DM and mapping in VOT (François Bonnarel)

Changed:
<
<
The field of views descriptors used by Aladin are currently coded in VOTable in a way that is not standardized by the VO and are understood only by Aladin and a few others.
The Model Instance in VOtable (MIVOT) standard is being recommended to encode in VOTable annotations to associate data models with tabular data.
We propose to replace the current field of view encoding in Aladin with an encoding based on MIVOT rendering an "instrument field of view" data model reusing some VO model components such as coords.
>
>
The field of views descriptors used by Aladin are currently coded in VOTable in a way that is not standardized by the VO and are understood only by Aladin and a few others.
The Model Instance in VOtable (MIVOT) standard is being recommended to encode in VOTable annotations to associate data models with tabular data.
We propose to replace the current field of view encoding in Aladin with an encoding based on MIVOT rendering an "instrument field of view" data model reusing some VO model components such as coords.
  Annotation Syntax (Laurent Michel)

VO mode annotation syntax proposes a syntax to map VOTable data on any model serialized in VO-DML. MIVOT annotations are grouped in a single XML block located in the resource head. The annotations operate as a bridge between the data and the model. It can denote the way data are connected to each other as well as different tables can be joined together. It is also able to carry data or meta-data that are missing in the VOTable. The annotation block is made of bricks that facilitate both annotation process and model instance reconstruction. it has been designed so as not to alter the original VOTable content, thus limiting its impact on legacy clients.

Annotating TAP Response on the Fly (Mireille Louys)

Currently the TAP protocol presents table data and metadata via a {TAP\_SCHEMA} describing the served tables with their columns and possible joins between them.

We explore here how to add an information layer, so that values within table columns can be used to instanciate objects defined in a selected IVOA data model like Photometry, Coords, Measure or the proposed MANGO container model. This information layer is provided through annotation tags which tell how the columns' values can be interpreted as attributes of instances of that model.

Then when a TAP query is processed, our server add-on interprets the ADQL query string and produces on-the-fly, when possible, the TAP response as an annotated VOTable document. The FIELD elements in the table response are mapped to corresponding model elements templated for this service. This has been prototyped in Java, using the VOLLT package library and a template annotation document representing elements from the MANGO data model. Examples on Vizier and Chandra catalogs will be shown.

Annotation: Implementation Status, Issues and Prospects (Laurent Michel)

The Model Instance in VOtable standard needs reference implementations to be validated. These reference implementations are based on annotated VOtables; they must also demonstrate that code reading VOtable data through a model view is both feasible and useful. We will present a Python based demonstrator exploring different ways to design model-based APIs. This talk is connected with the first hack-a-thon topic

[back to main programme page]

-- LaurentMichel - 2022-04-21

<--  
-->

Revision 92022-04-22 - FrancoisBonnarel

 
META TOPICPARENT name="InterOpApr2022"

DM Sessions Schedule - IVOA Apr 2022 Interoperability Meeting

[back to main programme page]

** DRAFT in good progress *

Schedule Summary
Session DateTime UTC UTC-07:00 UTC-04:00 UTC+02:00 UTC+08:00 UTC+10:00
Victoria BC/Pasadena Washington DC Strasbourg Perth/Beijing Canberra
DM 1 Apr 27 15:00 Apr 27 08:00 Apr 27 11:00 Apr 27 17:00 Apr 27 23:00 Apr 28 01:00
DM 2 Apr 28 05:00 Apr 27 22:00 Apr 28 01:00 Apr 28 07:00 Apr 28 13:00 Apr 28 15:00

Notes and session video recording are linked below each session schedule table.

DM 1: Data Models

Time: Apr 27 15:00 [session #10]

Speaker Title Time Material
Paul Harrison DM Tooling 12 + 3  
Mathieu Servillat Last Step Provenance 12 + 3  
Paul Harrison Observation Proposal DM 12 + 3  
Changed:
<
<
Francois Bonnarel Field of View DM 12 + 3  
>
>
Francois Bonnarel Instrument Field of View DM and mapping in VOT 12 + 3  
  Moderator: Laurent, Notetaker: Jesus

notes: etherpad notes (link to live notes, should expire around end of April 2023)

DM 2 : VOTable Annotation

Time: Apr 28 05:00 [session #14]

Speaker Title Time Material
Laurent Michel Annotation Syntax 12+ 3  
Mireille Louys Annotating TAP Responses on the Fly 12 + 3  
Laurent Michel Implementation Status, issues and Prospects    
       

Moderator: Laurent, Notetaker: Jesus

notes: etherpad notes (link to live notes, should expire around end of April 2023)

Abstracts

DM Tooling (Paul Harrison)

Recent updates to the tools for data model authors will be discussed. The tools are now driven by gradle and can be found in https://github.com/ivoa/vo-dml

Last Step Provenance (Mathieu Servillat)

abstract

Observation Proposal DM (Paul Harrison)

A data model for creating and managing observing proposals is being created in https://github.com/ivoa/ProposalDM. The current status and future plans will be presented. It should be noted that there will be a hack-a-thon session for those wishing to learn more and be able to contribute to the model.

Changed:
<
<
Field of View DM (François Bonnarel)
>
>
Instrument Field of View DM and mapping in VOT (François Bonnarel)
 
Changed:
<
<
The field of views descriptors used by Alain are currently coded in VOTable in a way that is not standardized by the OV but are understood only by Aladin.
The Model Instance in VOtable (MIVOT) standard is being recommended to encode in VOTable annotations to associate data models with tabular data.
The presented work proposes to replace the current field of view encoding in Aladin with an encoding based on MIVOT and on a field of view data model reusing some VO model components.
>
>
The field of views descriptors used by Aladin are currently coded in VOTable in a way that is not standardized by the VO and are understood only by Aladin and a few others.
The Model Instance in VOtable (MIVOT) standard is being recommended to encode in VOTable annotations to associate data models with tabular data.
We propose to replace the current field of view encoding in Aladin with an encoding based on MIVOT rendering an "instrument field of view" data model reusing some VO model components such as coords.
  Annotation Syntax (Laurent Michel)

VO mode annotation syntax proposes a syntax to map VOTable data on any model serialized in VO-DML. MIVOT annotations are grouped in a single XML block located in the resource head. The annotations operate as a bridge between the data and the model. It can denote the way data are connected to each other as well as different tables can be joined together. It is also able to carry data or meta-data that are missing in the VOTable. The annotation block is made of bricks that facilitate both annotation process and model instance reconstruction. it has been designed so as not to alter the original VOTable content, thus limiting its impact on legacy clients.

Annotating TAP Response on the Fly (Mireille Louys)

Currently the TAP protocol presents table data and metadata via a {TAP\_SCHEMA} describing the served tables with their columns and possible joins between them.

We explore here how to add an information layer, so that values within table columns can be used to instanciate objects defined in a selected IVOA data model like Photometry, Coords, Measure or the proposed MANGO container model. This information layer is provided through annotation tags which tell how the columns' values can be interpreted as attributes of instances of that model.

Then when a TAP query is processed, our server add-on interprets the ADQL query string and produces on-the-fly, when possible, the TAP response as an annotated VOTable document. The FIELD elements in the table response are mapped to corresponding model elements templated for this service. This has been prototyped in Java, using the VOLLT package library and a template annotation document representing elements from the MANGO data model. Examples on Vizier and Chandra catalogs will be shown.

Annotation: Implementation Status, Issues and Prospects (Laurent Michel)

The Model Instance in VOtable standard needs reference implementations to be validated. These reference implementations are based on annotated VOtables; they must also demonstrate that code reading VOtable data through a model view is both feasible and useful. We will present a Python based demonstrator exploring different ways to design model-based APIs. This talk is connected with the first hack-a-thon topic

[back to main programme page]

-- LaurentMichel - 2022-04-21

<--  
-->

Revision 82022-04-22 - LaurentMichel

 
META TOPICPARENT name="InterOpApr2022"

DM Sessions Schedule - IVOA Apr 2022 Interoperability Meeting

[back to main programme page]

Changed:
<
<

** DRAFT under development *

>
>

** DRAFT in good progress *

 
Schedule Summary
Session DateTime UTC UTC-07:00 UTC-04:00 UTC+02:00 UTC+08:00 UTC+10:00
Victoria BC/Pasadena Washington DC Strasbourg Perth/Beijing Canberra
DM 1 Apr 27 15:00 Apr 27 08:00 Apr 27 11:00 Apr 27 17:00 Apr 27 23:00 Apr 28 01:00
Changed:
<
<
DM 2 Apr 28 06:30 Apr 27 23:30 Apr 28 02:30 Apr 28 08:30 Apr 28 14:30 Apr 28 16:30
>
>
DM 2 Apr 28 05:00 Apr 27 22:00 Apr 28 01:00 Apr 28 07:00 Apr 28 13:00 Apr 28 15:00
 

Notes and session video recording are linked below each session schedule table.

DM 1: Data Models

Time: Apr 27 15:00 [session #10]

Speaker Title Time Material
Paul Harrison DM Tooling 12 + 3  
Mathieu Servillat Last Step Provenance 12 + 3  
Paul Harrison Observation Proposal DM 12 + 3  
Francois Bonnarel Field of View DM 12 + 3  

Moderator: Laurent, Notetaker: Jesus

notes: etherpad notes (link to live notes, should expire around end of April 2023)

DM 2 : VOTable Annotation

Changed:
<
<
Time: Apr 28 06:30 [session #14]
>
>
Time: Apr 28 05:00 [session #14]
 
Speaker Title Time Material
Laurent Michel Annotation Syntax 12+ 3  
Mireille Louys Annotating TAP Responses on the Fly 12 + 3  
Laurent Michel Implementation Status, issues and Prospects    
       

Moderator: Laurent, Notetaker: Jesus

notes: etherpad notes (link to live notes, should expire around end of April 2023)

Abstracts

DM Tooling (Paul Harrison)

Recent updates to the tools for data model authors will be discussed. The tools are now driven by gradle and can be found in https://github.com/ivoa/vo-dml

Last Step Provenance (Mathieu Servillat)

abstract

Observation Proposal DM (Paul Harrison)

A data model for creating and managing observing proposals is being created in https://github.com/ivoa/ProposalDM. The current status and future plans will be presented. It should be noted that there will be a hack-a-thon session for those wishing to learn more and be able to contribute to the model.

Field of View DM (François Bonnarel)

The field of views descriptors used by Alain are currently coded in VOTable in a way that is not standardized by the OV but are understood only by Aladin.
The Model Instance in VOtable (MIVOT) standard is being recommended to encode in VOTable annotations to associate data models with tabular data.
The presented work proposes to replace the current field of view encoding in Aladin with an encoding based on MIVOT and on a field of view data model reusing some VO model components.

Annotation Syntax (Laurent Michel)

VO mode annotation syntax proposes a syntax to map VOTable data on any model serialized in VO-DML. MIVOT annotations are grouped in a single XML block located in the resource head. The annotations operate as a bridge between the data and the model. It can denote the way data are connected to each other as well as different tables can be joined together. It is also able to carry data or meta-data that are missing in the VOTable. The annotation block is made of bricks that facilitate both annotation process and model instance reconstruction. it has been designed so as not to alter the original VOTable content, thus limiting its impact on legacy clients.

Annotating TAP Response on the Fly (Mireille Louys)

Currently the TAP protocol presents table data and metadata via a {TAP\_SCHEMA} describing the served tables with their columns and possible joins between them.

We explore here how to add an information layer, so that values within table columns can be used to instanciate objects defined in a selected IVOA data model like Photometry, Coords, Measure or the proposed MANGO container model. This information layer is provided through annotation tags which tell how the columns' values can be interpreted as attributes of instances of that model.

Then when a TAP query is processed, our server add-on interprets the ADQL query string and produces on-the-fly, when possible, the TAP response as an annotated VOTable document. The FIELD elements in the table response are mapped to corresponding model elements templated for this service. This has been prototyped in Java, using the VOLLT package library and a template annotation document representing elements from the MANGO data model. Examples on Vizier and Chandra catalogs will be shown.

Annotation: Implementation Status, Issues and Prospects (Laurent Michel)

The Model Instance in VOtable standard needs reference implementations to be validated. These reference implementations are based on annotated VOtables; they must also demonstrate that code reading VOtable data through a model view is both feasible and useful. We will present a Python based demonstrator exploring different ways to design model-based APIs. This talk is connected with the first hack-a-thon topic

[back to main programme page]

-- LaurentMichel - 2022-04-21

<--  
-->

Revision 72022-04-21 - MireilleLouys

 
META TOPICPARENT name="InterOpApr2022"

DM Sessions Schedule - IVOA Apr 2022 Interoperability Meeting

[back to main programme page]

** DRAFT under development *

Schedule Summary
Session DateTime UTC UTC-07:00 UTC-04:00 UTC+02:00 UTC+08:00 UTC+10:00
Victoria BC/Pasadena Washington DC Strasbourg Perth/Beijing Canberra
DM 1 Apr 27 15:00 Apr 27 08:00 Apr 27 11:00 Apr 27 17:00 Apr 27 23:00 Apr 28 01:00
DM 2 Apr 28 06:30 Apr 27 23:30 Apr 28 02:30 Apr 28 08:30 Apr 28 14:30 Apr 28 16:30

Notes and session video recording are linked below each session schedule table.

DM 1: Data Models

Time: Apr 27 15:00 [session #10]

Speaker Title Time Material
Paul Harrison DM Tooling 12 + 3  
Mathieu Servillat Last Step Provenance 12 + 3  
Paul Harrison Observation Proposal DM 12 + 3  
Francois Bonnarel Field of View DM 12 + 3  

Moderator: Laurent, Notetaker: Jesus

notes: etherpad notes (link to live notes, should expire around end of April 2023)

DM 2 : VOTable Annotation

Time: Apr 28 06:30 [session #14]

Speaker Title Time Material
Laurent Michel Annotation Syntax 12+ 3  
Mireille Louys Annotating TAP Responses on the Fly 12 + 3  
Laurent Michel Implementation Status, issues and Prospects    
       

Moderator: Laurent, Notetaker: Jesus

notes: etherpad notes (link to live notes, should expire around end of April 2023)

Abstracts

DM Tooling (Paul Harrison)

Recent updates to the tools for data model authors will be discussed. The tools are now driven by gradle and can be found in https://github.com/ivoa/vo-dml

Last Step Provenance (Mathieu Servillat)

abstract

Observation Proposal DM (Paul Harrison)

A data model for creating and managing observing proposals is being created in https://github.com/ivoa/ProposalDM. The current status and future plans will be presented. It should be noted that there will be a hack-a-thon session for those wishing to learn more and be able to contribute to the model.

Field of View DM (François Bonnarel)

The field of views descriptors used by Alain are currently coded in VOTable in a way that is not standardized by the OV but are understood only by Aladin.
The Model Instance in VOtable (MIVOT) standard is being recommended to encode in VOTable annotations to associate data models with tabular data.
The presented work proposes to replace the current field of view encoding in Aladin with an encoding based on MIVOT and on a field of view data model reusing some VO model components.

Annotation Syntax (Laurent Michel)

VO mode annotation syntax proposes a syntax to map VOTable data on any model serialized in VO-DML. MIVOT annotations are grouped in a single XML block located in the resource head. The annotations operate as a bridge between the data and the model. It can denote the way data are connected to each other as well as different tables can be joined together. It is also able to carry data or meta-data that are missing in the VOTable. The annotation block is made of bricks that facilitate both annotation process and model instance reconstruction. it has been designed so as not to alter the original VOTable content, thus limiting its impact on legacy clients.

Annotating TAP Response on the Fly (Mireille Louys)

Changed:
<
<
With the success and widespread of the IVOA Table Access Protocol for discovering and querying tabular data in astronomy, more than one hundred of TAP services exposing altogether 22 thousands of tables are accessible from the IVOA Registries at the time of writing. Currently the TAP protocol presents table data and metadata via a {TAP\_SCHEMA} describing the served tables with their columns and possible joins between them. We explore here how to add an information layer, so that values within table columns can be gathered and used to populate instances of objects defined in a selected IVOA data model like Photometry, Coords, Measure, Transform or the proposed MANGO container model. This information layer is provided through annotation tags which tell how the columns' values can be interpreted as attributes of instances of that model. Then when a TAP query is processed, our server add-on interprets the ADQL query string and produces on-the-fly, when possible, the TAP response as an annotated VOTable document. The FIELD elements in the table response are mapped to corresponding model elements templated for this service. This has been prototyped in Java, using the VOLLT package library and a template annotation document representing elements from the MANGO data model. This has been exercised on examples based on Vizier and Chandra catalogs.
>
>
Currently the TAP protocol presents table data and metadata via a {TAP\_SCHEMA} describing the served tables with their columns and possible joins between them.
Added:
>
>
We explore here how to add an information layer, so that values within table columns can be used to instanciate objects defined in a selected IVOA data model like Photometry, Coords, Measure or the proposed MANGO container model. This information layer is provided through annotation tags which tell how the columns' values can be interpreted as attributes of instances of that model.

Then when a TAP query is processed, our server add-on interprets the ADQL query string and produces on-the-fly, when possible, the TAP response as an annotated VOTable document. The FIELD elements in the table response are mapped to corresponding model elements templated for this service. This has been prototyped in Java, using the VOLLT package library and a template annotation document representing elements from the MANGO data model. Examples on Vizier and Chandra catalogs will be shown.

  Annotation: Implementation Status, Issues and Prospects (Laurent Michel)

The Model Instance in VOtable standard needs reference implementations to be validated. These reference implementations are based on annotated VOtables; they must also demonstrate that code reading VOtable data through a model view is both feasible and useful. We will present a Python based demonstrator exploring different ways to design model-based APIs. This talk is connected with the first hack-a-thon topic

[back to main programme page]

-- LaurentMichel - 2022-04-21

<--  
-->

Revision 62022-04-21 - PaulHarrison

 
META TOPICPARENT name="InterOpApr2022"

DM Sessions Schedule - IVOA Apr 2022 Interoperability Meeting

[back to main programme page]

** DRAFT under development *

Schedule Summary
Session DateTime UTC UTC-07:00 UTC-04:00 UTC+02:00 UTC+08:00 UTC+10:00
Victoria BC/Pasadena Washington DC Strasbourg Perth/Beijing Canberra
DM 1 Apr 27 15:00 Apr 27 08:00 Apr 27 11:00 Apr 27 17:00 Apr 27 23:00 Apr 28 01:00
DM 2 Apr 28 06:30 Apr 27 23:30 Apr 28 02:30 Apr 28 08:30 Apr 28 14:30 Apr 28 16:30

Notes and session video recording are linked below each session schedule table.

DM 1: Data Models

Time: Apr 27 15:00 [session #10]

Speaker Title Time Material
Paul Harrison DM Tooling 12 + 3  
Mathieu Servillat Last Step Provenance 12 + 3  
Paul Harrison Observation Proposal DM 12 + 3  
Francois Bonnarel Field of View DM 12 + 3  

Moderator: Laurent, Notetaker: Jesus

notes: etherpad notes (link to live notes, should expire around end of April 2023)

DM 2 : VOTable Annotation

Time: Apr 28 06:30 [session #14]

Speaker Title Time Material
Laurent Michel Annotation Syntax 12+ 3  
Mireille Louys Annotating TAP Responses on the Fly 12 + 3  
Laurent Michel Implementation Status, issues and Prospects    
       

Moderator: Laurent, Notetaker: Jesus

notes: etherpad notes (link to live notes, should expire around end of April 2023)

Abstracts

DM Tooling (Paul Harrison)

Changed:
<
<
abstract
>
>
Recent updates to the tools for data model authors will be discussed. The tools are now driven by gradle and can be found in https://github.com/ivoa/vo-dml
  Last Step Provenance (Mathieu Servillat)

abstract

Observation Proposal DM (Paul Harrison)

Changed:
<
<
abstract
>
>
A data model for creating and managing observing proposals is being created in https://github.com/ivoa/ProposalDM. The current status and future plans will be presented. It should be noted that there will be a hack-a-thon session for those wishing to learn more and be able to contribute to the model.
  Field of View DM (François Bonnarel)

The field of views descriptors used by Alain are currently coded in VOTable in a way that is not standardized by the OV but are understood only by Aladin.
The Model Instance in VOtable (MIVOT) standard is being recommended to encode in VOTable annotations to associate data models with tabular data.
The presented work proposes to replace the current field of view encoding in Aladin with an encoding based on MIVOT and on a field of view data model reusing some VO model components.

Annotation Syntax (Laurent Michel)

VO mode annotation syntax proposes a syntax to map VOTable data on any model serialized in VO-DML. MIVOT annotations are grouped in a single XML block located in the resource head. The annotations operate as a bridge between the data and the model. It can denote the way data are connected to each other as well as different tables can be joined together. It is also able to carry data or meta-data that are missing in the VOTable. The annotation block is made of bricks that facilitate both annotation process and model instance reconstruction. it has been designed so as not to alter the original VOTable content, thus limiting its impact on legacy clients.

Annotating TAP Response on the Fly (Mireille Louys)

With the success and widespread of the IVOA Table Access Protocol for discovering and querying tabular data in astronomy, more than one hundred of TAP services exposing altogether 22 thousands of tables are accessible from the IVOA Registries at the time of writing. Currently the TAP protocol presents table data and metadata via a {TAP\_SCHEMA} describing the served tables with their columns and possible joins between them. We explore here how to add an information layer, so that values within table columns can be gathered and used to populate instances of objects defined in a selected IVOA data model like Photometry, Coords, Measure, Transform or the proposed MANGO container model. This information layer is provided through annotation tags which tell how the columns' values can be interpreted as attributes of instances of that model. Then when a TAP query is processed, our server add-on interprets the ADQL query string and produces on-the-fly, when possible, the TAP response as an annotated VOTable document. The FIELD elements in the table response are mapped to corresponding model elements templated for this service. This has been prototyped in Java, using the VOLLT package library and a template annotation document representing elements from the MANGO data model. This has been exercised on examples based on Vizier and Chandra catalogs.

Annotation: Implementation Status, Issues and Prospects (Laurent Michel)

The Model Instance in VOtable standard needs reference implementations to be validated. These reference implementations are based on annotated VOtables; they must also demonstrate that code reading VOtable data through a model view is both feasible and useful. We will present a Python based demonstrator exploring different ways to design model-based APIs. This talk is connected with the first hack-a-thon topic

[back to main programme page]

-- LaurentMichel - 2022-04-21

<--  
-->

Revision 52022-04-21 - LaurentMichel

 
META TOPICPARENT name="InterOpApr2022"

DM Sessions Schedule - IVOA Apr 2022 Interoperability Meeting

[back to main programme page]

** DRAFT under development *

Schedule Summary
Session DateTime UTC UTC-07:00 UTC-04:00 UTC+02:00 UTC+08:00 UTC+10:00
Victoria BC/Pasadena Washington DC Strasbourg Perth/Beijing Canberra
DM 1 Apr 27 15:00 Apr 27 08:00 Apr 27 11:00 Apr 27 17:00 Apr 27 23:00 Apr 28 01:00
DM 2 Apr 28 06:30 Apr 27 23:30 Apr 28 02:30 Apr 28 08:30 Apr 28 14:30 Apr 28 16:30

Notes and session video recording are linked below each session schedule table.

DM 1: Data Models

Time: Apr 27 15:00 [session #10]

Speaker Title Time Material
Paul Harrison DM Tooling 12 + 3  
Mathieu Servillat Last Step Provenance 12 + 3  
Paul Harrison Observation Proposal DM 12 + 3  
Francois Bonnarel Field of View DM 12 + 3  

Moderator: Laurent, Notetaker: Jesus

notes: etherpad notes (link to live notes, should expire around end of April 2023)

DM 2 : VOTable Annotation

Time: Apr 28 06:30 [session #14]

Speaker Title Time Material
Laurent Michel Annotation Syntax 12+ 3  
Mireille Louys Annotating TAP Responses on the Fly 12 + 3  
Laurent Michel Implementation Status, issues and Prospects    
       

Moderator: Laurent, Notetaker: Jesus

notes: etherpad notes (link to live notes, should expire around end of April 2023)

Abstracts

DM Tooling (Paul Harrison)

abstract

Last Step Provenance (Mathieu Servillat)

abstract

Observation Proposal DM (Paul Harrison)

abstract

Field of View DM (François Bonnarel)

Changed:
<
<
abstract
>
>
The field of views descriptors used by Alain are currently coded in VOTable in a way that is not standardized by the OV but are understood only by Aladin.
The Model Instance in VOtable (MIVOT) standard is being recommended to encode in VOTable annotations to associate data models with tabular data.
The presented work proposes to replace the current field of view encoding in Aladin with an encoding based on MIVOT and on a field of view data model reusing some VO model components.
  Annotation Syntax (Laurent Michel)

VO mode annotation syntax proposes a syntax to map VOTable data on any model serialized in VO-DML. MIVOT annotations are grouped in a single XML block located in the resource head. The annotations operate as a bridge between the data and the model. It can denote the way data are connected to each other as well as different tables can be joined together. It is also able to carry data or meta-data that are missing in the VOTable. The annotation block is made of bricks that facilitate both annotation process and model instance reconstruction. it has been designed so as not to alter the original VOTable content, thus limiting its impact on legacy clients.

Annotating TAP Response on the Fly (Mireille Louys)

Changed:
<
<
With the success and widespread of the IVOA Table Access Protocol (1) for discovering and querying tabular data in astronomy, more than one hundred of TAP services exposing altogether 22 thousands of tables are accessible from the IVOA Registries at the time of writing. Currently the TAP protocol presents table data and metadata via a {TAP\_SCHEMA} describing the served tables with their columns and possible joins between them. We explore here how to add an information layer, so that values within table columns can be gathered and used to populate instances of objects defined in a selected IVOA data model like Photometry, Coords, Measure, Transform or the proposed MANGO container model. This information layer is provided through annotation tags which tell how the columns' values can be interpreted as attributes of instances of that model. Then when a TAP query is processed, our server add-on interprets the ADQL query string and produces on-the-fly, when possible, the TAP response as an annotated VOTable document. The FIELD elements in the table response are mapped to corresponding model elements templated for this service. This has been prototyped in Java, using the VOLLT package library and a template annotation document representing elements from the MANGO data model. This has been exercised on examples based on Vizier and Chandra catalogs.
>
>
With the success and widespread of the IVOA Table Access Protocol for discovering and querying tabular data in astronomy, more than one hundred of TAP services exposing altogether 22 thousands of tables are accessible from the IVOA Registries at the time of writing. Currently the TAP protocol presents table data and metadata via a {TAP\_SCHEMA} describing the served tables with their columns and possible joins between them. We explore here how to add an information layer, so that values within table columns can be gathered and used to populate instances of objects defined in a selected IVOA data model like Photometry, Coords, Measure, Transform or the proposed MANGO container model. This information layer is provided through annotation tags which tell how the columns' values can be interpreted as attributes of instances of that model. Then when a TAP query is processed, our server add-on interprets the ADQL query string and produces on-the-fly, when possible, the TAP response as an annotated VOTable document. The FIELD elements in the table response are mapped to corresponding model elements templated for this service. This has been prototyped in Java, using the VOLLT package library and a template annotation document representing elements from the MANGO data model. This has been exercised on examples based on Vizier and Chandra catalogs.
  Annotation: Implementation Status, Issues and Prospects (Laurent Michel)

The Model Instance in VOtable standard needs reference implementations to be validated. These reference implementations are based on annotated VOtables; they must also demonstrate that code reading VOtable data through a model view is both feasible and useful. We will present a Python based demonstrator exploring different ways to design model-based APIs. This talk is connected with the first hack-a-thon topic

[back to main programme page]

Changed:
<
<
-- LaurentMichel - 2022-04-07
>
>
-- LaurentMichel - 2022-04-21
 
<--  
-->

Revision 42022-04-21 - LaurentMichel

 
META TOPICPARENT name="InterOpApr2022"

DM Sessions Schedule - IVOA Apr 2022 Interoperability Meeting

[back to main programme page]

** DRAFT under development *

Schedule Summary
Session DateTime UTC UTC-07:00 UTC-04:00 UTC+02:00 UTC+08:00 UTC+10:00
Victoria BC/Pasadena Washington DC Strasbourg Perth/Beijing Canberra
DM 1 Apr 27 15:00 Apr 27 08:00 Apr 27 11:00 Apr 27 17:00 Apr 27 23:00 Apr 28 01:00
DM 2 Apr 28 06:30 Apr 27 23:30 Apr 28 02:30 Apr 28 08:30 Apr 28 14:30 Apr 28 16:30

Notes and session video recording are linked below each session schedule table.

DM 1: Data Models

Time: Apr 27 15:00 [session #10]

Speaker Title Time Material
Paul Harrison DM Tooling 12 + 3  
Mathieu Servillat Last Step Provenance 12 + 3  
Paul Harrison Observation Proposal DM 12 + 3  
Francois Bonnarel Field of View DM 12 + 3  

Moderator: Laurent, Notetaker: Jesus

notes: etherpad notes (link to live notes, should expire around end of April 2023)

DM 2 : VOTable Annotation

Time: Apr 28 06:30 [session #14]

Speaker Title Time Material
Laurent Michel Annotation Syntax 12+ 3  
Mireille Louys Annotating TAP Responses on the Fly 12 + 3  
Laurent Michel Implementation Status, issues and Prospects    
       

Moderator: Laurent, Notetaker: Jesus

notes: etherpad notes (link to live notes, should expire around end of April 2023)

Added:
>
>

Abstracts

 
Changed:
<
<

>
>
DM Tooling (Paul Harrison)
Added:
>
>
abstract

Last Step Provenance (Mathieu Servillat)

abstract

Observation Proposal DM (Paul Harrison)

abstract

Field of View DM (François Bonnarel)

abstract

Annotation Syntax (Laurent Michel)

VO mode annotation syntax proposes a syntax to map VOTable data on any model serialized in VO-DML. MIVOT annotations are grouped in a single XML block located in the resource head. The annotations operate as a bridge between the data and the model. It can denote the way data are connected to each other as well as different tables can be joined together. It is also able to carry data or meta-data that are missing in the VOTable. The annotation block is made of bricks that facilitate both annotation process and model instance reconstruction. it has been designed so as not to alter the original VOTable content, thus limiting its impact on legacy clients.

Annotating TAP Response on the Fly (Mireille Louys)

With the success and widespread of the IVOA Table Access Protocol (1) for discovering and querying tabular data in astronomy, more than one hundred of TAP services exposing altogether 22 thousands of tables are accessible from the IVOA Registries at the time of writing. Currently the TAP protocol presents table data and metadata via a {TAP\_SCHEMA} describing the served tables with their columns and possible joins between them. We explore here how to add an information layer, so that values within table columns can be gathered and used to populate instances of objects defined in a selected IVOA data model like Photometry, Coords, Measure, Transform or the proposed MANGO container model. This information layer is provided through annotation tags which tell how the columns' values can be interpreted as attributes of instances of that model. Then when a TAP query is processed, our server add-on interprets the ADQL query string and produces on-the-fly, when possible, the TAP response as an annotated VOTable document. The FIELD elements in the table response are mapped to corresponding model elements templated for this service. This has been prototyped in Java, using the VOLLT package library and a template annotation document representing elements from the MANGO data model. This has been exercised on examples based on Vizier and Chandra catalogs.

Annotation: Implementation Status, Issues and Prospects (Laurent Michel)

The Model Instance in VOtable standard needs reference implementations to be validated. These reference implementations are based on annotated VOtables; they must also demonstrate that code reading VOtable data through a model view is both feasible and useful. We will present a Python based demonstrator exploring different ways to design model-based APIs. This talk is connected with the first hack-a-thon topic

  [back to main programme page]

-- LaurentMichel - 2022-04-07

<--  
-->

Revision 32022-04-20 - JamesDempsey

 
META TOPICPARENT name="InterOpApr2022"

DM Sessions Schedule - IVOA Apr 2022 Interoperability Meeting

[back to main programme page]

** DRAFT under development *

Schedule Summary
Changed:
<
<
Session DateTime UTC UTC-07:00 UTC-04:00 UTC+02:00 UTC+08:00 UTC+11:00
>
>
Session DateTime UTC UTC-07:00 UTC-04:00 UTC+02:00 UTC+08:00 UTC+10:00
 
Victoria BC/Pasadena Washington DC Strasbourg Perth/Beijing Canberra
Changed:
<
<
DM 1 Apr 27 15:00 Apr 27 08:00 Apr 27 11:00 Apr 27 17:00 Apr 27 23:00 Apr 28 02:00
DM 2 Apr 28 06:30 Apr 27 23:30 Apr 28 02:30 Apr 28 06:30 Apr 28 14:30 Apr 28 17:30
>
>
DM 1 Apr 27 15:00 Apr 27 08:00 Apr 27 11:00 Apr 27 17:00 Apr 27 23:00 Apr 28 01:00
DM 2 Apr 28 06:30 Apr 27 23:30 Apr 28 02:30 Apr 28 08:30 Apr 28 14:30 Apr 28 16:30
 

Notes and session video recording are linked below each session schedule table.

DM 1: Data Models

Changed:
<
<
Time: Apr 27 15:00 [session #10]
>
>
Time: Apr 27 15:00 [session #10]
 
Speaker Title Time Material
Paul Harrison DM Tooling 12 + 3  
Mathieu Servillat Last Step Provenance 12 + 3  
Paul Harrison Observation Proposal DM 12 + 3  
Francois Bonnarel Field of View DM 12 + 3  

Moderator: Laurent, Notetaker: Jesus

notes: etherpad notes (link to live notes, should expire around end of April 2023)

DM 2 : VOTable Annotation

Changed:
<
<
Time: Apr 28 06:30 [session #14]
>
>
Time: Apr 28 06:30 [session #14]
 
Speaker Title Time Material
Laurent Michel Annotation Syntax 12+ 3  
Mireille Louys Annotating TAP Responses on the Fly 12 + 3  
Laurent Michel Implementation Status, issues and Prospects    
       

Moderator: Laurent, Notetaker: Jesus

notes: etherpad notes (link to live notes, should expire around end of April 2023)


[back to main programme page]

-- LaurentMichel - 2022-04-07

<--  
-->

Revision 22022-04-07 - LaurentMichel

 
META TOPICPARENT name="InterOpApr2022"

DM Sessions Schedule - IVOA Apr 2022 Interoperability Meeting

[back to main programme page]

** DRAFT under development *

Schedule Summary
Session DateTime UTC UTC-07:00 UTC-04:00 UTC+02:00 UTC+08:00 UTC+11:00
Victoria BC/Pasadena Washington DC Strasbourg Perth/Beijing Canberra
DM 1 Apr 27 15:00 Apr 27 08:00 Apr 27 11:00 Apr 27 17:00 Apr 27 23:00 Apr 28 02:00
DM 2 Apr 28 06:30 Apr 27 23:30 Apr 28 02:30 Apr 28 06:30 Apr 28 14:30 Apr 28 17:30

Notes and session video recording are linked below each session schedule table.

Changed:
<
<

DM 1

>
>

DM 1: Data Models

  Time: Apr 27 15:00 [session #10]

Speaker Title Time Material
Changed:
<
<
       
       
       
       
>
>
Paul Harrison DM Tooling 12 + 3  
Mathieu Servillat Last Step Provenance 12 + 3  
Paul Harrison Observation Proposal DM 12 + 3  
Francois Bonnarel Field of View DM 12 + 3  
  Moderator: Laurent, Notetaker: Jesus

notes: etherpad notes (link to live notes, should expire around end of April 2023)

Changed:
<
<

DM 2

>
>

DM 2 : VOTable Annotation

  Time: Apr 28 06:30 [session #14]

Speaker Title Time Material
Added:
>
>
Laurent Michel Annotation Syntax 12+ 3  
Mireille Louys Annotating TAP Responses on the Fly 12 + 3  
Laurent Michel Implementation Status, issues and Prospects    
 
       
Deleted:
<
<
       
       
       
  Moderator: Laurent, Notetaker: Jesus

notes: etherpad notes (link to live notes, should expire around end of April 2023)


[back to main programme page]

Changed:
<
<
-- LaurentMichel - 2022-04-04
>
>
-- LaurentMichel - 2022-04-07
Deleted:
<
<
<!--
* Set ALLOWTOPICRENAME = TWikiAdminGroup
-->
 
<--  
-->

Revision 12022-04-04 - LaurentMichel

 
META TOPICPARENT name="InterOpApr2022"

DM Sessions Schedule - IVOA Apr 2022 Interoperability Meeting

[back to main programme page]

** DRAFT under development *

Schedule Summary
Session DateTime UTC UTC-07:00 UTC-04:00 UTC+02:00 UTC+08:00 UTC+11:00
Victoria BC/Pasadena Washington DC Strasbourg Perth/Beijing Canberra
DM 1 Apr 27 15:00 Apr 27 08:00 Apr 27 11:00 Apr 27 17:00 Apr 27 23:00 Apr 28 02:00
DM 2 Apr 28 06:30 Apr 27 23:30 Apr 28 02:30 Apr 28 06:30 Apr 28 14:30 Apr 28 17:30

Notes and session video recording are linked below each session schedule table.

DM 1

Time: Apr 27 15:00 [session #10]

Speaker Title Time Material
       
       
       
       

Moderator: Laurent, Notetaker: Jesus

notes: etherpad notes (link to live notes, should expire around end of April 2023)

DM 2

Time: Apr 28 06:30 [session #14]

Speaker Title Time Material
       
       
       
       

Moderator: Laurent, Notetaker: Jesus

notes: etherpad notes (link to live notes, should expire around end of April 2023)


[back to main programme page]

-- LaurentMichel - 2022-04-04

<!--
* Set ALLOWTOPICRENAME = TWikiAdminGroup
-->

<--  
-->
 
This site is powered by the TWiki collaboration platform Powered by Perl This site is powered by the TWiki collaboration platformCopyright © 2008-2024 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback