InterOpMay2018VODML < IVOA

---++ Follow-up: Participant Feedback and Requests

The section gathers partipant requests. It is intended to provide both modellers and developpers with inputs on missing, misleading or failing features.
   * Any contribution is welcome.
   * Those who have trouble with editing the Wiki can send an Email either to IVOA.MarkCresitelloDittmar or IVOA.LaurentMichel
   * Please, sign your contribution so that we can get in touch with you for any further precision.

---

   * During our exercise trying to map the prototype Source model to Gaia data results, we discover some model elements that were missing or not clear. If any of these are present, we couldn't figure out where: 
      * Proper Motion (in this case, 2 values, RA PM and Dec PM)
      * Radial velocity
      * Position error (in this case, 2 values, RA Err and Dec Err)
   * Documentation seemed missed from most model elements.
   * When model elements are Quantities, units can be specified in VODML. How does this relate to the units on the FIELDs? Is it duplication, or does it represent a different flavor of unit, or can/should the VODML unit be left blank in cases where a FIELD specifies it?
-- IVOA.TomDonaldson - 2018-05-31

---

---+++ Model Features
   * Source Parameters 
      * Radial velocity (IVOA.PierreFernique)
      * Parallax (IVOA.PierreFernique)
      * Include upper flux limit (Flag?)
      * Add info on algorithm for mag/flux (psf, petro, ...?) (IVOA.AdaNebot)
      * Add pipeline version to Algorithms
   * Make axes dependencies explicit
   * Physical Quantities
   * STC is missing many transformations
   * STC's covariance matrix has one element too many, so it could be asymmetric
   * STC errors missing: sigmax, sigmay, sigmaxy, ErrorMatrix2D.
   * Miscelaneous
---+++ Tools
   * Model Design
   * VO-DML Generation and Validation
   * Mapping Generation
   * VO-Table processing
   * Miscelaneous
-- IVOA.LaurentMichel - 2018-05-31
---++ Wednesday May 30 -- 14:00 to 17:30

These sessions are intended to help data modellers to learn to use the available tools in order to describe their own models using VO-DML. This is a hands-on workshop/hackathon style event and *not* a normal speaker-audience-dicussion session.

If this doesn't sound like something you are ready to do or are interested in, then please don't feel guilty about taking the afternoon off to see more of Victoria, go whale-watching, etc
---++ What is this all about?

VO-DML is the Virtual Observatory Data Modelling Language : <a href="http://www.ivoa.net/documents/VODML/index.html" title="VO-DML-1.0">http://www.ivoa.net/documents/VODML/index.html</a>

The purpose of this session is 2 folds
   * Giving VO people the opportunity of doing a concrete job with VO-DML and getting answers to any questions: 
      * How to build a model
      * How to reuse a model
      * How to annotate existing data
      * How to annotate dynamically generated data
      * How to parse annotated VOTables
   * Checking that the current VO-DML workflow fulfill the expectations of the community 
      * Gain in term of interoperability
      * Curtation and developement effort
      * Sustainability
Participants can bring their own models, VOTables or even code.

---++ Project Pitch

   * Gregory: Existing data from Wise, annotate with example data models.
   * Olga: annotating NED images. Extend metadata for Cubes. List of minimal requirements. (Need anybody with solid knowledge about cubes)
   * Mireille: vodml-ize CharDM
   * Tim: Interop of WCS and Transform between GWCS and . Need a plan! Ideally STC2
   * Pat: CAOM2 in VODML. Unit tests for models. Show you how to Continuous Integration.
   * Tom: Exploring VODML annotations for Vizier Catalogs. (Need Vizier experts).
   * Baptiste: STC2 with XML schemata for inclusion in VOEvent.
   * Carlos: SimDM in VODML.
   * Marco: how to build a model, from idea to VODML-XML.
   * Omar: Explore JSON Serialization, Requirements on Data Providers Tools. SVO Photometry Filter Service annotations.
   * Dave: Mapping tool, what I need to do to make it automatic
   * 
---++ Possible subjects

In no particulaar order

   * dealing with model imports in Modelio
   * Mapping STC2 to many VizieR or other catalogues
   * Compare different versions of STC2
   * Create new model from scratch using Modelio + xslt path way 
      * Data Model for Wise
   * Create models using DSL (?)
   * Porting existing models to VO-DML 
      * characterization (Mireille?)
      * Simulation DM (+ using mapping in SimDAL?)
      * provenance
   * generate XSD from VO-DML
   * end-to-end time series treatment
   * Java parser for mapped VOTables
   * additions to mapping spec 
      * SAMEINSTANCE for star-schemas
      * RemoteReference or ProxyInstance?
      * Time domain data grouped by rows (Gaia)
   * Registering data models , in particular let's register ivoa model (and vo-dml standard!)
   * End-to-End (simple) implementation of KDD interoperable workflow
   * VODML-annotated Filter Profile Service
   * Brainstorming about use of mediators creating ADQL queries for object queries, from annotated TAP_SCHEMAS
   * Create an SDSS/Stripe82 analogue of the HSC data and run it through OMar/Tom's notebooks.
   * Try the HSC annotations with Laurent's syntax proposal.
   * JSON serialization of instances.
<span style="background-color: #f6f6f6; color: #630000; font-size: 18.85px;">Documentation</span>
   * A basic [[https://volute.g-vo.org/svn/trunk/projects/dm/vo-dml/doc/VO-DMLModelingBeginnersGuide.pdf][VO-DML: Beginner's Guide]] has been written to assist data modelers get acquainted with the procedures involved with generating VO-DML compliant models.
   * A basic [[https://volute.g-vo.org/svn/trunk/projects/dm/vo-dml/doc/VO-DMLModelioImportGuide.pdf][VO-DML: Import Guide]] has been written to assist data modelers to get acquainted with the model imports in Modelio.
   * The VO_DML reference document can be found [[http://www.ivoa.net/documents/VODML/20180519/VO-DML-PR-v1.0.pdf][here]]
   * The draft of the mapping document can be found [[https://volute.g-vo.org/svn/trunk/projects/dm/vo-dml-mapping/doc/VO-DML_mapping_WD.pdf][here]]
---++ Tutorials
   * The [[https://volute.g-vo.org/svn/trunk/projects/dm/Tesselation/][Tesselation]] project proposes is guideline to start with VO-DML. This toy project has been used as support for 2 talks 
      * Shanghai 2017 [[http://wiki.ivoa.net/internal/IVOA/InterOpMay2017-DM/FromModelToVOTable.pdf][pdf]]
      * Santiago 2017 [[http://wiki.ivoa.net/internal/IVOA/InterOpOct2017DM/MappingProspect.pdf][pdf]]
   * Omar's [[https://olaurino.gitlab.io/ivoa-dm-examples/0000/01/02/STC-current.htm][tutorial]] on the space coordinates mapping.
---++ Material
   * Project Templates 
      * Templates for the 3 supported modelers (Modelio, Magic Draw and Altova) can be found [[https://volute.g-vo.org/svn/trunk/projects/dm/vo-dml/templates/][here]].
      * The _ivoa_ model for the basics VO-DML data types can be found [[https://volute.g-vo.org/svn/trunk/projects/dm/vo-dml/models/ivoa/vo-dml/][here]].
   * Models 
      * Some models are availble in [[https://volute.g-vo.org/svn/trunk/projects/dm/][Volute]]. The VO-DML mode representation can usally be found in the _vo-dml_ sub-folder.
      * Toy Models 
         * In the VO-DML [[https://volute.g-vo.org/svn/trunk/projects/dm/vo-dml/models/sample/sample/vo-dml/][project]]
         * Tessellation [[https://volute.g-vo.org/svn/trunk/projects/dm/Tesselation/vo-dml/][project]]
      * IVOA Model Pages: 
         * STC [[https://volute.g-vo.org/svn/trunk/projects/dm/STC/vo-dml/][model]].
         * CubeDM [[https://volute.g-vo.org/svn/trunk/projects/dm/Cube/vo-dml/][model]].
   * Annotated VOTable Sample: 
      * CubeDM [[https://volute.g-vo.org/svn/trunk/projects/dm/SourceDM/samples/][sample]]
      * Tesselation [[https://volute.g-vo.org/svn/trunk/projects/dm/Tesselation/vo-dml/mapping/][sample]]

   * <a target="_blank" href="https://olaurino.gitlab.io/ivoa-dm-examples/">Plenty of examples of STC, Cube, Time Series annotations</a>

---++ Tools
   * VO-DML model representation can be build in 3 different ways 
      * By hand
      * <a target="_blank" href="https://olaurino.gitlab.io/ivoa-dm-examples/0000/01/01/ReferenceImplementations.html"> By using a DLS</a>
      * By using a modeler in combination with a set of XSLT transformation scripts 
         * Modelio, Magic Draw and Altova are currently supported
   * Data can be annotated in 3 different ways 
      * By hand
      * <a target="_blank" href="https://olaurino.gitlab.io/ivoa-dm-examples/0000/01/01/ReferenceImplementations.html"> By using a DSL</a>
      * By a graphical Web application 
         * http://dsa012.pha.jhu.edu:8081/VODML-Mapper
         * if you want to save results, send a user name + MD5 encrypted password to glemson1 at jhu.edu
         * http://www.miraclesalad.com/webtools/md5.php)
         * will be presented during DM session
         * documentation being updated
<li> </li> <li> Available VO-DML parsers 
   * MAST portal (tbc)
   * <a target="_blank" href="https://olaurino.gitlab.io/ivoa-dm-examples/0000/01/01/ReferenceImplementations.html"> Python API</a>
</li> <li> Software you may have to use </li>
   * Python &gt; 3.6
   * Java 8
   * Modelio last release
-- IVOA.PatrickDowler - 2018-05-16

<!--
      * Set ALLOWTOPICRENAME = IVOA.TWikiAdminGroup
-->
This topic: IVOA > WebHome > IvoaEvents > InterOpMay2018 > InterOpMay2018VODML
Topic revision: r23 - 2018-06-01 - AdaNebot