MANGO-1_0 < IVOA

IVOA Web>IvoaDataModel>MANGO-1_0 (2025-02-20, LaurentMichel) (raw view)
---+ MANGO version 1.0

%TOC{depth="3"}%

---++ Overview

There is a paradox in the VO world: source data which represent the basic building blocks of astronomers’ work, is not modelled. This paradox can be explained by the fact that the observation of source objects is multifaceted.<br />In a general way, the way features for source data are described and organised depends on the targeted science case. Principal investigators and archive designers set up the data profile and structure it according to this goal which varies from one project to another. Therefore this diversity cannot be served by a single static data model describing a source item for all possible cases. <br />Having a global source model would lead to a very complex solution not usable in practice.<br />This standard proposes to overcome this paradox and presents a template model gathering independent components from VO existing models embedded on demand in a container. MANGO is not designed to describe what a source is but to help clients to discover and to understand the quantities available for a particular source instance.

VOtable data mapped on MANGO with Mivot annotations can be consumed quantity par quantity instead of column per column. The way complex quantities are built is described by MANGO but no longer by the clients.

The main purpose of MANGO is to add an upper description level to the tabular data of query responses. MANGO is not designed to replace the meta-data already present in query responses,<br />Uses-cases have been collected since 2019 from representatives of various astronomical missions, archive designers and tools developers. These open contributions gave a good picture of the needs but we do not pretend that everything will be supported by this first version.<br /><br />
---++ Participants

Laurent Michel, François Bonnarel, Gilles Landais,Jesus Salgado, Mireille Louys and Marco Molinaro and all the people having tested the model or reviewed related code.
---++ Uses cases

The main purpose of MANGO is to add an upper description level to the tabular data of query responses. MANGO is not designed to replace the meta-data already present in query responses.<br />Uses-cases have been collected since 2019 from representatives of various astronomical missions, archive designers and tools developers. The contribution was totally open.
   * Gaia, Euclid, exoplanets, Morphologically Complex Structures, Chandra (or XMM), Vizier, client developers, XMatch tools

This gave a good picture of the needs but we do not pretend that everything will be supported by this first version.
---++ Requirements

From the list of use-cases, we have identified 4 domains for which the model should provide added value:
   1 support of the most popular quantities
   1 data description enhancement
   1 description of quantities consisting of several columns
   1 connected quantities.
---++ Documentation and Implementation
---+++ Repository
   * The project is hosted by [[https://github.com/ivoa-std/MANGO][GitHub]] as a regular _ivoa-std_ project
   * The working draft [[https://github.com/ivoa-std/MANGO/releases][PDF]] is regularly udpdated
   * The descriptions of the model elements are stored in individual files located in _PROJECT_HOME/vo-dml/desc_. <br />This allows for an easy update. It also delegates the latex escape character handling to the builder tool.
   * The document is built by the _PROJECT_HOME/utils/buildDoc.bash_ script:
      * Insert the description of all model elements in<i> mango.vo-dml.xml</i> and store the result in __desc.mango.vo-dml.xml__ which is the *model reference file.*
      * Escape some characters to please to latex
      * Build the _PROJECT_HOME/doc/model.tex_ file which contains the Latex of the model description (section 4). <br />This step is achieved by the XSLT developed by M. Cresitello Dittmar.
      * Update the publication date
      * Build the pdf with the _ivoatex_ tools
   * The <i>PROJECT_HOME/mivot </i>folder contains MIVOT snippets for the main classes. <br />This allows contributors to figure out what the MIVOT annotation for MANGO could look like.<br />These snippets have been generated with the _mivot-validator_ package (available on pip)
<b>%RED%Contributor Watchout: %ENDCOLOR%</b>%RED%If you want to open a PR, please *do not edit _PROJECT_HOME/doc/model.tex_* but the snippet files in __PROJECT_HOME/vo-dml/desc__ and then run __PROJECT_HOME/utils/buildDoc.bash__. %ENDCOLOR%
---+++ Epoch Propagation

Mango has been developed along with [[https://ivoa.net/documents/MIVOT/20230620/index.html][MIVOT]] with a particular focus on the EPOCH propagation.
   * Vizier deployed a cone search service that returns VOtable partially mapped on MANGO: https://cdsarc.cds.unistra.fr/beta/viz-bin/mivotconesearch/TABLE_ID<br />Try *curl "https://cdsarc.cds.unistra.fr/beta/viz-bin/mivotconesearch/I/329/urat1?RA=52.26708&DEC=59.94027&SR=0.05"* <br />This dataset can be processed by [[https://github.com/astropy/pyvo][PyVO]] ( [[https://pyvo.readthedocs.io/en/latest/mivot/index.html][readthedoc]])
   * A Gaia VOTable completly mapped on the epoch propagation class of MANGO (_mango:EpochPosition_) can bee seen on<br /> [[https://github.com/ivoa/dm-usecases/blob/main/pyvo-ci-sample/gaia_epoch_propagation_flat_full.xml][GitHub]]
---+++ HE data and Photometry

A TAP service serving XMM catalogue (https://xcatdb.unistra.fr/xtapdb/) data (table _mergedentry_) has been deployed.

This service demonstrates the ability of MANGO to properly describe the following quantities
   * Coordinate systems (space, time imported from Coords DM)
   * Position at a given epoch
   * Photometric filters and calibration (imported from Phot DM)
   * Fluxes and hardness ratio
   * Quality flags
It can be connected with [[https://saada.unistra.fr/taphandle?url=https%3A//xcatdb.unistra.fr/xtapdb/][Taphandle]] or by using curl:

<b>curl "https://xcatdb.unistra.fr/xtapdb/sync?LANG=ADQL&REQUEST=doQuery&QUERY=SELECT%20%20TOP%201%20%20%2A%20FROM%20%22public%22.mergedentry&FORMAT=application%2Fmango"</b><br /><br />

If you want to connect this service from another client, you must specify _FORMAT=application/mango_ to get annotated data (this format will be changed soon).
---++ Discussion Topics

*Git Issues*

<br />
<!--
      * Set ALLOWTOPICRENAME = IVOA.TWikiAdminGroup
-->
Topic revision: r8 - 2025-02-20 - LaurentMichel
IVOA
Log in or Register
IVOA.net
Wiki Home
WebChanges
WebTopicList
WebStatistics
Twiki Meta & Help
IVOA
Know
Main
Sandbox
TWiki
TWiki intro
TWiki tutorial
User registration
Notify me
Working Groups
Interest Groups
Time Domain
Committees
Stds&Procs
www.ivoa.net
Documents
Events
Members
XML Schema