UnitsDesc < IVOA

IVOA Web>IvoaDataModel>UnitsDesc (2011-12-16, SebastienDerriere) (raw view)

<H1>IVOA DM Work Package : Units description and usage</H1>
<br/>
 %RED% !!! Work in progress : !!! %ENDCOLOR%                

   * lead [[IVOA.AnitaRichards][Anita Richards]] 
   * units final VO standard to be achieved with the Semantic WG
---
---+++ Latest

[[DiscussionOnVOUnits]] : Discussion on specific aspects of the document 1.0.

[[%ATTACHURL%/WD-VOUnits-1.0-20111216.pdf][WD-VOUnits-1.0-20111216.pdf]] 2011 December 16 - first release of Version 1.0

[[%ATTACHURL%/WD-VOUnits-v0.3-20110508.pdf][WD-VOUnits-v0.3-20110508.pdf]] 2011 May 08 draft IVOA Note minor update 

[[%ATTACHURL%/WD-VOUnits-v0.2-20090522.pdf][WD-VOUnits-v0.2-20090522.pdf]] 2009 May 22 draft IVOA Note

[[%ATTACHURL%/UnitsMir2_10mar.html][2009 March Draft IVOA working draft]] 

ImplicationsForADQL 2009Mar18

---

OldUnitsPage

[[IVOA.IvoaDataModel][Main IvoaDataModel page]]
---

<H2>Goal </H2>
This workpage is meant to record the general practice in manipulating units for astronomical data and define a simple way to homogeneise their representation within VO services.



<H2> Existing Documents </H2>
   * Standards
      * [[http://vizier.u-strasbg.fr/doc/catstd-3.2.htx][Standards for Astronomical Catalogues, Version 2.0]]
      * Type `units' in many types of Linux
      * [[http://www.iau.org/Units.234.0.html][IAU Recommendations concerning Units from the IAU Style Manual by G.A. Wilkins (1989)]]
         * Symbols unsuitable for the IVOA as they  use Greek letters, diacritical marks etc. which are not easy to use in machine-readable documents; escaped versions could be error-prone. These are not in general used within data (as distinct from free text) anyway.
   * [[IAUVizieRHEASARCGNU][Comparison between IAU recommendations, <nop>VizieR</nop>, HEASARC and the GNU software Units]] from IVOA.SebastienDerriere
   * Existing VO usage
      * VOSpec model - described in [[http://arxiv.org/pdf/astro-ph/0511616][Dimensional Analysis applied to Spectrum Handling in VO context]] (Osuna & Salgado)
      * [[http://hea-www.cfa.harvard.edu/~arots/nvometa/STC/STCunits.txt][Unit strings allowed in STC]] from IVOA.ArnoldRots
   * CDS has a [[http://cdsweb.u-strasbg.fr/devcorner.gml][library for units manipulation]]. An [[http://vizier.u-strasbg.fr/cgi-bin/Unit][on-line tool to interpret units]] is also available (based on [[http://vizier.u-strasbg.fr/cgi-bin/Unit?%3f][recognized symbols]]). This library has beed used in tools like:
      * [[http://wiki.eurovotech.org/twiki/bin/view/VOTech/MEx][MEx, for FITS keyword mapping]]
      * [[http://wiki.eurovotech.org/twiki/bin/view/VOTech/DataExtractionTool][An homogenized data extraction tool]] (most suited for <nop>VizieR catalogues)
   * More:
      * [[http://www.mel.nist.gov/msid/sima/07_ndml.htm][NIST (National Institute of Standards & Technology) project UnitsXML]] from IVOA.MarieLiseDubernet 
      * *FITS* [[http://fits.gsfc.nasa.gov/fits_wcs.html][FITS references page]], [[http://fits.gsfc.nasa.gov/fits_draft.html][development]]. 
         * In the [[http://fits.gsfc.nasa.gov/fits_standard.html][new FITS standard]], look at section 4.3 of the [[http://fits.gsfc.nasa.gov/standard30/fits_standard30.pdf][v3.0 PDF file]] (pp.31-36 in the PDF, numbered pp.24-28 in the document)
         * Section 4 in Greisen and Calabretta 2002, A&A 395, 1061 - see [[http://heasarc.gsfc.nasa.gov/docs/heasarc/ofwg/docs/general/ogip_93_001/ogip_93_001.html][Specification of Physical Units within OGIP FITS files]] (not only relevant to FITS)
      * On-line unit conversion:
         * [[http://www.starlink.ac.uk/~dsb/ast/unitmap-form.html][AST Unit Mapper]]
         * [[http://vizier.u-strasbg.fr/cgi-bin/Unit][VizieR units]]


<H2>Recommendations</H2>

As discussed at IVOA, Trieste, May 2008   

   * Goal: to provide suitable tools - Backus Naur form?, libraries and references to allow 
      * Recognition of units in use by the members of IVOA
      * Simple (mostly linear) conversions such as metres/parsec; use of SI prefixes (k,M,G eetc.) to avoid bulky numbers or damaged precision.  
   * Whatever is adopted should as far as possible be compatible with existing VO implimentatations and FITS, and should cover all the relevant IAU types of unit (as distinct from the unsuitable symbols). 
      * *Please nominate whichever you consider to be the most complete existing system*
     The IVOA should provide translation where there are unambiguous variations in other systems, including from FITS keywords (making use of existing tools/libraries where possible).
   * *Please identify any serious ambiguities* e.g. k could be kilo- or Boltzmann's constant, and suggestions for how to overcome this (recognise by context? Flag for human intervention?).
   * Produce web page of links to existing tools for unit handling, conversion, dimensional analysis etc.
      * Example from CDS pages: [[http://cdsweb.u-strasbg.fr/devcorner.gml][see Unit conversion link]] - but in a form which can be linked to user programs or packages in C, IDL, python etc. with simple instructions
   * Educate next generation of data providers to use _some_ standard for units!
   * Need to record date and reference to values of fundamental quantities where available.
   * *How far can we go with dimensional analysis?* Are there so few cases where it breaks down that these can be handled individually, and if so how does code recognise them (e.g. the Hubble constant, in km/s per Mpc) - or can we specify limited situations where dimensional analysis is adequate?

<H2>Use cases </H2>
   1. TAP - source catalogue DM - need to compare quantities _please elaborate_
   2. SPECFIND : A tool to extract cross-identifications and radio continuum spectra from radio catalogues contained in the VIZIER database of the CDS. <BR> Reference:   SPECFIND Catalog of radio continuum spectra <BR> Authors:     Vollmer, B.; Davoust, E.; Dubois, P.; Genova, F.; Ochsenbein, F.; van Driel, W. <BR> Publication: <nop>VizieR On-line Data Catalog: VIII/74. <BR> _please elaborate_ - is this a requirequirement for conversion between physical flux units e.g. mJy, Jy, W m-2 Hz-1 - what about Jy beam-1 (if you are lucky the beam size is given conveniently...?
   3. Cone, S?AP, registry searches
      * The current IVOA standards mandate units, but this leads to frequent problems due to to a Cone search/SIAP service returning a region in different units from the one the user thinks they are using (e.g. 0.1 arcmin instead of degree) (see DB queries below).
   4. Database queries: We have no control over the units used by data providers (?).  We do need to be able to recognise them.
      * Example inspired by Jeff Lusted: What can ADQL do about units for synthetic columns? E.g. <pre>SELECT a.fint/(a.maj*a."min") <br/> as fluxdensity from firstSource as a</pre> where fint has units of mJy and maj and min have units of arcsec so fluxdensity has units of mJy arcsec-2
      * More complicated cases:  
         * In the above case, strictly speaking the divisor should be <tt>(a.maj*a.min/4*ln2)</tt>
         * <pre>SELECT 365.25*a.dist_opt/(a.jdate-2450975.0) <br/> as propermotion FROM twomass_psc as a</pre> where the inputs have units of arcsec and Julian Days (implicit for 2450975.0) but the user wants output in arcsec per year ...
   5. Enabling convenient image display with axes labeled in user-specified units/sensible SI multiples.
   6. Complex conversions e.g. magnitudes to physical units, are outside our scope but well-defined physical units should make that workpackage easier. 
      * Flux unit conversions e.g.  VOSpec, tools using the STILTS library
      * Coordinate conversions (B1950 RA-Dec to J2000 glat-glon etc.)  e.g. tools using the STILTS library, SIMBAD services etc.
      * Conversion between wavelength and frequency/energy units is non-linear (even without observational issues).  Whilst this is trivial (and rounding errors are unimportant) for single simple regions, it makes it hard to describe a spectral resolution of 1 MHz between 1 and 30 GHz, with a single number in wavlength units.

<H2>Interactions with other WG efforts</H2>
   * [[IvoaVOQL][IVOA VO Query Language]] 

---IVOA.AnitaRichards - 16 Jun 2008

[[UnitsMir_fichiers][UnitsMir_fichiers]]

<!--
      * Set ALLOWTOPICRENAME = IVOA.TWikiAdminGroup
-->

Attachments

Topic attachments
I	Attachment	History	Action	Size	Date	Who	Comment
txt	STCunits.txt	r1	manage	5.9 K	2007-10-05 - 16:52	ArnoldRots	Unit strings allowed in STC
pdf	WD-VOUnits-1.0-20111216.pdf	r1	manage	526.2 K	2011-12-16 - 23:15	SebastienDerriere	VOUnits WD 1.0 2011-12-16
pdf	WD-VOUnits-v0.3-20110508.pdf	r3 r2 r1	manage	385.6 K	2011-05-09 - 08:17	MireilleLouys	WD after interop May 2009/ minor update
txt	minutes_units_discussion_070927.txt	r1	manage	1.3 K	2007-10-01 - 06:21	AlbertoMicol	Minutes of initial discussion: Cambridge, 20070927

Topic revision: r41 - 2011-12-16 - SebastienDerriere

IVOA

Log in or Register

IVOA.net
Wiki Home
WebChanges
WebTopicList
WebStatistics

Twiki Meta & Help
IVOA
Know
Main
Sandbox
TWiki

TWiki intro
TWiki tutorial
User registration
Notify me

Working Groups

Interest Groups

Time Domain

Committees

Stds&Procs

www.ivoa.net
Documents
Events
Members
XML Schema