Protocol Transitioning Tiger Team (P3T)

The Protocol Transitioning Tiger Team was formed in Tucson at the Interop meeting in Nov 2023. The aim is to address the question of compatibility of the DAL protocols (and by implication protocols such as UWS) with modern web development tools. A number of people volunteered to form a tiger team to work on this.

The recommendations being examined would mostly be in DAL and GWS (e.g., TAP, SIA2, SODA, UWS) so will need to be a cross WG effort. A question to answer is : How do we adapt the protocol interactions to be compatible with tools such as OpenAPI.

Membership - email alias "P3T"

• James Dempsey - james.dempsey@csiro.au - Lead (DAL Ch) - P3T Lead
• Dave Morris - dave@metagrid.co.uk
• Kim Gillies - kgillies@tmt.org (If we are volunteering to help with creating service APIs in OPENAPI, I would participate)
• Gregory Dubois Feldman - gpdf@ipac.caltech.edu
• Grégory Mantelet - gregory.mantelet@astro.unistra.fr (DAL V Ch)
• Janet Evans - janet@cfa.harvard.edu
• Jesus Salgado - jesus.salgado@skao.int (GWS Ch)
• Joshua Fraustro - jfraustro@stsci.edu (sharing pydantic/pydantic-xml models)
• Marco Molinaro - marco.molinaro@inaf.it
• Rick Ebert - rick.ebert@caltech.edu (NED) anything that helps to standardize datamodel/semantics
• Paul Harrison - paul.harrison@manchester.ac.uk
• Sara Bertocco - sara.bertocco@inaf.it (GWS V Ch)
• Theresa Dower - dower@stsci.edu (work on open sourcing the pydantic model code in recent MAST TAP services.)
• Tom Donaldson - tdonaldson@stsci.edu
• Adrian Damian - adrian.damian@nrc-cnrc.gc.ca
• Brian Major - brian.major@nrc-cnrc.gc.ca
• Russ Alberry - eagle@eyrie.org

Initial Plan forward

• Setup a wiki & mail list
• Meet over 4 months ... Jan - April (once a month)
• Plan to meet in Sydney 2 days (Thu/Fri, May 16/17) prior to IVOA that starts on Sunday (discussed with Simon/he can do it)
• May Interop : May 20-24; TCG mtg: May 19

Standards Involved (1st up!)

• CS
• UWS
• TAP
• VOSpace

OpenAPI Project Links (add yours)

• https://github.com/spacetelescope/vo-openapi - UWS OpenAPI spec (WIP)
• https://github.com/spacetelescope/vo-models - Pydantic python models
• https://github.com/pahjbo/DataModelPlayground/tree/interface_models - defining the data models in VO-DML with automatic java and python code generation.

Related GitHub issues (add yours)

• new xtype="json"
• Include YAML as well as JSON
• Update VOTable to preserve spaces
• Update VOTable to handle UTF-8

Meetings

1. 22 Jan - yopad shared notes - IVOA_22Jan_PTTT.pdf
2. 26 Feb 2024 at 20:00 UTC - yopad shared notes (will expire April 2024) - PDF TBA

References

• OpenAPIs - https://www.openapis.org
• Frossie's talk at Bologna in GWS2 - https://wiki.ivoa.net/twiki/bin/view/IVOA/InterOpMay2023GWS
• Joshua's talk in Bologna in DAL: https://wiki.ivoa.net/internal/IVOA/InterOpMay2023DAL/mast-tapservice-fraustro.pdf
• Simbad ConeSearch service I presented in Bologna: https://simbad.cds.unistra.fr/cone/help/
• Notes of the DAL sessions with volunteer list for the Tiger Team at the end of the doc: https://wiki.ivoa.net/internal/IVOA/InterOpNov2023DAL/DAL_1.pdf

From Tucson DAL session YoPAD

• Modernisation of protocols - improve compatability with modern web dev tools
  GDF: Still very interested in modern definition of protocols/APIs (e..g JSON/ OpenAPI) to assist service implementors to use modern tools. High priority for Rubin
  FB: How would that look like
  GDF: Way more services than clients - clients have resources to stay up to date - would need to update clients to support new services while supporting old services. New services would be json based
  GDF: Suggest a tiger team as no one service can do this alone
  GM: Have used microsservices with json to send votable in the new SIMBAD's ConeSearch service
  GDF: About service interaction not votable format change - so how UWS works. Really hard to implement UWS in contemporary
  JD: Is OpenAPI a useful step?
  Tim: Is there support for json? Yes, then presumably some would be intersted in volunteering.
  RE: NED already has json behind the scenes and easier to convert json
  DM: Suggest updating standards as defining the data model and then have an examples of the json implementation as well as XML. Don't want to be talking in 10 years about how to convert away from json!
  Joshua Fraustro: MAST has a model of the UWS interactions - need management approval to make them open source and share.
  Tim: Use Pydantic and FastAPI too - very happy with them