SimDALRFC < IVOA

---++ SimDAL 1.0 Proposed Recommendation: Request for Comments

Public discussion page for the IVOA !SimDAL 1.0 Proposed Recommendation.

The latest version of the SimDAL Specification can be found at:
   * [[http://www.ivoa.net/documents/SimDAL/index.html][http://www.ivoa.net/documents/SimDAL/index.html]]

---+++ Reference Interoperable Implementations
   * [[https://app.ism.obspm.fr/simdal-client/][SimDAL Reference Implementations]]

---++ Comments from the IVOA Community and TCG members during RFC period: 2016-07-08 - 2016-08-22
---+++ Comments from Enrique Solano
<h3>
   * <span style="font-weight: normal; color: #000000; font-size: small; line-height: normal; background-color: transparent;"> _"First SimDAL Repositories store codes and theoretical projects descriptions. They can be used by clients to discover theoretical services"_ </span> 
      * <span style="color: #000000; font-size: x-small;"><span style="font-weight: normal; line-height: normal;">As it is written now, it seems to me that SimDAL Repositories are the only way to discover theoretical services. This is not true that, at least the "simdal search" services can also be found using the Registries. This should be clarified.</span></span>
</h3>

_Anwser: This has been clarified. The text now mentions the components can be found in SimDAL repositories and registries_
<h3><span style="color: #000000; font-size: x-small;"><span style="font-weight: normal; line-height: normal;"> </span></span>

   * <span style="color: #000000; font-size: small; font-weight: normal; line-height: normal; background-color: transparent;">"Finally, SimDAL Data Access services are dedicated to retrieve raw data."</span> 
      * <span style="color: #000000; font-size: small; font-weight: normal; line-height: normal; background-color: transparent;">Only raw data? This is not true. I would remove "raw" from the sentence.</span>
</h3>

_Anwser: Indeed. This has been corrected_
<h3><span style="color: #000000; font-size: x-small;"><span style="font-weight: normal; line-height: normal;"> </span></span>

   * <span style="color: #000000; font-size: x-small;"><span style="font-weight: normal; line-height: normal;">The inclusion of an Appendix describing some implementations and showing how these services work in real life would be more than desirable. This was done with SSAP and it was very useful.</span></span>
</h3>

_Anwser: This would be useful. An implementation note was written for the Simulation Data Model. It presents how to map the DM on different kind of simulations. We plan to do the same for SimDAL. Once the standard will be accepeted, it is planned to write an Implementation Note that will present how to use SimDAL to publish different categories of simulations / numerical models._
<h3>

   * <span style="color: #000000; font-size: x-small;"><span style="font-weight: normal; line-height: normal;">A typo: In the Introduction, the sentence "It is a fine grain registry for numerical codes and simulations in the Virtual Observatory" is repeated twice</span></span>
</h3>

_Anwser: Thank you. This has been corrected_

<em><br /></em>
---+++ Comments from Mark Taylor

I don't have a strong interest in !SimDAL, and I have not thoroughly reviewed this draft, but I read it and have some comments.

   * This document departs from usual VO procedures in various ways, apparently reinventing the capabilities of TAP and the Registry for its own purposes. There is a rationale provided in Appendix B for avoiding use of TAP, which I'm not sure I find convincing, but I haven't gone into the requirements of simulation data access carefully enough to want to comment further on that.
_Anwser:_

_The notion of views may present similarities with TAP/TAP schemas. TAP has not been chosen as a solution because it does not fulfill the requirements for Theory. Theoretical services will publish very different kind of numerical models and simulations (N-body / SPH / MHD simulations, asterosismology models, radiative transfer codes, astrochemistry models, ...). Some of these theoretical results have a lot of properties characterizing simulated objects (&gt; 100 000 in one the SimDAL implementation). These numbers are growing due to the progresses in numerical models. <br /><br />We would need to have the properties as table columns in a table in a relational database, which is simply not possible for the majority of the rdbms currently in use (which we would have to use if we would like to use TAP, since TAP is strongly SQL, and so relational, coupled). Storing such data in TAP-way in RDBMS would require to have the properties as table columns in a table but it is not possible to manage high dimension data (i.e. table columns) for the majority of the RDMS currently in use (Postgress, MySQL). High dimension data and their use is much more properly served by other type of storage architectures. That publishers cannot (or would have great difficulty - i.e nonsense - to) use with TAP when they do not have SQL compatibility/adapter.<br /><br />Note that if the definition of SimDAL has been so long, that is because many technological solutions have been tested (and implemented) before reaching the present proposition. Among them TAP has been tested on various data management systems / storage architecture. The conclusion of this implementation is that TAP is not an option. The views solution adopted in SimDAL has two benefits<br />1 - it decouples the standard VO interface of the technology to store the data (so a publisher can choose the technology he preferes depending on the particularities of his data)<br />2 - it is as similar as possible to TAP (virtual table + view schema) so that publishers already familiar with the VO should not be lost.<br /><br />Concerning the SimDAL Repository part: <br />First, note that SimDAL components (and among them the SimDAL Repositories) are registered in the IVAO registries. <br />To the difference of the registries, SimDAL Repositories describe resources (protocols /codes, projects, etc.) with the semantics defined in the Simulation DataModel So it is only with SimDAL Repositories that a search for resources can be done using the SimDM semantics. Moreover, SimDAL Repositories are places where the SimDM XML serializations of projects and protocols (codes) are stored. These serializations are the descriptions <br />of theoretical projects and codes that are published in the VO. IVOA registries do not have functionalities to store and query such serializations whereas SimDAL Repositories do. <br />Discussions with Markus (for the Registry W.G.) showed that some parts of these serializations could be transformed and ingested in the IVOA registries. Nevertheless, this would be done loosing the relationships between SimDM classes, and so loosing the hierarchy of the model and a part of the SimDM semantics.<br />Presently, the SimDAL Repository search API does not allow to fully benefit of the SimDM XML serializations despite most scientific use cases would require fine grain search in these SimDM serializations to discover efficiently protocols and projects of interest. This has been a choice for the version 1.0 of SimDAL. Indeed, in the coming months / years we do not expect to have a lot of registered IVOA theory services and so, it should be easy for users to discover theoretical services with the SimDAL Repositories as presently defined. Nevertheless, when more and more theoretical services will be registered finer grain search will be necessary. SimDAL Repositories as defined in version 1.0, storing the full XML serializations of projects and protocols, contain all the informations and the standardized relationships between these informations to answer these use cases. It will then be time to extend the capabilities of its Search API._

   * Section 1.1: Only a specimen IVOA architecture diagram is included, a real one should be used. In view of the unusual content of this standard as I dicussed above, there should be some more detailed discussion here of which IVOA standards this document uses, which ones it avoids in favour of its own ways of doing similar things, and why.
_Answer: Indeed. The diagram has been replaced. If a diagram with all the standards is required, it will be introduced in the corrected version of the document._

   * Section 3.2: The use of VOTable to encode errors here says it follows !DALI, but in fact it looks different from the usual way that !DALI-compliant services do it. The specification in this document encodes errors as a sequence of multiple (error_msg,error_code) pairs as rows within a TABLE, while !DALI encodes an error as a single INFO element outside the TABLE element. I suspect this is a misunderstanding of !DALI intention, but maybe it's deliberate because of the need to report sequences of errors rather than single ones. It should either be changed to match standard !DALI practice, or if not it should be clear from the text that this is not !DALI standard.
_Answer: Thank you. That has been corrected._

   * Section 4.2: _"The response schema of the results table is (FIELD IDs):"_ but the following table has FIELDs with =name= attributes as listed rather than =ID= attributes. <span style="background-color: transparent;">Some of the VOTable samples use lower-case element names, which is not permitted in VOTable.</span>
_Answer: Thank you. Also corrected._

   * There are reference implemenations listed, which is good. However, I don't see any validators. I played around a bit with the implementations (not really understanding how to drive it properly); quite a few links in the obspm implementation lead to error pages. Validation tools should be provided by this stage of the review process, and ought to help in identifying missing/broken functionality like that I currently see in the obspm implementation.
<em> Answer: <span style="background-color: transparent;">At the InterOp of Sesto, in May 2015, when the procedure to finalize SimDAL has been launched, Severin Gaudet (as chair of the TCG) asked for a validator but said that a client compatible with the reference implementations is a validator. </span><span style="background-color: transparent;">So, a client instead of a simple validator as been developed. It is compatible with the two reference implementations.</span></em>

_We tested the client (https://app.ism.obspm.fr/simdal-client/) and it seems to work properly. <br />A few comments on its use:<br />1 - To search for simulation, follow the order in the top menu: Search in the Repository, then do a SimDAL Search, and finally search in Access data. Each step provide the URIs for the next one.<br />2 - In the repository search, first select a SimDAL Repository before doing a {search} or ask for the list of {projects}. <br />3 - At each step, after a search, the system provides the URI of the services. These URIs have to be copy-paste in the next step._

-- IVOA.MarkTaylor - 2016-07-14

Answers: --IVOA.FranckLePetit and IVAO.DavidLanguignon - 2016-08-09

---+++ Comments from Markus Demleitner

(This is still against the 2016-06-08 version; I already had the review written at the time the new draft came out. Sorry about that, but I believe most of the material is still pertinent)

Let me start with the very general remark that I believe this standard tries to do too much. I think it should be three different standards at least. When reading it, I kept having the creepy feeling that far too many details are left open, more or less by necessity because there's so much to specify. You're defining more than a dozen endpoints and quite a few VOTable hacks on 50 pages; perhaps tight integration, solid SimDM foundation and specialisation on particular use cases actually let you do that, but I'm concerned that all kinds of little issues will come up when different implementations try to interoperate. Is there a client that would exercise even half of the features described in the document? In your experimental implementations, was underspecification an issue?

In particular, I'm a bit concerned about the proliferation of end points. you're defining about about as many end point types as the entire rest of the VO combined. Perhaps that's ok, in particular because by and large your interfaces appear fairly "small" and tidy compared to some other things we've produced in the VO, but it's at least somewhat of a liability for writing validators, and I suspect for implementations, too. Since quite a few of the interfaces are essentially just searches in (perhaps virtual) XML documents: have you investigated whether you could reduce the number of interfaces required by re-using, say, xpath or xquery or whatever?

In short, I believe you should split up this document into three pieces, each of which would work out to be more handleable.

<div id="_mcePaste"> _Answer:_ _Yes we have several API endpoints. Off course we tried our best to make this number as small as possible while satisfying as many use cases as possible._ </div>

<em><br /></em>
<div id="_mcePaste"> _That is a big standard, that is why it was so hard and long to have a first version of it released. The other VO (DAL) standards are basically serving a single, fixed, underlying data model. As you know SimDM, that SimDAL is serving, is a meta model, i.e we are serving an infinity of underlying data models. This bring some additional use cases that we had to address by adding a complete API._ </div>

<em><br /></em>
<div id="_mcePaste"> _Several very smart guys addressed the SimDAL problem in the past years, and a lot of advance has been made thanks to them, yet being still not 100% perfect. The fact is a lot of people are waiting for years to have a way to publish their theoretical data and we think we have to give them a solution now._ </div> <div id="_mcePaste"> _We need a basis, SimDAL v1, that will be implemented by several teams, will fulfill_ _the most common use cases (80 %) and this on real data in production environment (not theoretical/potential use cases/issues). Then, we hope these teams will collaborate with the IVOA to provide feedbacks for a v2 version that will add some features not planned at_ _in the first version._ </div>

_As for xpath, we made SimDAL partly because we realized understanding/querying SimDM is a too high prerequisite for a scientist/developer and that we had to design an as straightforward as possible query API, even if it comes with the price of not dealing with 100% use cases for now._

_We have not split SimDAL because, for the first version of the standard, we do not want to break the workflow logic that carries the user from theoretical project discovery to data retrieval, with the price of the developper having to deal with a bigger standard. Instead we tried to be clear in the document so the reader understand he does not have to implement the three parts. For next version of the standard, once several teams will be familiar with it, the splitting of the document in several more specific standards can be discussed._

Individual issues:

   * I couldn't find the document source, so I couldn't fix a number of typos and editorial glitches (e.g., "SimDAL as then" -&gt; "SimDAL and the", two instances of "It is a fine grain registry for numerical codes and simulations in the Virtual Observatory" in the Introduction, "fine grain" -&gt; "fine-grained" throughout). If you tell me where the source is, I'd volunteer for another round of proofreading.
<em>Answer: Thank you to propose to help for the proofreading ! <span style="background-color: transparent;">The Latex file can be downloaded under the src link on the SimDAL webpage: </span><span style="background-color: transparent;">http://www.ivoa.net/documents/SimDAL/index.html</span></em>

<em><span style="background-color: transparent;"><br /></span></em>
   * sect. 2.1 ends with a pointer to use cases in Appendix A. The text continues with "use cases" in 2.2. It would help the comprehension of the document if the reason for this distribution of use cases were made clear (actually, I think 2.2 could be re-formulated a bit so they actually become requirements rather than use cases).
_Answer: Done. Section 2.2. no more mention use cases but requirements._

   * I think the document would profit from a bit of de-duplication (e.g., the affirmation that "only a few data centers" would implement a repository is made at least twice; the different URI forms for-id/3 vs. views?id=3).
_Answer: We simplified as much as possible._

   * Starting p. 8, there are references to "UML classes". I don't think the "UML" should be there. Perhaps just "classes" is enough, or one needs a different terminology. That (initial) modelling has been done in UML is, I think, of no import for this specification, and indeed I would hope that future versions of SimDM will come in VO-DML.
_Answer: You are perfectly right. That is corrected._

   * On p. 8, there's "ex star, cloud, halo" -- I'd much rather see "e.g.," than "ex"; in general, I think it would be better if the term "object" could be avoided here (if it indeed refers to "astronomical object"). Does SimDM perhaps already offer precise terms for what's meant here?
_Answer: Ok. We clarified this._

   * On p. 9, the "pivot format" (incidentally, I'm not sure I understand why it is called "pivot" -- perhaps a brief explanation could help?) is defined as consisting of several files which are given as what looks like file names. It is not clear to me whether these file names are part of the standard, and if so, how multiple experiment files are to be stored under one name. If, as I suppose, these are generic identifiers for "sub-formats", I think you shouldn't use file name-like names for these but instead use more format-like names for them. But perhaps all that should rather be part of SimDM.
_Answer: That is corrected_

<em><br /></em>
   * On p. 10, I think "with a list of couple (error messages, error code)" should be "containing rows consisting of a string-valued column error_msg and an integer-valued column error_code." or so. Also, DALI says. "The content of the INFO element conveying the status should be a message suitable for display to the user describing the status." Of course, this cannot convey multiple error messages, but for improved compatiblitiy with DALI I think you should keep the INFO text as something immediately displayable to a user. Also: Does the table in the error case have a name results as well or does it not? If it does, then perhaps the text currently in the paragraph "Result" on p. 11 should be an introductory paragraph to 3.2?
_Answer: You are right, thank you, we have made the update in the document._

   * In 3.3, you define the "links" table; this is pretty much a stripped-down datalink table -- why do you not simply use datalink itself? It would have the advantage that client authors might already have code to parse and display datalink tables, and they'll curse you if they have to unnecessarily write some glue code just to shoehorn your table into their datalink data structures. Getting your SimDAL-specific terms into the Datalink vocabulary should not be a big deal.
<em>Answer: Datalink would have made the standard heavyier whereas we just need a tiny subset of <span style="background-color: transparent;">datalink: the subset that was Datalink when we were involved in its definition </span><span style="background-color: transparent;">back in 2012 when F.Bonnarel started thinking about it. </span><span style="background-color: transparent;">That is something we have in mind for a future version of the standard.</span></em>

   * I have a heartfelt dislike for your "foreign-key" GROUP in 3.3. My preference would be to just fix the column name(s) in results and links and be done with it. If, on the other hand, you want to establish a general mechanism for declaring foreign key relationships, don't do it here, do it in VOTable or in the VO-DML mapping document. We should do this properly; if every standard starts to ad-hoc this kind of annotation, VOTable will become an unimplementable, contradictory mess.
<em>Answer: The foreign-key mechanisms is used in VOTable responses, and is directly taken from the VOTable 1.3 document. <span style="background-color: transparent;">It is a neat and tidy way to link our tables while letting some extensibiity. </span><span style="background-color: transparent;">We define it in the document because it is not formally defined in the VOTable document, just mentionned as some kind of example/possible use of the GROUP element.</span></em>

   * In general, after reading 3.3, I'd not be sure what I'm supposed to return in results. ident, yes. created? MUST? SHOULD? Just as an example? And as a client, what am I supposed to do with the results table? Just display it as an opaque table? You have a couple of words on "general" return fields quite a bit later; perhaps the document would profit if you pulled that part up a bit or at least referenced that from here.
<em>Answer: <span style="background-color: transparent;">These fields are defined in each API endpoints, see for example the result table in {search}, subsection response schema. All FIELDs are described and those that are not mandatory are explicitly declared as optional.</span></em>

<span style="background-color: transparent;"><br /></span>
   * In 3.4, I think you should give some explicit guidance as to what to say when a next_page/previous_page link has expired, be it because the query result was cached somewhere, be it because the underlying result has changed. In that same vein, you might consider recommending that services communicate an (estimated) validity span of the pagination link (see, e.g., OAI-PMH for how they did that).
<em>Answer: <span style="background-color: transparent;">Ok, we have not precised anything because our idea is "do not bother with the lifetime of the pagination, we take care of it for you so that it's longlife enough for you to do interactive browsing in your current session". </span><span style="background-color: transparent;">This has been precised (section 3.6). </span></em>

   * Still in 3.4, I'd say there's not enough value in letting clients specify the page size to justify the complication in implementation. Let the service decide on the page size and trust that it's not so large as to overwhelm the client. Pagination is hard enough to get actually (!) right even without extra tricks.
<em>Answer: <span style="background-color: transparent;">We thought the same while writing/implementing the standard but decided it would be of some use to users to be consistent with the majority of existing api. But after some more thinking recently we agree with you to simply remove this to make the standard more straightforward to use.</span></em>

<span style="background-color: transparent;"><br /></span>
   * In 3.7, you currently say "eventually followed by a decimal point and fractions of seconds"; I think you intend this to be "optionally followed", right? If not, I'd be severely concerned. In this context I think you should allow an optional "Z" at the end for compliance with other timestamp formats in the VO (ideally, just reference DALI 1.1 here).
<em>Answer: <span style="background-color: transparent;">Indeed we meant Optionaly. This has been precised.</span></em>

<span style="background-color: transparent;"><br /></span>
   * In 4.1, you are claiming {search} were "search for concepts" -- as far as I can make out, this is just a full-text search. If so, I'd say just say so: "perform full-text searches".
<em>Answer: <span style="background-color: transparent;">Done</span></em>

<span style="background-color: transparent;"><br /></span>
   * In 4.1, I guess I'd rather start with "formal" definition of the query parameters and then go on with all the explanation. I was a bit confused about the talk about q and att. (And I'd then remove the "Note" about att, too, as it only repeats what's (now) later said under "Parameter".
<em>Answer: <span style="background-color: transparent;">Ok. We modified the presentation of the section. </span></em>

<span style="background-color: transparent;"><br /></span>
   * In 4.1, you say that without a document schema "it is up to the client to understand what the attributes are and what they mean." I think that's misleading. The client simply has no way to figure out what attributes there are, no? Wouldn't "the metadata schema has to be communicated by non-standard means" or something like that be more appropriate?
<em>Answer: <span style="background-color: transparent;">Indeed. Ok. </span></em>

<span style="background-color: transparent;"><br /></span>
   * In 4.1 and following, I think you should give the VOTable types you expect in the response sehemas ("text" is fine, since I don't think you should mandate arraysize="*" on char fields; however, if, e.g., created is a timestamp, I think you should mandate the corresponding xtype).
<em>Answer: <span style="background-color: transparent;">We already have the datatype in the FIELD element, do you think we have to add more ?</span></em>

<span style="background-color: transparent;"><br /></span>
   * In 4.2, is the project parameter mandatory?
<em>Answer: <span style="background-color: transparent;">No it is not. We now say it explicitly.</span></em>

<span style="background-color: transparent;"><br /></span>
   * In 4.3, the query example uses "projects" as the parameter name, whereas the defined parameter name is "project".
<em>Answer: <span style="background-color: transparent;">We corrected the typo. Thank you. </span></em>

   * Which brings me to a general point: I think SimDAL should say somewhere whether its parameters are supposed to repeatable (i.e.: can I pass multiple "project" parameters to, say, <protocols resource URI>?)
<em>Answer: <span style="background-color: transparent;">The answer is no. In this first version of SimDAL, only a single "parameter" can be passed. We now say it in the text. </span></em>

   * In 5, you say, at various places "These views can be seen as ASCII tab separated files.", "That is what would be done when performing a SQL query on a single flat table", "This server-side file is abstracted, in a VO context, as a VOTable.", "It aims at untying the standard and the implementation details." So -- I have to say I'm fairly confused. From what I can fathom from this, you're saying the underlying data structure is a relation, and a view is a projection of a subset of that relation? Whatever it is, I think you should define the basic data structure without reference to any specific serialisation, just in terms of the underlying mathematical model, exactly to untie model and implementation.
<em>Answer: <span style="background-color: transparent;">Ok, document updated</span></em>

<span style="background-color: transparent;"><br /></span>
   * On p. 26, you give a VOTable group to declare foreign keys, which is fairly related to the foreign-key from 3.3, but has some additional PARAMs, but doesn't have a name and doesn't use ref. I appreciate that the use case is a bit different here, but couldn't there be one common mechanism for "foreign-key-like relationship between entities declared in some VOTable"? Sure, this might make the 3.3 GROUP a bit clumsier, and perhaps the typedness of the FIELDref is lost, but I'd consider this a small price to pay for at least internal consistency of SimDAL (of course, I'm still all for trying to do without some generic foreign-key mechanism defined in a DAL standard; let's have that in VOTable).
<em>Answer: <span style="background-color: transparent;">Ok, this is related to our answer to the previous question about foreign_keys - see above.</span></em>

<span style="background-color: transparent;"><br /></span>
   * On p. 26, "Query Language", you should reference the concrete JSON standard people should implement against (or reference some Javascript specification and say which nonterminal your dictionaries should conform to. There's just too many flavours of JSON out there.
<em>Answer: <span style="background-color: transparent;">You are right, thank you for pointing this to us, we have added the reference.</span></em>

<span style="background-color: transparent;"><br /></span>
   * The {fields} end point apparently uses a REQUEST parameter and is polymorphic on it (REQUEST=search has a q parameter, REQUEST=schema has a field parameter). Isn't that a bit at odds with the rest of the design, where you have different endpoints for different functionalities? Why don't you split up these two functionalities into two endpoints (or, conversely, join a few other endpoints and use REQUEST to dispatch between different sub-functions; obviously, that's not my preference)?
<em>Answer: <span style="background-color: transparent;">We have done the update following your recommendation.</span></em>

<span style="background-color: transparent;"><br /></span>
   * In 6.3., a reader might suppose the first job creation request already returns the UWS document with the results element filled out. I'd suggest putting an "eventually" or something like this into "It returns a UWS resource".
<em>Answer: <span style="background-color: transparent;">Yes, thank you this is clarified (section 6.3)</span></em>

<span style="background-color: transparent;"><br /></span>
   * p. 41f, "UWS extension" stipulates that SimDAL "differs" from UWS in two points. First, there's no joblist -- where does the SimDAL say that? If the sentence itself is the norm, this should be made much clearer. Also, I don't think there's a necessity to even outlaw it, since I'd expect most people would use off-the-shelf UWS components anyway that have their own ways of dealing with the "security" issues you cite. The second point, the use of JSON as a JCL, I cannot see as a difference from UWS, which does not specify the JCL in the first place. Which stipulation of UWS do you see violated there?
<em>Answer: <span style="background-color: transparent;">You are right about the JCL, we have removed the mention. </span><span style="background-color: transparent;">We also made the 1st point clearer. </span><span style="background-color: transparent;">Thank you.</span></em>

   * Finally, even in a technical text, the pervasive use of male-only forms reads a bit odd and cranky these days. Just use plural forms and don't worry about it ("...the final user can get a hint about if he is asking for too many..." -&gt; "users can get a hint whether they are asking for too many...").
_Answer: Done. Thank you._

-- IVOA.MarkusDemleitner - 2016-09-13

Answers: --IVOA.FranckLePetit and IVAO.DavidLanguignon - 2016-09-28
---++ Comments from TCG members during the TCG Review Period: 2016-07-08 - 2016-08-22

WG chairs or vice chairs must read the Document, provide comments if any and formally indicate if they approve or do not approve of the Standard.

IG chairs or vice chairs are also encouraged to do the same, although their inputs are not compulsory.

---+++ TCG Chair & Vice Chair ( _Matthew Graham, Pat Dowler_ )

---+++ Applications Working Group ( _Pierre Fernique, Tom Donaldson_ )

Approved. I have no expertise in Sim, but as an independent feature, the specification seems reasonable and consistent.

-- IVOA.TomDonaldson - 2016-10-22

---+++ Data Access Layer Working Group ( _François Bonnarel, Marco Molinaro_ )

Discovery and Access to simulation data has been a long term VO goal. It is nice to see that this goal is now ready to be achieved as the first implementations prove it. Specially nice to see that DALI constistency has been much improved in the last versions. We validate this specification for recommendation.

On the long term we recommend authors and editors to pay attention to a couple of points for better integration to the full DAL landscape and better interoperability between observational and simulation data :

- convergence of DataLink technics which may be reached in next versions of both SimDAL and DataLink.

- convergence in query languages which may also result from efforts on SimDAL side as well as Simple access or TAP side for future versions

- complementarity and coupling of SKOS technology and ucd technology for coding the semantics looks important to us and is probably possible. But this is more in the hand of the semantics working group which is collaborating with TIG on that.

-- IVOA.FrancoisBonnarel , IVOA.MarcoMolinaro - 2016-11-24

---+++ Data Model Working Group ( _Mark Cresitello-Dittmar, Laurent Michel_ )

I reviewed the 20161014 version of the document. I'm wondering if this is correct, as some of my comments appear earlier with comments that they have been addressed.

Two broad comments:

1) I would like to see some statement about the completeness of the implementations.. do they implement all features of the spec?

<em>Answer: <span style="background-color: transparent;">All mandatory APIs are implemented in the Paris implementation. This implementation does not implement (up to now) the optional {cutouts-preview} </span><span style="background-color: transparent;">The SVO implementation implement most of the mandatory API (see the </span><span style="background-color: transparent;">implementation documentation and tutorial to have detailed information about </span><span style="background-color: transparent;">the implementation).</span></em>

<em><span style="background-color: transparent;">Answer (Carlos Rodrigo): The SVO implementation (http://svo2.cab.inta-csic.es/theory/simdal1/) includes all three types of services: repository, search and dataAccess. We implemented all the mandatory resorces and some optional ones (for instance, </span></em><em><span style="background-color: transparent;"><em><span style="background-color: transparent;">{cutouts-preview})</span></em>. It is presented in the web page with explanations of what we consider a typical workflow and an example of use because we thought that, as simdal has many endpoints, it was more ilustrative to do it so. But, in each case, links are given to the URL's of the real implementation of each resource.</span></em>

<em><span style="background-color: transparent;"><br /></span></em>

2) In reading it, there seems to be a large overlap with existing standards ( DALI, DATALINK, etc) which was also mentioned by others. Since DALI is supposed to be the basis for DAL protocols, I'd like to see this spec. be expressed more directly in relation to it rather than statements of compatibility. In reading the responses to similar comments above, and speaking with Francois about this, I understand that this is intentional for this version. A subsequent version can integrate the spec into the DALI family. So, I will not block progress on this count.

<em>Answer: <span style="background-color: transparent;">Indeed. As explained in another answer c</span>oncerning Datalink, SimDAL does not use it since it would have made the standard heavier whereas we just need a tiny subset of datalink. As you say, that is something we have in mind for a future version of the standard. Concerning DALI, <span style="background-color: transparent;">SimDAL is DALI-compliant. </span></em>

General:

Section 1: pg 5 = The final lines state who should implement each of the components, but in very fuzzy terms (eg: "most of the time the SimDAL Search component"). It would be more clear if it stated specifically who would implement each part. This same fuzzy language is repeated in a couple places (pg 8)

<em>Answer: <span style="background-color: transparent;">Thank you for pointing this out. We have reworked the part your are talking </span><span style="background-color: transparent;">about trying to make it more clear.</span></em>

<span style="background-color: transparent;">pg 6: Architecture diagram does not match the one in the master IVOA Architecture document.</span>

_Thank you. We will see with DAL chairs to correct this IVOA Architecture figure._

S2.3 - pg10: "the pivot format" as Markus stated, I have no idea what that means, perhaps it is common knowlege to the target audience?

_Answer: Ok, we realize that this is a tricky term so that we have removed it completly_

S3.0 - pg11: Question marks should be confirmed and removed. 1. "SimDAL components are exposed with APIs following a REST design (?) that conforms to the DALI resource description (?)."

_Answer: sorry, that was an erroneous generation of the bilio in the published archive. It is now corrected._

S3.3 - pg12: Question mark in place of reference to JSON standard

_Answer: sorry, that was an erroneous generation of the bilio in the published archive. It is now corrected._

S3.5 - pg15: another question mark in place of reference (VOTable)

_Answer: sorry, that was an erroneous generation of the bilio in the published archive. It is now corrected._

S3.6 - pg15: "must provide sufficient lifetime for interactive browsing of the pages". This is a rather vague statement if requirement.

<em>Answer: <span style="background-color: transparent;">We though that it is not more abritrary than saying any random time like </span><span style="background-color: transparent;">10 seconds or 10 minutes. Moreover, this "sufficient lifetime" is often very </span><span style="background-color: transparent;">specific to the service/type of data/simulation that only the publisher is the </span><span style="background-color: transparent;">most capable to master.</span></em>

S4.1 - pg17: the description for 'q' parameter, "The search logic is up to the publisher.." How is a user supposed to know what to put in the field if the logic is up to the publisher? The example q='n(h2)' matches both 'N(H2)' and n(H2)', but only because this provider decided to make the search case insensitive?

<em>Answer: That is correct. The user knows about how the "q" parameter is handled <span style="background-color: transparent;">through publisher documentation of the extra features. But we understand that </span><span style="background-color: transparent;">it could be tricky so that we added better explanations in </span><span style="background-color: transparent;">the document. Thank you for pointing this.</span></em>

S5.6 - pg37: "the same way<strong> than</strong> the one" =&gt; "the same way as the one"

_Answer: Thank you. We corrected the document._

S5.6 - pg37: "but in *another* cases it would" =&gt; "but in other cases it would"

_Answer: Thank you. We corrected the document._

S6.3 - pg44: UWS extension.. "For various reasons but in particular because of security concerns." I don't know much about what this content, but it sounds like it is indicating security concerns with the content of the UWS document standard.

_Answer: Thank you. We reformulated this point._

Appendix B - pg48: "and some <strong>developpers</strong>" =&gt; "and some developers"

_Answer: Thank you. We corrected the document._

Appendix B - pg48: "to have *much* more properties" =&gt; "to have many more properties"

_Answer: Thank you. It now also corrected._

Appendix B - pg48: "the APIs *with the willing* of putting" =&gt; "with the intent" or "with the hope"..

_Answer: Thank you. Done._

Appendix B - pg48: "should know about <strong>technics</strong>" =&gt; "the technical aspects"?

_Answer: Thank you. This is now corrected._

Appendix B - pg48: "end user to *not needing to* worry" =&gt; "end user to not worrry"

_Answer: Thank you. We corrected the document._

-- IVOA.MarkCresitelloDittmar - 2016-10-26

Answers: --IVOA.FranckLePetit and IVAO.DavidLanguignon - 2016-11-04
---+++ Grid & Web Services Working Group ( _Brian Major, Giuliano Taffoni_ )

I approve this document.

-- IVOA.BrianMajor - 2016-12-09

---+++ Registry Working Group ( _Markus Demleitner, Theresa Dower_ )

We are somewhat concerned that there is a fairly large overlap between Registry and your repositories. It would seem that at least the plain {search} endpoint is largely covered by standard Registry infrastructure; for {projects} and {protocols} I'd say it's a matter of a Registry extension.

<em>Answer: <span style="background-color: transparent;">We organized a meeting in Paris in march 2015/16 dedicated to the question of the registration of SimDAL components in the registries. Several authors of SimDAL as well as representative of the DAL WG (Marco) and Registry WG (Markus) were present. </span></em>

_Several options and questions were identified during the meeting. After this meeting, discussions between the authors of the SimDAL standard concluded that some important use cases require SimDAL repositories:_

_1) fine discovery of SimDAL services requires the detailed description of theoretical services following SimDM serializations including its semantics aspects (SKOS)._

_2) these SimDM descriptions / serializations must be centralized (for example to have a unique description of a code to which publishers of simulations produced by this code can refer to)._

_The need of such a way (using SimDM repositories) to discover and describe theoretical services in the VO has been identified a long time ago, before and during the definition of SimDM. Nevertheless, SimDAL components must be registered in the IVOA registries._

When you say "SimDAL services may be discovered through Registry queries", I think you should say "by looking for capabilities with the standard ids defined in sect. 3.6."

_Answer: Yes, this precision adds clarification, thank you. We modified the document._

Beyond that, if you want to define a Registry extension (and I think you should), I think you should do so in the document. Splitting up the "DAL part" and the extension, as we've done with S*AP and TAP, has proven to be a severe maintenance liability. We are happy to assist you there, and as long as you have your metadata concepts worked out, this would be a quick process.

_Answer: During the meeting in Paris in February 2016, we started to look at how to register SimDAL components in the IVOA registries. Two solutions appeared:_

_1) to map as much as possible the SimDM serializations (protocol.xml, project.xml) in the IVOA registries using extensions. This solution requires depreciating some SimDM concepts (notions of code version, owner etc &hellip;), slight modifications of registries (or take a bit of freedom as to store SKOS concepts in UCD fields), develop an XSLT transformation of SimDM serializations, etc ._

_2) to do a simple registration of SimDAL components in the IVOA registries without extensions using classical fields for registrations: title, description, keywords, publishers, etc ..._

<span style="background-color: transparent;"> _Solution 1 is more complex to set up: it requires developments, to set up a prototype to check it works properly and to test the implications for end users. It may be nicer from an IVOA point of view but is not required by the scientific use cases defined by the Theory I.G. Nevertheless, we decided to try it but we fixed a deadline to the end of March 2016 to get an operational XSLT mapping from SimDM serializations towards registries. Without progress for the end of March we would move to solution 2 to avoid to delay a release of the SimDAL standard that is asked by several teams in the astrophysics community. Solution 1 would then be investigated for SimDAL version 2.0_ </span>

_Nothing happened for the end of March. So we moved towards solution 2. This solution does not need any specific descriptions since it is a standard registration of services in the IVOA registries. It fulfills all the scientific goals._

<span style="background-color: transparent;">Talking about standardIds, in 3.6, it seems you are saying the curly braces should actually be part of the URI ("ivo://ivoa.net/std/SimDALSearch#{views}-1.0" in what you label "Example"). I doubt that is intended, but if it is, we would veto it; curly braces are not allowed in URIs.</span>

_Answer: Ok, fixed in the document. Thank you for pointing this out._

<span style="background-color: transparent;">In 4.1, you say that search "should implement the pagination API" -- so, how does a client find out whether it does? As long as there is a possibility that a given service doesn't support pagination, I'd suggest you should say in 3.4 how to discover pagination support once and for all. From a Registry perspective, I'd say this is a fairly natural item for a Registry extension's metadata model.</span>

<em>Answer: The way a client knows that a collection resource supports pagination is by <span style="background-color: transparent;">looking in the resource representation (a VOTable) if there is pagination </span><span style="background-color: transparent;">special LINK elements (that is having the special content roles described in </span><span style="background-color: transparent;">"Pagination" section). Thus, a service may implement the pagination but decide </span><span style="background-color: transparent;">not to use it for some collections while using it for others. </span><span style="background-color: transparent;">This is now explained in the document.</span></em>

In 4.1, you define what boils down to a universal metadata model, including a means for schema discovery. We note for the record that from the Registry experience we are fairly uneasy about the usability of such an extremely generic thing; also, we've found many metadata items have a natural tree structure, which of course is not really representable in such a flat key-value structure.

<em>Anser: Tree structure representation in relational databases (say sets of flat <span style="background-color: transparent;">key-value structures) has been being used for years and is mastered. Off </span><span style="background-color: transparent;">course this brings some query complexity for the tree reconstruction. </span></em>

<em><span style="background-color: transparent;"> </span><span style="background-color: transparent;">We do not expect hierarchy to be used here, the full information (and the </span><span style="background-color: transparent;">various hierarchies) is actually kept in the SimDM serializations (of project </span><span style="background-color: transparent;">and protocol SimDM package mostly.). This is intended to be a simple (flat), </span><span style="background-color: transparent;">yet informative, view of the SimDM serializations (classes mainly).</span></em>

In 4.1, you say "(in the sense of ivo:// id)" for the authority. We are not *quite* sure what you intend to do here, but we strongly suspect you do *not* want an authority here. A publisher typically is an Organization in VOResource, *not* an Authority, and an Authority can register multiple Organizations. We *believe* what you want to say here is: "The IVOA Identifier of the publisher of the project...". This would mean that, provided the publishers did their job right, that <publisher>#<project> is a globally unique identifier (albeit one for which only the publisher part properly resolves, but that's fine).

In the VO Registry, the real complex point is the proliferation of information from the publishers to the searchable registries. This problem must surely exist in the proposed SimDAL system, as the number of publishers is apparently expected to be much larger than the number of repositories. Some indication of how the initial metadata transfer and subsequent updates should be performed (file format, transfer modalities, signaling,...) would strengthen our confidence in this part of the standard.

<em>Answer: <span style="background-color: transparent;">Yes, that's correct. Thank you for pointing this out, we have updated the document to fix this.</span></em>

<span style="background-color: transparent;">Answers: --IVOA.FranckLePetit and IVOA.DavidLanguignon - 2016-09-28</span>
---+++ Semantics Working Group ( _Mireille Louys, Alberto Accomazzi_ )

I have read the specification carefully (2016-10-14) and proposed a few typo corrections for the Appendix A and B namely, directly to the authors/editors.

_Answer: Thanks. We have adressed the typo corrections in the January version._

Table labels and captions might help to clarify the goal of such table examples for the reader and reference them more easily. The Acknowlegment section does not mention the support of national projects --&gt; can be mentioned.

_Answer: The projects are now acknowledged in the head of the document._

The document is very rich and covers the use cases precisely and with working examples. It is didactic and useful as a guide for implementation. The SKOS VO theory vocabulary has been defined previously in the !SimDM specification already and is appropriately cited in the specification.

The heterogeneity and scale of possible simulation parameters is very large and deserves a specific vocabulary as defined in the VO Theory interest group. The overlap of such a vocabulary with Unified Content Descriptors is not so important. When dealing with the comparison of simulated observations and genuine observations , a mapping between SKOS concepts and UCDs might help to homogeneize the metadata.

-- IVOA.MireilleLouys - 2017-01-10

<em>-- Answers: David Languignon and Franck Le Petit (24th January 2017) new update of the document uploaded <br /></em>

After reviewing version 20170130 (http://ivoa.net/documents/SimDAL/20170130/PR-SimDAL-1.0-20170130.pdf) of the document, I support the recommendation of this specification which is rich and helpful as a guideline to publish services for simulated data.

-- IVOA.MireilleLouys - 2017-02-06<em><br /></em>
---+++ Education Interest Group ( _Massimo Ramella, Sudhanshu Barway_ )

---+++ Time Domain Interest Group ( _John Swinbank, Dave Morris_ )

---+++ Data Curation & Preservation Interest Group ( _Françoise Genova_ )

---+++ Operations Interest Group ( _Tom !McGlynn, Mark Taylor_ )

---+++ Knowledge Discovery Interest Group ( _Kaï Polsterer_ )

---+++ Theory Interest Group ( _Carlos Rodrigo_ )

When I read the introduction of section 5 (SimDAL Search) I get the impression that an unaware reader could understand that it is impossible to define views contaning properties and links to more than one different object type. For instance, it explains that, if you have a simulation that provides both the 3D structure of a star and its oscillation spectrum, you have to define two different views. This, in fact, is a missunderstanding.

First, having a simulation that generates different output files for a set of given inputs is quite a common case. And having different views for each object type (output data file), while possible, would make it almost impossible that a user can make a search on metadata and get the two, or more, final files corresponding to that "experiment" (the links between different views is very inefficient).

Second, it is perfectly possible and natural in SimDAL to define a view that links together all the output files for the same experiment and points to the corrresponding DataAccess services poroviding each dataset.

By the way, this is not a "new idea", it's something that have been discussed and agreed before. It is just not clear in the document.

In my opinion, it should be explicetely said that views containing different objecttypes can be defined. And it would be nice to give a simple example of a view schema for such a case.

_Answer: Thank you Carlos, we have done the update in the document._
---+++ Standards and Processes Committee ( _Françoise Genova_)

<br /> <!--
      * Set ALLOWTOPICRENAME = IVOA.TWikiAdminGroup
-->
This topic: IVOA > TemplateRFC > SimDALRFC
Topic revision: r22 - 2017-02-06 - MireilleLouys