GWS WG discussion @ November Interop 2021GWS session 1 | ||||||||
Changed: | ||||||||
< < | Dave Morris: ExecutionPlanner Service Interface | |||||||
> > | Dave Morris: ExecutionPlanner Service Interface | |||||||
Changed: | ||||||||
< < | Today there exists a large variety of type of tasks with different cofigurations. | |||||||
> > | Today there exists a large variety of Science Platforms, they serve different communities, they have different configurations and different authentication methods. How can we make them interoperable? | |||||||
Changed: | ||||||||
< < | Moreover, a lot of people are looking at containerization as way to execute tasks and a platform to execute containers. | |||||||
> > | There exists notebook based platform and platforms that execute containers. Both are based on a single file that defines the task, evenif the "content of the file" is different (task specific), the pattern is very similar. | |||||||
Changed: | ||||||||
< < | The picture is not as simple | |||||||
> > | The reality however is not so simple, there are a lot of different services that are not defined by a single file: reality is messy. | |||||||
Changed: | ||||||||
< < | ||||||||
Changed: | ||||||||
< < | ||||||||
> > | we are working on two notes: | |||||||
Added: | ||||||||
> > |
Christine Banek: The reality is really complex, there are different specification designed to do different things that iteract one woth the other (e.g. like Kubernetes uses helm and helm uses docker, ans so on). I am worried that trying to unify this as one abstraction layer will be tricky at best, and since these are all moving, might be hard to keep up with. Dave Morris: yes, this is the problem we are trying to solve (it is hard to describe all the complexity in an 10min presentation). The execution planner only acts as a discovery service, it answers the question "can I do this", and hands the client the information it needs to use the actual service.
GT: we could dedicate a virtual splinter in the next days to brainstorm on this idea
Carlo Zwolf: Should the execution framework have to say how to execute the container? Shouldn't the implementer do it themselves "under the hood" and just run it? This may make the configuration even more limited to try to make a unified configuration for all these different specs, but it is a good point that in the end you just want to execute it and get the result. If the caller has to worry about the way it is done, it will be less interoperable between data centers if they don't support the same execution frameworks. I would say that the client is not interested in out the service is implemented under the hood but is more focused on the protocols to interact with the services. DM - you are right. It is hard to choose names for the interfaces in the presentation that people will recognise.
Stefano Alberto Russo: Rosetta science platform
It is a conteiner centric microservices based science platform that allow users to execute tasks on different platforms including HPC clusters. Based on a set of architectural elements: files, computing resources, tasks, comtainers, AAI.
In practice it is a way to allow users to run containers of their choosing to host their containers for tasks. Similar to execution planner but a lot more simple in terms of the scope.
GT: the platform architecture identifies a set of elements that corresponds to services and standards that IVOA already has but shoud be updated to recent tecnologies (as containers). This si in line with what Dave is doing on extending UWS.
Brian Major: GMS RFC.
Brian is presenting the GMS and he is going through the currently open RFC issues.
GMS (group membership service) is an API that answers questions about whether a user is a member of a group or which groups they are a member of. GMS is supporting interaction between services; a user calling GMS directly isn't really useful (you can find out your group information) but if you have a TAP service using GMS for authorization decisions then it does become useful bacase it implements access control to data.
There's the RFC page where comments and can be submitted or github issues and pull requests.
We discuss the various issues and comments from github and wiki.
<!-- * Set ALLOWTOPICRENAME = TWikiAdminGroup --> | |||||||
GWS WG discussion @ November Interop 2021GWS session 1Dave Morris: ExecutionPlanner Service Interface Today there exists a large variety of type of tasks with different cofigurations. Moreover, a lot of people are looking at containerization as way to execute tasks and a platform to execute containers. The picture is not as simple<--
|