Revision 62025-06-02 - TamaraCivera

META TOPICPARENT	name="InterOpJune2025"

Ops + DSP Session at the June 2025 Interop, College Park (Maryland, US)

Thursday June 5 2025 11:00-12:30, Room: room 1309

Back to main progamme page: InterOpJune2025

Changed:

<
<

Moderators: Steve Groom, Tamara Civera

>
>

Ops Session 11:00 - 11:30

Added:

>
>

Speaker	Title	Time	Material
Henrik Norman	Euro-VO Registry weather report During the past few months, I’ve actively contacted ~40 data providers and asked them to address specific issues with their services. I will talk about the status of this effort and the current compliance rating of the VO ecosystem as a whole.	15' + 5'

Changed:

<
<

All

Discussion

15'

>
>

All

Discussion

10'

Added:

>
>

Moderators: Sara Bertocco, Tamara Civera

Changed:

<
<

DSP Sessions

Moderators: Sara Bertocco, Tamara Civera

>
>

Notetakers: Collaborative

Added:

>
>

notes: _( live notes, should expire around end of June 2025)_

DSP Session 11:30 - 12:30

https://wiki.ivoa.net/twiki/bin/view/IVOA/InterOpJune2025DSP

Added:

>
>

Moderators: Sara Bertocco, Tamara Civera

Revision 52025-06-02 - JesusSalgado

META TOPICPARENT	name="InterOpJune2025"

Ops + DSP Session at the June 2025 Interop, College Park (Maryland, US)

Thursday June 5 2025 11:00-12:30, Room: room 1309

Back to main progamme page: InterOpJune2025

Deleted:

<
<

~~---++ DRAFT Schedule:~~ ---++ DRAFT Schedule:

Moderators: Steve Groom, Tamara Civera

Speaker	Title	Time	Material
Henrik Norman	Euro-VO Registry weather report During the past few months, I’ve actively contacted ~40 data providers and asked them to address specific issues with their services. I will talk about the status of this effort and the current compliance rating of the VO ecosystem as a whole.	15' + 5'

Changed:

<
<

>
>

All

Discussion

15'

Deleted:

<
<

DSP Sessions

Moderators: Sara Bertocco, Tamara Civera
|

ZHANG, Zhen

(Remote)

| Experiences and lessons learned from EP scientific workflow |

15'

9:15-9:30

| An automated and efficient workflow is crucial for scientific output in astronomy, particularly in time-domain astronomy. The National Astronomical Data Centre (NADC) has undertaken the development of the workflow for the Einstein Probe(EP), a high-energy X-ray satellite focused on time-domain astronomy. During the development process, we encountered challenges including workflow orchestration, workflow scalability, and the traceability of data product generation processes. To address these issues, we developed a workflow framework based on cloud technologies, including containers, message queues, and workflow orchestrators, etc. This framework offers excellent scalability and portability and significantly enhances the efficiency of complex algorithm integration and deployment in multi-team collaborations. Finally, we proposed our recommendation for provenance and workflow data model. This framework can be further applied to future time-domain astronomy projects, and we hope that our experiences can provide insights for the IVOA workflow standards. | |

Baptiste Cecconi

Workflow orchestration for radio interferometric imaging using EXTRACT

15'

9:30-9:45

We present the result of the EXTRACT project, which is proposing a compute continuum framework (with edge, cloud and HPC compute resources) on a distributed data environment. In our presentation, we will show how we deploy multiple cloud-ready and HPC-ready technologies to furnish radio astronomers with a simple interface to describe data processing workflows which dramatically lowers the difficulty threshold of using complex tools from the radio interferometric community. In the case of NenuFAR, we propose workflows to dynamically process the imaging data of the dynamic Sun, which enables the astrometric localisation of the solar bursts (Type II, Type III bursts), and planets (e.g. Jupiter, exoplanets), complementary to beamformed observations. This workflow integrates classical LOFAR tools and methods as well as recent direction-dependent tools (e.g. DDFacet, killMS, DynSpecMS) to perform complex operations on interferometric data, such as the processing of the NLFSS sky survey and the search for exoplanetary signatures using rebuilt dynamic spectra derived from imaging data.

We will discuss how this will be interfaced with IVOA standards for data provenance and data discoverability.

Changed:

<
<

CONFLICT version 2:

>
>

DSP Sessions

Moderators: Sara Bertocco, Tamara Civera

Changed:

<
<

Moderators: Sara Bertocco, Tamara Civera

>
>

https://wiki.ivoa.net/twiki/bin/view/IVOA/InterOpJune2025DSP

Deleted:

<
<

Notetakers: Collaborative |
ZHANG, Zhen

(Remote)
| Experiences and lessons learned from EP scientific workflow |
15'

9:15-9:30
| An automated and efficient workflow is crucial for scientific output in astronomy, particularly in time-domain astronomy. The National Astronomical Data Centre (NADC) has undertaken the development of the workflow for the Einstein Probe(EP), a high-energy X-ray satellite focused on time-domain astronomy. During the development process, we encountered challenges including workflow orchestration, workflow scalability, and the traceability of data product generation processes. To address these issues, we developed a workflow framework based on cloud technologies, including containers, message queues, and workflow orchestrators, etc. This framework offers excellent scalability and portability and significantly enhances the efficiency of complex algorithm integration and deployment in multi-team collaborations. Finally, we proposed our recommendation for provenance and workflow data model. This framework can be further applied to future time-domain astronomy projects, and we hope that our experiences can provide insights for the IVOA workflow standards. | | | Baptiste Cecconi | Workflow orchestration for radio interferometric imaging using EXTRACT |
15'

9:30-9:45
| We present the result of the EXTRACT project, which is proposing a compute continuum framework (with edge, cloud and HPC compute resources) on a distributed data environment. In our presentation, we will show how we deploy multiple cloud-ready and HPC-ready technologies to furnish radio astronomers with a simple interface to describe data processing workflows which dramatically lowers the difficulty threshold of using complex tools from the radio interferometric community. In the case of NenuFAR, we propose workflows to dynamically process the imaging data of the dynamic Sun, which enables the astrometric localisation of the solar bursts (Type II, Type III bursts), and planets (e.g. Jupiter, exoplanets), complementary to beamformed observations. This workflow integrates classical LOFAR tools and methods as well as recent direction-dependent tools (e.g. DDFacet, killMS, DynSpecMS) to perform complex operations on interferometric data, such as the processing of the NLFSS sky survey and the search for exoplanetary signatures using rebuilt dynamic spectra derived from imaging data.
We will discuss how this will be interfaced with IVOA standards for data provenance and data discoverability.
| |*notes: _( live notes, should expire around end of June 2025)_*

Revision 42025-06-02 - TamaraCivera

META TOPICPARENT	name="InterOpJune2025"

Ops + DSP Session at the June 2025 Interop, College Park (Maryland, US)

Thursday June 5 2025 11:00-12:30, Room: room 1309

Back to main progamme page: InterOpJune2025

Changed:

<
<

DRAFT Schedule:

>
>

~~---++ DRAFT Schedule:~~ ---++ DRAFT Schedule:

Added:

>
>

Moderators: Steve Groom, Tamara Civera

Speaker	Title	Time	Material
Henrik Norman	Euro-VO Registry weather report During the past few months, I’ve actively contacted ~40 data providers and asked them to address specific issues with their services. I will talk about the status of this effort and the current compliance rating of the VO ecosystem as a whole.	15' + 5'

Changed:

<
<

DSP Sessions

Moderators: Sara Bertocco, Tamara Civera

>
>

DSP Sessions

Moderators: Sara Bertocco, Tamara Civera
|

ZHANG, Zhen

(Remote)

| Experiences and lessons learned from EP scientific workflow |

15'

9:15-9:30

| An automated and efficient workflow is crucial for scientific output in astronomy, particularly in time-domain astronomy. The National Astronomical Data Centre (NADC) has undertaken the development of the workflow for the Einstein Probe(EP), a high-energy X-ray satellite focused on time-domain astronomy. During the development process, we encountered challenges including workflow orchestration, workflow scalability, and the traceability of data product generation processes. To address these issues, we developed a workflow framework based on cloud technologies, including containers, message queues, and workflow orchestrators, etc. This framework offers excellent scalability and portability and significantly enhances the efficiency of complex algorithm integration and deployment in multi-team collaborations. Finally, we proposed our recommendation for provenance and workflow data model. This framework can be further applied to future time-domain astronomy projects, and we hope that our experiences can provide insights for the IVOA workflow standards. | |

Deleted:

<
<

Notetakers: Collaborative

ZHANG, Zhen

(Remote)

Experiences and lessons learned from EP scientific workflow

15'

9:15-9:30

An automated and efficient workflow is crucial for scientific output in astronomy, particularly in time-domain astronomy. The National Astronomical Data Centre (NADC) has undertaken the development of the workflow for the Einstein Probe(EP), a high-energy X-ray satellite focused on time-domain astronomy. During the development process, we encountered challenges including workflow orchestration, workflow scalability, and the traceability of data product generation processes. To address these issues, we developed a workflow framework based on cloud technologies, including containers, message queues, and workflow orchestrators, etc. This framework offers excellent scalability and portability and significantly enhances the efficiency of complex algorithm integration and deployment in multi-team collaborations. Finally, we proposed our recommendation for provenance and workflow data model. This framework can be further applied to future time-domain astronomy projects, and we hope that our experiences can provide insights for the IVOA workflow standards.

Baptiste Cecconi

Workflow orchestration for radio interferometric imaging using EXTRACT

15'

9:30-9:45

We present the result of the EXTRACT project, which is proposing a compute continuum framework (with edge, cloud and HPC compute resources) on a distributed data environment. In our presentation, we will show how we deploy multiple cloud-ready and HPC-ready technologies to furnish radio astronomers with a simple interface to describe data processing workflows which dramatically lowers the difficulty threshold of using complex tools from the radio interferometric community. In the case of NenuFAR, we propose workflows to dynamically process the imaging data of the dynamic Sun, which enables the astrometric localisation of the solar bursts (Type II, Type III bursts), and planets (e.g. Jupiter, exoplanets), complementary to beamformed observations. This workflow integrates classical LOFAR tools and methods as well as recent direction-dependent tools (e.g. DDFacet, killMS, DynSpecMS) to perform complex operations on interferometric data, such as the processing of the NLFSS sky survey and the search for exoplanetary signatures using rebuilt dynamic spectra derived from imaging data.

We will discuss how this will be interfaced with IVOA standards for data provenance and data discoverability.

Added:

>
>

CONFLICT version 2:

Moderators: Sara Bertocco, Tamara Civera

Notetakers: Collaborative |

ZHANG, Zhen

(Remote)

| Experiences and lessons learned from EP scientific workflow |

15'

9:15-9:30

| An automated and efficient workflow is crucial for scientific output in astronomy, particularly in time-domain astronomy. The National Astronomical Data Centre (NADC) has undertaken the development of the workflow for the Einstein Probe(EP), a high-energy X-ray satellite focused on time-domain astronomy. During the development process, we encountered challenges including workflow orchestration, workflow scalability, and the traceability of data product generation processes. To address these issues, we developed a workflow framework based on cloud technologies, including containers, message queues, and workflow orchestrators, etc. This framework offers excellent scalability and portability and significantly enhances the efficiency of complex algorithm integration and deployment in multi-team collaborations. Finally, we proposed our recommendation for provenance and workflow data model. This framework can be further applied to future time-domain astronomy projects, and we hope that our experiences can provide insights for the IVOA workflow standards. | | | Baptiste Cecconi | Workflow orchestration for radio interferometric imaging using EXTRACT |
15'

9:30-9:45
| We present the result of the EXTRACT project, which is proposing a compute continuum framework (with edge, cloud and HPC compute resources) on a distributed data environment. In our presentation, we will show how we deploy multiple cloud-ready and HPC-ready technologies to furnish radio astronomers with a simple interface to describe data processing workflows which dramatically lowers the difficulty threshold of using complex tools from the radio interferometric community. In the case of NenuFAR, we propose workflows to dynamically process the imaging data of the dynamic Sun, which enables the astrometric localisation of the solar bursts (Type II, Type III bursts), and planets (e.g. Jupiter, exoplanets), complementary to beamformed observations. This workflow integrates classical LOFAR tools and methods as well as recent direction-dependent tools (e.g. DDFacet, killMS, DynSpecMS) to perform complex operations on interferometric data, such as the processing of the NLFSS sky survey and the search for exoplanetary signatures using rebuilt dynamic spectra derived from imaging data.
We will discuss how this will be interfaced with IVOA standards for data provenance and data discoverability.
| |*notes: _( live notes, should expire around end of June 2025)_*

Revision 32025-06-02 - JesusSalgado

META TOPICPARENT	name="InterOpJune2025"

Ops + DSP Session at the June 2025 Interop, College Park (Maryland, US)

Thursday June 5 2025 11:00-12:30, Room: room 1309

Back to main progamme page: InterOpJune2025

Changed:

<
<

DRAFT Schedule:

>
>

DRAFT Schedule:

Added:

>
>

Moderators: Steve Groom, Tamara Civera

Speaker	Title	Time	Material
Henrik Norman	Euro-VO Registry weather report During the past few months, I’ve actively contacted ~40 data providers and asked them to address specific issues with their services. I will talk about the status of this effort and the current compliance rating of the VO ecosystem as a whole.	15' + 5'

Changed:

<
<

DSP talks

....

Moderators: Sara Bertocco, Tamara Civera

>
>

DSP Sessions

Moderators: Sara Bertocco, Tamara Civera

Notetakers: Collaborative

Added:

>
>

ZHANG, Zhen (Remote)	Experiences and lessons learned from EP scientific workflow	15' 9:15-9:30	An automated and efficient workflow is crucial for scientific output in astronomy, particularly in time-domain astronomy. The National Astronomical Data Centre (NADC) has undertaken the development of the workflow for the Einstein Probe(EP), a high-energy X-ray satellite focused on time-domain astronomy. During the development process, we encountered challenges including workflow orchestration, workflow scalability, and the traceability of data product generation processes. To address these issues, we developed a workflow framework based on cloud technologies, including containers, message queues, and workflow orchestrators, etc. This framework offers excellent scalability and portability and significantly enhances the efficiency of complex algorithm integration and deployment in multi-team collaborations. Finally, we proposed our recommendation for provenance and workflow data model. This framework can be further applied to future time-domain astronomy projects, and we hope that our experiences can provide insights for the IVOA workflow standards.
Baptiste Cecconi	Workflow orchestration for radio interferometric imaging using EXTRACT	15' 9:30-9:45	We present the result of the EXTRACT project, which is proposing a compute continuum framework (with edge, cloud and HPC compute resources) on a distributed data environment. In our presentation, we will show how we deploy multiple cloud-ready and HPC-ready technologies to furnish radio astronomers with a simple interface to describe data processing workflows which dramatically lowers the difficulty threshold of using complex tools from the radio interferometric community. In the case of NenuFAR, we propose workflows to dynamically process the imaging data of the dynamic Sun, which enables the astrometric localisation of the solar bursts (Type II, Type III bursts), and planets (e.g. Jupiter, exoplanets), complementary to beamformed observations. This workflow integrates classical LOFAR tools and methods as well as recent direction-dependent tools (e.g. DDFacet, killMS, DynSpecMS) to perform complex operations on interferometric data, such as the processing of the NLFSS sky survey and the search for exoplanetary signatures using rebuilt dynamic spectra derived from imaging data. We will discuss how this will be interfaced with IVOA standards for data provenance and data discoverability.

Deleted:

<
<

notes: _( live notes, should expire around end of June 2025)_

Revision 22025-06-02 - TamaraCivera

META TOPICPARENT	name="InterOpJune2025"

Changed:

<
<

Ops Session at the June 2025 Interop, College Park (Maryland, US)

>
>

Ops + DSP Session at the June 2025 Interop, College Park (Maryland, US)

Added:

>
>

Thursday June 5 2025 11:00-12:30, Room: room 1309

Back to main progamme page: InterOpJune2025

DRAFT Schedule:

Speaker	Title	Time	Material
Henrik Norman	Euro-VO Registry weather report During the past few months, I’ve actively contacted ~40 data providers and asked them to address specific issues with their services. I will talk about the status of this effort and the current compliance rating of the VO ecosystem as a whole.	15' + 5'

Changed:

<
<

All

Discussion?

Moderators: Steve Groom, Tamara Civera

>
>

DSP talks

....

Moderators: Sara Bertocco, Tamara Civera

Added:

>
>

Notetakers: Collaborative

notes: _( live notes, should expire around end of June 2025)_

Revision 12025-05-29 - SteveGroom

META TOPICPARENT	name="InterOpJune2025"

Ops Session at the June 2025 Interop, College Park (Maryland, US)

Back to main progamme page: InterOpJune2025

DRAFT Schedule:

Speaker	Title	Time	Material
Henrik Norman	Euro-VO Registry weather report During the past few months, I’ve actively contacted ~40 data providers and asked them to address specific issues with their services. I will talk about the status of this effort and the current compliance rating of the VO ecosystem as a whole.	15' + 5'
All	Discussion?

Moderators: Steve Groom, Tamara Civera

Difference: InterOpJune2025Ops (1 vs. 6)

Revision 62025-06-02 - TamaraCivera

Ops + DSP Session at the June 2025 Interop, College Park (Maryland, US)

Revision 52025-06-02 - JesusSalgado

Ops + DSP Session at the June 2025 Interop, College Park (Maryland, US)

Revision 42025-06-02 - TamaraCivera

Ops + DSP Session at the June 2025 Interop, College Park (Maryland, US)

DRAFT Schedule:

Revision 32025-06-02 - JesusSalgado

Ops + DSP Session at the June 2025 Interop, College Park (Maryland, US)

DRAFT Schedule:

DRAFT Schedule:

Revision 22025-06-02 - TamaraCivera

Ops Session at the June 2025 Interop, College Park (Maryland, US)

Ops + DSP Session at the June 2025 Interop, College Park (Maryland, US)

DRAFT Schedule:

Revision 12025-05-29 - SteveGroom

Ops Session at the June 2025 Interop, College Park (Maryland, US)

DRAFT Schedule: