Vision: information-centric dataflow: re-imagining reactive distributed computing
- This paper describes an Information-Centric Dataflow system that is based on name-based access to computation results, NDN PSync dataset synchronization for enabling consuming compute functions to learn about updates and for coordinating the set of compute functions in a distributed Dataflow pipeline. We describe how relevant Dataflow concepts can be mapped to ICN and how data-sharing, data availability and scalability can be improved compared to state-of-the-art systems. We also provide a specification of an application-independent namespace design and report on our experience with a first prototype implementation.
| Author: | Dirk KutscherORCiD, Laura Al Wardani, T M Rayhan Gias |
|---|---|
| DOI: | https://doi.org/10.1145/3460417.3482975 |
| ISBN: | 9781450384605 |
| Parent Title (English): | ICN '21: Proceedings of the 8th ACM Conference on Information-Centric Networking, 22.09.-24.09.2021, Paris (France) |
| Publisher: | ACM |
| Place of publication: | New York, NY, USA |
| Document Type: | Conference Proceeding |
| Language: | English |
| Year of Completion: | 2021 |
| Release Date: | 2025/02/25 |
| Tag: | Dataflow; Distributed Computing; Information-Centric Networking |
| Pagenumber: | 7 |
| First Page: | 52 |
| Last Page: | 58 |
| Institute: | Fachbereich Technik |
| Research Focus Area: | Industrielle Informatik |