A Survey of Big Data Pipeline Orchestration Tools from the Perspective of the DataCloud Pro ject

Mihhail Matskin · Shirin Tahmasebi · Amirhossein Layegh · Amir H. Payberah · Aleena Thomas · Nikolay Nikolov +1 more

7 citations0/0 files storedZenodo (CERN European Organization for Nuclear Research)

No readable copy stored yet — this record is metadata only.

No open-access location is known for this record yet.

Literature note Cite in a project Citation map

Scientific Computing and Data Management Cloud Computing and Resource Management Big Data Technologies and Applications

Abstract

This paper presents a survey of existing tools for Big Data pipeline orchestration based on a comparative framework developed in the DataCloud project. We propose criteria for evaluating the tools to support reusability, flexible pipeline communication modes, and separa- tion of concerns in Big Data pipeline descriptions. This survey aims to identify research and technological gaps and to recommend approaches for filling them. Further work in the DataCloud project is oriented to- wards the design, implementation, and practical evaluation of the rec- ommended approaches.

Paper brief

Loading…

Cite this work

Citation unavailable for this work.

BibTeX RIS CSL-JSON

No public copy is stored for this record, so only the metadata is cited.

Imported from OpenAlex (CC0) — nothing here is generated.