Visual Life Sciences Workflow Design Using Distributed and Heterogeneous Resources

Abstract

Programming or querying usually presupposes some degree of technical familiarity with the syntax of a language and the peculiarity of the objects it manipulates to produce useful information. The degree of abstractions supported in a language helps lessen the depth of such familiarity needed, and aids in improving access to and usability of these resources. To help biologists concentrate more on their science questions and not on how to compute it, several successful workflow orchestration languages and systems have been proposed. Despite their popularity, significant limitations reduce their usability and limit applicability in novel applications. In this paper, we present a visual language, called VisFlow, for workflow orchestration using heterogeneous and distributed resources. We advance the idea that once resources are minimally described and abstracted, arbitrary workflows can be designed solely using query primitives supported in VisFlow. Its capabilities can be augmented by including computational artifacts in the form of library functions written in R, Python, and Java, or even in SQL and XQuery, making it a truly extensible system. We discuss its salient features and illustrate its capabilities using a substantial set of examples.

Cite this work

No public copy is stored for this record, so only the metadata is cited.

Stored only when both papers are in the corpus — 6 citations exist upstream.

Papers that cite the same references — the relational fallback while embeddings are still backfilling.