pype.utils.pipeline.Pipeline#

class pype.utils.pipeline.Pipeline(path, name, pype_snippets_module={'_benchmark_power': <pype.utils.snippets.Snippet object>, '_dowload_files': <pype.utils.snippets.SnippetMd object>, 'complement_fa': <pype.utils.snippets.Snippet object>, 'hello': <pype.utils.snippets.Snippet object>, 'lower_fa': <pype.utils.snippets.Snippet object>, 'merge_fa': <pype.utils.snippets.Snippet object>, 'reverse_fa': <pype.utils.snippets.Snippet object>, 'test_adv': <pype.utils.snippets.Snippet object>, 'test_base': <pype.utils.snippets.SnippetMd object>, 'test_fail_exit_code': <pype.utils.snippets.SnippetMd object>, 'test_fail_missing_output': <pype.utils.snippets.SnippetMd object>, 'test_skip_check_results_md': <pype.utils.snippets.SnippetMd object>, 'test_skip_check_results_py': <pype.utils.snippets.Snippet object>})[source]#
Parameters:
  • path (str)

  • name (str)

  • pype_snippets_module (Dict)

__init__(path, name, pype_snippets_module={'_benchmark_power': <pype.utils.snippets.Snippet object>, '_dowload_files': <pype.utils.snippets.SnippetMd object>, 'complement_fa': <pype.utils.snippets.Snippet object>, 'hello': <pype.utils.snippets.Snippet object>, 'lower_fa': <pype.utils.snippets.Snippet object>, 'merge_fa': <pype.utils.snippets.Snippet object>, 'reverse_fa': <pype.utils.snippets.Snippet object>, 'test_adv': <pype.utils.snippets.Snippet object>, 'test_base': <pype.utils.snippets.SnippetMd object>, 'test_fail_exit_code': <pype.utils.snippets.SnippetMd object>, 'test_fail_missing_output': <pype.utils.snippets.SnippetMd object>, 'test_skip_check_results_md': <pype.utils.snippets.SnippetMd object>, 'test_skip_check_results_py': <pype.utils.snippets.Snippet object>})[source]#
Parameters:
  • path (str)

  • name (str)

  • pype_snippets_module (Dict)

Methods

__init__(path, name[, pype_snippets_module])

submit(parser, argv, queue, profile, log[, ...])

Submit pipeline for execution using DAG-based dependency ordering.

__init__(path, name, pype_snippets_module={'_benchmark_power': <pype.utils.snippets.Snippet object>, '_dowload_files': <pype.utils.snippets.SnippetMd object>, 'complement_fa': <pype.utils.snippets.Snippet object>, 'hello': <pype.utils.snippets.Snippet object>, 'lower_fa': <pype.utils.snippets.Snippet object>, 'merge_fa': <pype.utils.snippets.Snippet object>, 'reverse_fa': <pype.utils.snippets.Snippet object>, 'test_adv': <pype.utils.snippets.Snippet object>, 'test_base': <pype.utils.snippets.SnippetMd object>, 'test_fail_exit_code': <pype.utils.snippets.SnippetMd object>, 'test_fail_missing_output': <pype.utils.snippets.SnippetMd object>, 'test_skip_check_results_md': <pype.utils.snippets.SnippetMd object>, 'test_skip_check_results_py': <pype.utils.snippets.Snippet object>})[source]#
Parameters:
  • path (str)

  • name (str)

  • pype_snippets_module (Dict)

submit(parser, argv, queue, profile, log, progress=None, jobs=None, registry=None)[source]#

Submit pipeline for execution using DAG-based dependency ordering.

Parameters:
  • parser (ArgumentParser) – Argument parser

  • argv (List[str]) – Command line arguments

  • queue (str) – Queue system to use

  • profile (str) – Profile name

  • log (Any) – Logger instance

  • progress (Any | None) – Optional Progress tracker for resumable execution

  • jobs (List[Any] | None) – Optional list of jobs

  • registry (PipelineRegistry | None) – Optional PipelineRegistry from parent pipeline (sub-pipeline calls only)