cursus.pipeline_catalog.core.pipeline_factory

Pipeline Factory — simplified.

All pipelines follow: load DAG → compile with config → return Pipeline. No dynamic class generation needed.

create_pipeline(dag_id=None, dag_path=None, config_path=None, sagemaker_session=None, role=None)[source]

Create a pipeline from a DAG + config.

Parameters:

  • dag_id (str | None) – Shared DAG ID from catalog (e.g., “bedrock_pytorch_incremental_edx”)

  • dag_path (str | None) – Path to a .dag.json file (alternative to dag_id)

  • config_path (str) – Path to pipeline config JSON

  • sagemaker_session (Session | None) – SageMaker session

  • role (str | None) – IAM role ARN

Returns:

Tuple of (Pipeline, CompilationReport)

Return type:

Tuple[Pipeline, any]

list_available_pipelines()[source]

List all available shared DAG IDs.