cursus.mods.exe_doc.data_uploading_helper

Data Uploading Helper for execution document generation.

This module provides the DataUploadingHelper class that extracts execution document configurations from DataUploading step configurations.

class DataUploadingHelper[source]

Bases: ExecutionDocumentHelper

Helper for extracting execution document configurations from DataUploading steps.

Unlike CradleDataLoadingHelper (which builds Coral model objects and serializes), this helper is simple: DataUploadingConfig.job_config already produces the exact dict expected by the execution document / CreateDataUploadJobRequest.

can_handle_step(step_name, config)[source]

Check if this helper can handle the given step configuration.

Parameters:

  • step_name (str) – Name of the step

  • config – Step configuration object

Returns:

True if this helper can handle the configuration, False otherwise

Return type:

bool

get_execution_step_name(step_name, config)[source]

Get execution document step name.

DataUploading steps don’t typically have job_type variants, so the step name is used as-is or with minor normalization.

Parameters:

  • step_name (str) – Original step name from DAG

  • config – Configuration object

Returns:

Execution document step name

Return type:

str

extract_step_config(step_name, config)[source]

Extract execution document configuration from DataUploading step config.

This is straightforward: DataUploadingConfig.job_config already assembles the exact dict needed for the execution document (matches the sample_config format expected by DataUploadProcessor’s JSON Schema validation).

Parameters:

  • step_name (str) – Name of the step

  • config – DataUploading configuration object

Returns:

Dictionary containing the execution document configuration

Raises:

ExecutionDocumentGenerationError – If configuration extraction fails

Return type:

Dict[str, Any]