cursus.processing.categorical.categorical_validation_processor

Categorical Validation Processor for Data Quality Checks

This module provides atomic validation of categorical data quality. Extracted from TSA data validation requirements.

class CategoricalValidationProcessor(allowed_values=None, validation_rules=None, validation_strategy='warn', report_violations=True, max_violations=None)

Bases: Processor

Validates categorical data quality and consistency.

Extracted from TSA data validation requirements.

Parameters:

• allowed_values (Dict[str, Set[Any]] | None) – Dictionary of field -> allowed values mappings

• validation_rules (Dict[str, callable] | None) – Custom validation rules

• validation_strategy (str) – ‘strict’, ‘warn’, ‘filter’

• report_violations (bool) – Whether to report validation violations

• max_violations (int | None) – Maximum allowed violations before error

fit(data)

Learn allowed values from training data if not provided

process(input_data)

Apply categorical validation

get_validation_report()

Get detailed validation report

add_allowed_values(field, values)

Add allowed values for a field

remove_allowed_values(field, values)

Remove allowed values for a field

add_validation_rule(field, rule_func, rule_name=None)

Add custom validation rule for a field

get_config()

Return processor configuration