Skip to main content

Batch Processing Pipeline - CODITECT Adapter

Implements the staged batch processing pipeline pattern from Agent-Skills-for-Context-Engineering for LLM-powered batch processing.

Usage: python3 scripts/context-engineering/batch_pipeline.py --init PROJECT_DIR python3 scripts/context-engineering/batch_pipeline.py --run PROJECT_DIR --stage acquire python3 scripts/context-engineering/batch_pipeline.py --status PROJECT_DIR

Source: external/Agent-Skills-for-Context-Engineering/skills/project-development/scripts/

File: batch_pipeline.py

Classes

Stage

Pipeline stages.

StageConfig

Configuration for a pipeline stage.

CoditechBatchPipeline

CODITECT-integrated batch processing pipeline.

Functions

main()

No description

initialize(items, config)

Initialize a new pipeline project.

run(stage, items, dry_run)

Run pipeline for specified stage and items.

status()

Get pipeline status.

estimate_cost(items, tokens_per_item, price_per_1k_tokens)

Estimate processing costs.

register_handler(stage, handler)

Register a custom handler for a stage.

Usage

python batch_pipeline.py