Skip to main content

Data Migration

Migrate data between systems/databases including extraction, transformation, validation, incremental sync, and cutover planning.

Complexity: Complex | Duration: 30m+ | Category: Devops

Tags: data-engineering migration database etl

Workflow Diagram​

Steps​

Step 1: Source assessment​

Agent: data

engineer - Analyze source schema, volume, constraints

Step 2: Target design​

Agent: database

architect - Design target schema, mappings

Step 3: Migration strategy​

Agent: database

architect - Choose big-bang vs. phased approach

Step 4: Extract logic​

Agent: data

engineer - Export from source with checkpointing

Step 5: Transform logic​

Agent: data

engineer - Map source to target schema

Step 6: Load logic​

Agent: data

engineer - Bulk load with batch processing

Step 7: Validation​

Agent: testing

specialist - Row count, checksum, sampling validation

Step 8: Cutover plan​

Agent: database

architect - Document cutover steps, rollback, downtime

Usage​

To execute this workflow:

/workflow devops/data-migration.workflow

See other workflows in this category for related automation patterns.