Skip to main content

WF-RESEARCH-PIPELINE: Autonomous Research Pipeline

Workflow ID: WF-RP-001 Pattern: Orchestrator-Workers with Batched Parallelization Trigger: /research-pipeline, /deep-dive, /rp


Workflow Diagram


Agent Dispatch Table

BatchAgentTask Tool TypeModelInputOutput
0research-web-crawlerweb-search-researcherSonnetURLs, GitHub, docsresearch-context.json
1research-quick-start-generatorresearch-agentHaikuresearch-context.json1-2-3-detailed-quick-start.md
1research-impact-analyzerresearch-agentSonnetresearch-context.jsoncoditect-impact.md
1research-exec-summary-writerresearch-agentSonnetresearch-context.jsonexecutive-summary.md
2research-sdd-generatorsoftware-design-document-specialistSonnetcontext + batch 1sdd.md
2research-tdd-generatorresearch-agentSonnetcontext + batch 1tdd.md
2research-c4-modelerresearch-agentSonnetcontext + batch 1c4-architecture.md
3research-adr-generatorresearch-agentSonnetresearch-context.jsonadrs/
3research-glossary-builderresearch-agentHaikuresearch-context.jsonglossary.md
3research-mermaid-creatorresearch-agentHaikuresearch-context.jsonmermaid-diagrams.md
4research-dashboard-generatorresearch-agentSonnetall phase 1 artifactsdashboards/ (4 files)
5research-dashboard-generatorresearch-agentSonnetall phase 1 artifactsdashboards/ (2 files)
research-ideation-generatorresearch-agentSonnetall artifactsfollow-up-prompts.md
research-quality-validatorresearch-agentSonnetall artifactsquality report
research-artifact-aggregatorresearch-agentHaikuphase 1 artifactsstructured data

Batch Dependencies

Batch 0 ──→ Batch 1 ──→ Batch 2 ──→ Quality Gate 1 ──→ Batch 4 ──→ Batch 5 ──→ Phase 3
└──→ Batch 3 ──┘ └──→ Phase 4

Rules:

  • Batch N+1 cannot start until Batch N completes
  • Batches 2 and 3 run in parallel (no cross-dependency)
  • Phase 2 (dashboards) requires ALL Phase 1 artifacts
  • Phase 3 requires Phase 1 + 2
  • Phase 4 requires Phase 1 + 2 + 3

Token Budget

PhaseAgentsEst. TokensModel Mix
Phase 00~200
Batch 01~8,000Sonnet
Batch 13~12,000Haiku + 2 Sonnet
Batch 23~15,0003 Sonnet
Batch 33~8,000Sonnet + 2 Haiku
Phase 24-6~20,0004-6 Sonnet
Phase 31~5,000Sonnet
Quality1-2~3,000Sonnet
Total16-18~71,00040% Haiku, 55% Sonnet, 5% Opus

Error Recovery

FailureDetectionRecovery
Agent timeoutTaskOutput timeoutRetry with increased timeout
Agent produces empty outputFile size checkRetry once with Opus
Quality gate failsValidator agentRe-run failed artifacts
All agents in batch failBatch completion checkAbort pipeline, save partial
Genesis handoff fails/new-project errorSave brief, suggest manual

Configuration

# pipeline-config.json
{
"topic": "Temporal.io workflow engine",
"sources": {
"urls": ["https://temporal.io/docs"],
"github": ["https://github.com/temporalio/temporal"],
"docs": "./reference-docs/",
"originals": null
},
"output_dir": "analyze-new-artifacts/temporal-io/artifacts/",
"extended": true,
"genesis": false,
"batch_size": 3,
"model_override": null,
"skip_phases": []
}


Created: 2026-02-16 Author: Hal Casteel, CEO/CTO AZ1.AI Inc. Owner: AZ1.AI INC


Copyright 2026 AZ1.AI Inc.