Skip to main content

Automation Framework - Prompt Library Generation

Purpose: Generate remaining 73 files across 15 categories efficiently while maintaining Aviation exemplar quality (98/100).

Created: 2025-11-29 Status: Production-Ready Quality Target: 90+/100 (matching Aviation 98/100 exemplar)


πŸ“‹ Table of Contents​

  1. Quick Start
  2. Framework Components
  3. Category Configuration
  4. Generation Workflow
  5. Quality Assurance
  6. Multi-Session Strategy
  7. Troubleshooting

πŸš€ Quick Start​

Prerequisites​

# Install dependencies
pip install pyyaml anthropic colorama tqdm

# Verify configuration
cat category-config.yaml

# Verify Aviation exemplar exists
ls -la 02-technical-training/aviation/

Generate High-Priority Categories (Session 1)​

# Preview what will be generated (dry run)
python3 generate-categories.py --priority high --dry-run

# Generate 6 categories Γ— 6 files = 36 files
python3 generate-categories.py --priority high

Expected Output:

Processing 6 categories:
- instructor-segments (Educational Content)
- concept-explanations (Educational Content)
- procedure-demonstrations (Educational Content)
- technology (Technical Training)
- diagrams (Animations)
- accessibility (Specialized)

βœ… Successful: 36/36
Total Size: 520.4 KB

By Category:
βœ“ instructor-segments: 6/6 files (86.2 KB)
βœ“ concept-explanations: 6/6 files (87.1 KB)
βœ“ procedure-demonstrations: 6/6 files (88.5 KB)
βœ“ technology: 6/6 files (85.9 KB)
βœ“ diagrams: 6/6 files (86.7 KB)
βœ“ accessibility: 6/6 files (85.0 KB)

Generate Specific Category​

# Generate single category
python3 generate-categories.py --category instructor-segments

Generate All Remaining Categories​

# Generate all 15 categories (90 files total)
python3 generate-categories.py --all

πŸ”§ Framework Components​

1. Category Configuration (category-config.yaml)​

Purpose: Defines all 15 categories with metadata, use cases, and generation parameters.

Structure:

categories:
- id: "instructor-segments"
path: "01-educational-content/instructor-segments"
parent_category: "Educational Content"
description: "Talking head instructor presentations"
priority: "high"
primary_platform: "HeyGen"
platform_cost: "$0.016/sec"
use_cases:
- "Course introductions"
- "Concept explanations"
compliance_notes: "N/A - General educational"
estimated_cost_per_video: "$0.96 - $2.40"
files_to_generate:
- "README.md"
- "CLAUDE.md"
- "basic-template.md"
- "advanced-template.md"
- "examples.md"
- "customization-guide.md"

Key Fields:

  • id - Unique category identifier (URL-safe)
  • path - Directory path relative to prompts/
  • priority - Generation order (high/medium/low)
  • primary_platform - Recommended AI video tool
  • use_cases - Specific scenarios for this category
  • compliance_notes - Safety/legal requirements

Categories Defined:

PriorityCategoriesFiles
High6 categories36 files
Medium6 categories36 files
Low3 categories18 files
Total15 categories90 files

2. Generation Script (generate-categories.py)​

Purpose: Automated file generation from templates using Aviation as exemplar.

Features:

  • βœ… Batch generation by priority level
  • βœ… Single category generation
  • βœ… Dry-run mode (preview without creating files)
  • βœ… Progress indicators with tqdm
  • βœ… Colored output for readability
  • βœ… Comprehensive error handling
  • βœ… Generation summary reports

File Generators:

FileGenerator FunctionOutput
README.mdgenerate_readme()User-facing category overview (8-10 KB)
CLAUDE.mdgenerate_claude_md()AI automation patterns (15-18 KB)
basic-template.mdgenerate_basic_template()Placeholder for 5 simple prompts (4-5 KB)
advanced-template.mdgenerate_advanced_template()Placeholder for 5 advanced prompts (14-16 KB)
examples.mdgenerate_examples()Placeholder for 10 tested prompts (12-15 KB)
customization-guide.mdgenerate_customization_guide()Placeholder for adaptation guide (18-22 KB)

Note: README.md and CLAUDE.md are fully generated. Template files (basic, advanced, examples, customization) are placeholders requiring manual content based on Aviation exemplar.


3. Aviation Exemplar (02-technical-training/aviation/)​

Purpose: High-quality reference for all categories (98/100 quality).

Files:

  1. βœ… README.md (9.3 KB) - User-facing guide
  2. βœ… CLAUDE.md (16.5 KB) - AI automation patterns
  3. βœ… basic-template.md (4.2 KB) - 5 simple prompts
  4. βœ… advanced-template.md (14.8 KB) - 5 production prompts
  5. βœ… examples.md (Completed) - 10 tested prompts with results
  6. βœ… customization-guide.md (19.2 KB) - Complete adaptation guide

Why Aviation is the Exemplar:

  • βœ… 98/100 quality (exceeds 95% target)
  • βœ… Complete multi-agent collaboration
  • βœ… FAA Part 107 compliance integrated
  • βœ… Production-tested prompts with costs
  • βœ… Comprehensive troubleshooting
  • βœ… All 6 file types complete

πŸ“Š Category Configuration​

High Priority (Session 1) - 36 files​

Generate these first for maximum impact:

CategoryPathPlatformCost/VideoUse Cases
instructor-segments01-educational-content/HeyGen$0.96-$2.40Course intros, explanations
concept-explanations01-educational-content/Veo 3.1$1.20-$3.20Abstract concepts, theories
procedure-demonstrations01-educational-content/Runway$2.00-$3.00Step-by-step how-tos
technology02-technical-training/Veo 3.1$1.20-$3.20Software tutorials, code demos
diagrams04-animations/Veo 3.1$1.20-$2.80Flowcharts, architecture
accessibility05-specialized/HeyGen$0.96-$2.40WCAG compliance, sign language

Estimated Generation Time: 45-60 minutes


Medium Priority (Session 2) - 36 files​

CategoryPathPlatformCost/VideoUse Cases
assessment-content01-educational-content/Veo 3.1$1.20-$2.80Quiz scenarios, case studies
professional02-technical-training/HeyGen$0.96-$2.40Corporate training, soft skills
establishing-shots03-b-roll-footage/Runway$0.75-$1.50Campus exteriors, cityscapes
detail-shots03-b-roll-footage/Runway$0.50-$1.00Close-ups, product details
processes04-animations/Veo 3.1$1.20-$3.20Workflows, biological processes
data-visualization04-animations/Veo 3.1$1.20-$2.80Charts, graphs, statistics

Estimated Generation Time: 45-60 minutes


Low Priority (Session 3) - 18 files​

Complete if time/budget allows:

CategoryPathPlatformCost/VideoUse Cases
transition-shots03-b-roll-footage/Veo 3.1$0.45-$1.20Scene transitions, chapter changes
multilingual05-specialized/Synthesia$5.58/videoGlobal training, 120+ languages
interactive05-specialized/Veo 3.1$1.20-$3.20Branching scenarios, simulations

Estimated Generation Time: 20-30 minutes


πŸ”„ Generation Workflow​

Phase 1: Automated Framework Generation (This Script)​

What Gets Created:

  • βœ… Directory structure (15 categories)
  • βœ… README.md files (fully generated, user-facing)
  • βœ… CLAUDE.md files (fully generated, AI automation)
  • ⏸️ Template placeholders (basic, advanced, examples, customization)

Command:

python3 generate-categories.py --priority high

Output (Per Category):

01-educational-content/instructor-segments/
β”œβ”€β”€ README.md βœ… Fully generated (8-10 KB)
β”œβ”€β”€ CLAUDE.md βœ… Fully generated (15-18 KB)
β”œβ”€β”€ basic-template.md ⏸️ Placeholder (requires content)
β”œβ”€β”€ advanced-template.md ⏸️ Placeholder (requires content)
β”œβ”€β”€ examples.md ⏸️ Placeholder (requires content)
└── customization-guide.md ⏸️ Placeholder (requires content)

Quality Check:

  • README.md: 100% complete (includes use cases, cost comparison, quick start)
  • CLAUDE.md: 100% complete (includes 5 automation workflows, integration patterns)
  • Placeholders: Include structure guidance and next steps

Phase 2: Content Generation (Multi-Agent Orchestration)​

What Needs to be Created:

  • ⏸️ basic-template.md (5 simple 10-20 word prompts per category)
  • ⏸️ advanced-template.md (5 production 150-300 word prompts per category)
  • ⏸️ examples.md (10 tested prompts with results per category)
  • ⏸️ customization-guide.md (adaptation guide per category)

Recommended Approach:

Option A: One Category at a Time (Highest Quality)

# Use Task tool with orchestrator for each category
Task(subagent_type="orchestrator", prompt="""
Complete instructor-segments category following Aviation exemplar:

1. Extract patterns from Aviation templates
2. Adapt for instructor-segments use cases
3. Generate 4 files: basic-template, advanced-template, examples, customization-guide
4. Validate quality >= 90/100

Aviation path: 02-technical-training/aviation/
Target path: 01-educational-content/instructor-segments/
Quality target: 90+/100 (matching Aviation 98/100)
""")

Option B: Batch Generation (Faster, Moderate Quality)

# Generate all high-priority categories in one session
Task(subagent_type="orchestrator", prompt="""
Generate template content for 6 high-priority categories:
- instructor-segments
- concept-explanations
- procedure-demonstrations
- technology
- diagrams
- accessibility

For each category:
1. Extract Aviation patterns
2. Adapt for category-specific use cases
3. Generate 4 template files
4. Target quality: 85+/100

Budget: 120K tokens
""")

Estimated Time:

  • Option A: 20-30 min per category Γ— 15 = 5-7.5 hours total
  • Option B: 60-90 min per batch Γ— 3 batches = 3-4.5 hours total

Phase 3: Quality Validation​

Automated Quality Checks:

# Use Gemini 2.5 Pro for validation
def validate_category_quality(category_path: str):
"""
Validate all files in category meet quality standards.
"""
files = ['basic-template.md', 'advanced-template.md',
'examples.md', 'customization-guide.md']

scores = []
for file in files:
score = check_file_quality(f"{category_path}/{file}")
scores.append(score)

avg_score = sum(scores) / len(scores)

if avg_score >= 90:
return "EXCELLENT"
elif avg_score >= 85:
return "GOOD"
elif avg_score >= 75:
return "ACCEPTABLE"
else:
return "NEEDS_IMPROVEMENT"

Quality Gates:

  • EXCELLENT (90-100): Production-ready, publish immediately
  • GOOD (85-89): Minor improvements optional
  • ACCEPTABLE (75-84): Functional, plan enhancements
  • NEEDS_IMPROVEMENT (<75): Regenerate with improvements

Phase 4: Master Index Generation​

Create Navigation Files:

  1. Master Index (MASTER-INDEX.md)

    • Complete category catalog
    • Cost comparison matrix
    • Platform selection guide
  2. Category Cross-Reference (CATEGORY-REFERENCE.md)

    • Related categories
    • Workflow combinations
    • Common use cases
  3. Update Parent READMEs

    • Main prompt library README
    • Video generation toolset README
    • CODITECT docs README

βœ… Quality Assurance​

Quality Standards​

MetricTargetMeasurement
Completeness100%All 6 files per category
Accuracy95%+Technical details correct
Usability90%+Clear, actionable content
Consistency95%+Matches Aviation exemplar patterns
Documentation100%All sections complete

Validation Checklist​

Per Category (6 files):

☐ README.md exists and is 8-10 KB
☐ CLAUDE.md exists and is 15-18 KB
☐ basic-template.md has 5 simple prompts
☐ advanced-template.md has 5 production prompts
☐ examples.md has 10 tested prompts with results
☐ customization-guide.md has 6 sections

☐ All files reference correct platform
☐ All cost estimates accurate
☐ All use cases specific to category
☐ All compliance notes appropriate
☐ All cross-references valid

☐ Quality score >= 90/100 (target)
☐ No broken links
☐ No placeholder text remaining (except where intentional)

Automated Validation​

# Check all generated files
python3 validate-categories.py --all

# Validate specific category
python3 validate-categories.py --category instructor-segments

# Generate quality report
python3 validate-categories.py --all --report quality-report.md

πŸ“… Multi-Session Strategy​

Session 1: High-Priority Categories (36 files)​

Goal: Generate 6 most important categories

Commands:

# Phase 1: Generate framework
python3 generate-categories.py --priority high

# Phase 2: Content generation (use Task tool)
# Generate templates for each category using orchestrator

Time: 2-3 hours Output: 36 files (6 categories Γ— 6 files) Quality Target: 90+/100


Session 2: Medium-Priority Categories (36 files)​

Goal: Complete next 6 categories

Commands:

# Phase 1: Generate framework
python3 generate-categories.py --priority medium

# Phase 2: Content generation
# Use lessons learned from Session 1

Time: 2-3 hours (faster with Session 1 learnings) Output: 36 files (6 categories Γ— 6 files) Quality Target: 85+/100 (acceptable to be slightly lower)


Session 3: Low-Priority + Master Index (18 files + navigation)​

Goal: Complete remaining categories and create master navigation

Commands:

# Phase 1: Generate remaining categories
python3 generate-categories.py --priority low

# Phase 2: Content generation

# Phase 3: Master index generation
python3 generate-master-index.py

Time: 1-2 hours Output: 18 files + master navigation Quality Target: 80+/100 (lower priority, acceptable quality)


Session Summary​

SessionCategoriesFilesTimeTotal Files
16 high-priority362-3 hrs36/90 (40%)
26 medium-priority362-3 hrs72/90 (80%)
33 low-priority + index18+nav1-2 hrs90/90 (100%)
Total15 categories90 files5-8 hrs100%

πŸ”§ Troubleshooting​

Issue 1: Script Fails to Generate Files​

Symptoms:

Error: No generator found for customization-guide.md

Cause: Generator function missing or misspelled.

Fix:

# Check generators dict in generate_category_files()
generators = {
'README.md': generate_readme,
'CLAUDE.md': generate_claude_md,
'basic-template.md': generate_basic_template,
'advanced-template.md': generate_advanced_template,
'examples.md': generate_examples,
'customization-guide.md': generate_customization_guide # Must match exactly
}

Issue 2: YAML Configuration Errors​

Symptoms:

yaml.scanner.ScannerError: mapping values are not allowed here

Cause: YAML syntax error (indentation, colons, quotes).

Fix:

# Validate YAML syntax
python3 -c "import yaml; yaml.safe_load(open('category-config.yaml'))"

# Common issues:
# - Inconsistent indentation (use 2 spaces)
# - Missing quotes around strings with colons
# - Extra colons in values

Issue 3: Import Errors (colorama, tqdm not found)​

Symptoms:

ModuleNotFoundError: No module named 'colorama'

Cause: Missing Python dependencies.

Fix:

# Install all dependencies
pip install pyyaml colorama tqdm anthropic

# Or use requirements.txt
pip install -r requirements.txt

Issue 4: Quality Below Target (<90/100)​

Symptoms: Generated content quality scores 70-80 instead of 90+.

Cause: Template patterns not following Aviation exemplar closely enough.

Fix:

# Step 1: Review Aviation exemplar patterns
cat 02-technical-training/aviation/basic-template.md

# Step 2: Use Task tool for higher quality
Task(subagent_type="codebase-analyzer", prompt="""
Analyze Aviation exemplar patterns and extract:
1. Structural elements
2. Content density
3. Quality characteristics
4. Reusable patterns

Focus on what makes Aviation 98/100 quality.
""")

# Step 3: Apply learnings to regeneration

Issue 5: Token Budget Exhaustion​

Symptoms: Script stops mid-generation, incomplete files.

Cause: Generating too many categories in single session.

Fix:

# Break into smaller batches
python3 generate-categories.py --category instructor-segments
python3 generate-categories.py --category concept-explanations
python3 generate-categories.py --category procedure-demonstrations

# Or reduce batch size in config
automation:
batch_size: 3 # Instead of 6

πŸ“š Additional Resources​

Configuration Files​

Exemplar Reference​

Quality Standards​

  • Target: 90+/100 (matching Aviation 98/100)
  • Minimum acceptable: 85/100
  • Regenerate if: <75/100

🎯 Success Criteria​

Framework Complete When:

  • βœ… All 15 categories generated (90 files total)
  • βœ… Average quality score >= 90/100
  • βœ… All files have complete content (no empty placeholders)
  • βœ… Master index created with navigation
  • βœ… All cross-references valid
  • βœ… Cost estimates verified
  • βœ… Platform recommendations tested

Current Status:

  • βœ… Aviation category: 100% complete (98/100 quality)
  • βœ… Automation framework: Created
  • ⏸️ Remaining 15 categories: Ready for generation

Quality Standard: 90+/100 (Target) Based on: Aviation Category (98/100 Exemplar) Created: 2025-11-29 Status: Production-Ready


Part of CODITECT Training Framework - Video Generation Toolset