Skip to main content

Session Processing Watermark Tracker

Tracks processing progress for JSONL session files to enable resume capability after crashes or interruptions.

Features:

  • Per-session watermark tracking
  • Chunk completion tracking
  • Status management (pending, in_progress, completed, failed)
  • Resume from last successful point
  • Atomic updates

Author: Claude + AZ1.AI License: MIT

File: watermark_tracker.py

Classes​

ProcessingStatus​

Session processing status

SessionWatermark​

Watermark for session processing progress

WatermarkTracker​

Track session processing watermarks for resume capability.

Functions​

get_watermark(session_id)​

Get watermark for session.

update_watermark(session_id, last_processed_line, total_lines, chunk_id, status, error_message)​

Update watermark for session.

mark_completed(session_id)​

Mark session as completed

mark_failed(session_id, error_message)​

Mark session as failed

reset_watermark(session_id)​

Reset watermark for session (start over)

get_progress(session_id)​

Get progress statistics for session.

list_in_progress()​

Get all in-progress sessions

list_failed()​

Get all failed sessions

list_completed()​

Get all completed sessions

Usage​

python watermark_tracker.py