Engine Services

The Engine Services layer provides pipeline management and execution capabilities:

• Pipeline Service - Manages pipeline definitions, validation, and execution (sync/async)

• Training Service - Trains binary SVM classifiers using training pipelines

• Token Usage Service - Extracts and tracks LLM token usage from pipeline executions

• Embedding Service - Generates document embeddings for semantic search

The PipelineService is the central orchestrator that builds and executes pipelines from YAML definitions.

Engine Services

• Pipeline Service
  • Key Components
  • Execution Flow
• Training Service
• Token Usage Service
  • Key Functions