Engine Services

The Engine Services layer provides pipeline management and execution capabilities:

  • Pipeline Service - Manages pipeline definitions, validation, and execution (sync/async)

  • Token Usage Service - Extracts and tracks LLM token usage from pipeline executions

  • Embedding Service - Generates document embeddings for semantic search

  • Haystack Enterprise Service - Executes pipelines via Haystack Enterprise API

The PipelineService is the central orchestrator that builds and executes pipelines from YAML definitions.