Architecture
services/resources/
services/engine/
services/haystack/
services/shared/
API Layer
Service Layer
extract_token_usage_from_pipeline_result()
aggregate_token_usage()
infer_provider_from_model()
Task Processing
Data Layer
Authentication
Utilities
Development
user: Standard user access
admin: Administrative access
Endpoints can require specific scopes using FastAPI dependencies.
New scopes can be added by:
Adding to user model
Updating JWT generation
Creating new dependency functions