Skip to content

Configuration

Sergio Soto edited this page Apr 8, 2026 · 2 revisions

Configuration

All configuration via environment variables in the pipeline deployment.

S3 Access (Required)

Variable Description
S3_ENDPOINT VAST S3 data VIP (e.g., http://172.200.201.67). No trailing slash.
S3_ACCESS_KEY S3 access key for source bucket
S3_SECRET_KEY S3 secret key

VAST DataBase

Variable Description Default
VAST_DB_ENDPOINT DataBase endpoint Falls back to S3_ENDPOINT
VAST_DB_ACCESS_KEY DataBase access key Falls back to S3_ACCESS_KEY
VAST_DB_SECRET_KEY DataBase secret key Falls back to S3_SECRET_KEY
VAST_DB_BUCKET Database-enabled bucket sergio-db
VAST_DB_SCHEMA Schema name (shared with exr-inspector) exr_metadata_2

Kafka

Variable Description Default
KAFKA_BROKER Kafka broker address vastbroker:9092
KAFKA_TOPIC Topic for proxy completion events spaceharbor.proxy

Processing

Variable Description Default
OCIO_CONFIG_PATH Optional OCIO config file. If set and valid, enables ACES colorspace names. If unset or missing, uses oiiotool built-in transforms (linear, sRGB, Rec709). (unset)
OIIO_TIMEOUT Subprocess timeout in seconds for oiiotool and ffmpeg 300
DEV_MODE Skip Kafka publishing and S3 uploads when true false

Deployment Resources

Resource Recommended Notes
CPU request 500m ffmpeg + color transform are CPU-bound
CPU limit 2000m ffmpeg parallelizes internally
Memory request 512Mi Full EXR in memory for color transform
Memory limit 2Gi 4K EXR + resize intermediates
Ephemeral disk 5Gi Source download + intermediates + outputs
Timeout 600s 4K EXR encode can take 30-60s
RPS factor 1 One file per pod (CPU-bound)
minScale 1 Avoid cold start (loads oiiotool + ffmpeg)
maxScale 5 Cap memory (5 pods x 2GB = 10GB)
Delivery unordered Each file is independent
Scale-down delay 60s Avoid thrashing during burst ingestion

Pipeline Environment Variables (VMS UI)

Variable Example Value
S3_ENDPOINT http://172.200.201.67
S3_ACCESS_KEY your access key
S3_SECRET_KEY your secret key
VAST_DB_BUCKET sergio-db
VAST_DB_SCHEMA exr_metadata_2
DEV_MODE false

Clone this wiki locally