Skip to main content
Run a PySpark job on oleander-managed infrastructure in a few minutes. Lineage, cost, and run context are captured automatically from the first execution.

​
Install the CLI

brew tap OleanderHQ/tap
brew install oleander-cli

​
Configure your API key

Authenticate with the API key from your oleander settings. 
oleander configure --api-key <YOUR_API_KEY>

​
Initialize a workspace

Create a new PySpark job workspace: 
oleander spark init my-job
cd my-job
The workspace includes entrypoint.py, a mylib/ package directory, and a Makefile for building deployable artifacts. Install dependencies and build: 
uv sync --dev
make
This produces out/pyfiles.zip and out/environment.tar.gz for upload.

​
Upload and submit

Upload your entrypoint and dependencies, then submit a run: 
oleander spark jobs upload entrypoint.py \
  --py-files out/pyfiles.zip \
  --virtualenv out/environment.tar.gz

oleander spark jobs submit entrypoint.py \
  --namespace my-namespace \
  --name my-first-job \
  --wait
When the run finishes, open Runs in the oleander app to inspect timing, lineage, and cost attribution.

​
Next steps

Spark jobs reference

Upload artifacts, submit runs, and register your own Spark clusters

CLI reference

Full oleander spark commands for init, upload, submit, and clusters