Leverage Helios to see how flows propagate through the components of your application - including microservices and notebooks, how they are connected, and what is triggering and is triggered by the notebook.


Add Helios to your Databricks cluster

Install the Helios SDK as a library on your cluster.


The, edit the cluster configuration and add the following environment variables under Advanced options > Spark > Environment variables:

HS_TOKEN=<API_TOKEN> # TODO: Replace value with API token from Helios.
HS_SERVICE_NAME=<SERVICE_NAME> # TODO: Replace value with service name.
HS_ENVIRONMENT=<ENVIRONMENT_NAME> # TODO: Replace value with service environment.

E2E flows in Helios

Run a job on the cluster and see your Databricks data in Helios.
It is recommended to add custom spans to your Databricks notebooks for increased visibility in Helios.

Did this page help you?