Databricks

Leverage Helios to see how flows propagate through the components of your application - including microservices and notebooks, how they are connected, and what is triggering and is triggered by the notebook.

800800

Add Helios to your Databricks cluster

Install the Helios SDK as a library on your cluster.

609609

The, edit the cluster configuration and add the following environment variables under Advanced options > Spark > Environment variables:

AUTOWRAPT_BOOTSTRAP=helios
HS_TOKEN=<API_TOKEN> # TODO: Replace value with API token from Helios.
HS_SERVICE_NAME=<SERVICE_NAME> # TODO: Replace value with service name.
HS_ENVIRONMENT=<ENVIRONMENT_NAME> # TODO: Replace value with service environment.
HS_DATABRICKS=True
791791

E2E flows in Helios

Run a job on the cluster and see your Databricks data in Helios.
It is recommended to add custom spans to your Databricks notebooks for increased visibility in Helios.


Did this page help you?