Duaer

Integrations

Start a Duaer workflow with Databricks Trigger

In Duaer, Databricks Trigger starts a workflow by checking Databricks on a schedule you set. It can listen for 3 events, such as Run Failed, Run Started, and Run Succeeded.

Start a Duaer workflow with Databricks Trigger

  1. On the Duaer canvas, open the node panel, search for Databricks Trigger, and add it as the first node.
  2. Under Authentication, choose Access Token or OAuth2, then pick or create the matching credential (Databricks or Databricks OAuth2 API) in Credential to connect with.
  3. Pick the events that should start a run, for example Run Failed or Run Started.
  4. Check Poll Times and Simplify on the node.
  5. Set Poll Times, select Execute step to fetch a sample, then publish the workflow so Duaer checks Databricks on that schedule.

Events that start a Duaer workflow with Databricks Trigger

  • Run Failed: A run ended with any result other than a full success, including cancelled, skipped and partly failed runs.
  • Run Started: A new run of the job was seen.
  • Run Succeeded: A run ended with every task successful.

Databricks Trigger parameters in Duaer

  • Poll Times: Time at which polling should occur.
  • Simplify: Whether to return a simplified version of the response instead of the raw data.

Questions

Which Databricks Trigger events can start a Duaer workflow?

Duaer's Databricks Trigger can listen for 3 events, including Run Failed, Run Started, and Run Succeeded. Pick one or more on the node.

Does Databricks Trigger run before the Duaer workflow is published?

Only while you test with Execute step. After you publish, Duaer polls Databricks on the Poll Times schedule.

Which credential does Databricks Trigger use in Duaer?

Duaer's Databricks Trigger uses Databricks or Databricks OAuth2 API, depending on the method you choose under Authentication.

In this section