Integrations
Start a Duaer workflow with Databricks Trigger
In Duaer, Databricks Trigger starts a workflow by checking Databricks on a schedule you set. It can listen for 3 events, such as Run Failed, Run Started, and Run Succeeded.
Start a Duaer workflow with Databricks Trigger
- On the Duaer canvas, open the node panel, search for Databricks Trigger, and add it as the first node.
- Under Authentication, choose Access Token or OAuth2, then pick or create the matching credential (Databricks or Databricks OAuth2 API) in Credential to connect with.
- Pick the events that should start a run, for example Run Failed or Run Started.
- Check Poll Times and Simplify on the node.
- Set Poll Times, select Execute step to fetch a sample, then publish the workflow so Duaer checks Databricks on that schedule.
Events that start a Duaer workflow with Databricks Trigger
- Run Failed: A run ended with any result other than a full success, including cancelled, skipped and partly failed runs.
- Run Started: A new run of the job was seen.
- Run Succeeded: A run ended with every task successful.
Databricks Trigger parameters in Duaer
- Poll Times: Time at which polling should occur.
- Simplify: Whether to return a simplified version of the response instead of the raw data.
Questions
Which Databricks Trigger events can start a Duaer workflow?
Duaer's Databricks Trigger can listen for 3 events, including Run Failed, Run Started, and Run Succeeded. Pick one or more on the node.
Does Databricks Trigger run before the Duaer workflow is published?
Only while you test with Execute step. After you publish, Duaer polls Databricks on the Poll Times schedule.
Which credential does Databricks Trigger use in Duaer?
Duaer's Databricks Trigger uses Databricks or Databricks OAuth2 API, depending on the method you choose under Authentication.
In this section
Built-in integrations in Duaer
Built-in triggers, actions, and credentials in Duaer. Triggers start a workflow. Actions run a step after it has started.
IntegrationsRisks of community nodes in Duaer
Before you install a community node in Duaer, know the code comes from a source the instance admin trusts, and know what permissions it gets.
IntegrationsTroubleshoot community nodes in Duaer
When a Duaer community node will not install or run, check the version, permissions, and node docs, then the instance logs.
IntegrationsMake custom API calls for an app in Duaer
When a Duaer app node does not expose the API you need, use HTTP Request and reuse that app’s saved authentication.
IntegrationsIntegrations in Duaer
Built-in triggers, actions, and credentials in Duaer. Community nodes are extra packages. Custom operations reuse saved authentication with HTTP Request.
CredentialsBuilt-in credentials in Duaer
Per-service credential notes for Duaer built-ins. The create flow is in the credentials overview; node docs link to the matching service page.
Create nodesCreate a custom node for Duaer
Write a node package for Duaer when built-in nodes and custom operations are not enough and you will reuse the step.