Integrations
Use Databricks in Duaer
In Duaer, the Databricks node works with Databricks from a workflow. It offers 40 operations on Databricks SQL, File, Genie Agent, Job, Model Serving, Unity Catalog, and Vector Search.
Add Databricks to a Duaer workflow
- On the Duaer canvas, open the node panel, search for Databricks, and connect it after the previous node.
- Under Authentication, choose Access Token or OAuth2, then pick or create the matching credential (Databricks or Databricks OAuth2 API) in Credential to connect with. Refer to Databricks credentials.
- Pick a Resource and an Operation. For example, to execute a SQL query and wait for results, pick Databricks SQL and Execute Query.
- Fill the fields that operation shows, such as Warehouse, Query, and Query Parameters.
- If needed, select Add Option for the optional settings listed below.
- Select Execute step and check the output.
Databricks operations in Duaer
The Databricks node in Duaer offers these operations, grouped by resource:
- Databricks SQL: Execute Query
- File: Create Directory, Delete Directory, Delete File, Download File, Get File Metadata, List Directory, Upload File
- Genie Agent: Create Conversation Message, Execute Message SQL Query, Get Conversation Message, Get Genie Agent, Get Query Results, Start Conversation
- Job: Get, Get Run, Get Run Output, Run
- Model Serving: Query Endpoint
- Unity Catalog: Create Catalog, Create Function, Create Table, Create Volume, Delete Catalog, Delete Function, Delete Table, Delete Volume, Get Catalog, Get Function, Get Table, Get Volume, List Catalogs, List Functions, List Tables, List Volumes, Update Catalog
- Vector Search: Create Index, Get Index, List Indexes, Query Index
Databricks options in Duaer
Under Add Option, Databricks offers Page Size, Page Token, and Overwrite.
Use Databricks as a tool for an AI Agent in Duaer
In the Tool input of an AI Agent, search for Databricks and add it. The agent decides when to call it. For a field the model should fill, select the sparkle next to it or write $fromAI('name', 'what to put here'); fixed values stay as you set them.
Call a Databricks endpoint the node does not cover
Add an HTTP Request node, set Authentication to Predefined Credential Type, pick Databricks as the credential type, and select the same credential. Duaer signs the request with it, so you only fill in the method and URL. Refer to custom operations.
Questions
Which Databricks operations does Duaer support?
Duaer's Databricks node offers 40 operations on Databricks SQL, File, Genie Agent, Job, Model Serving, Unity Catalog, and Vector Search. For example, Databricks SQL has Execute Query.
Which credential does Databricks use in Duaer?
Duaer's Databricks uses Databricks or Databricks OAuth2 API, depending on the method you choose under Authentication.
In this section
Built-in integrations in Duaer
Built-in triggers, actions, and credentials in Duaer. Triggers start a workflow. Actions run a step after it has started.
IntegrationsRisks of community nodes in Duaer
Before you install a community node in Duaer, know the code comes from a source the instance admin trusts, and know what permissions it gets.
IntegrationsTroubleshoot community nodes in Duaer
When a Duaer community node will not install or run, check the version, permissions, and node docs, then the instance logs.
IntegrationsMake custom API calls for an app in Duaer
When a Duaer app node does not expose the API you need, use HTTP Request and reuse that app’s saved authentication.
IntegrationsIntegrations in Duaer
Built-in triggers, actions, and credentials in Duaer. Community nodes are extra packages. Custom operations reuse saved authentication with HTTP Request.
CredentialsBuilt-in credentials in Duaer
Per-service credential notes for Duaer built-ins. The create flow is in the credentials overview; node docs link to the matching service page.
Create nodesCreate a custom node for Duaer
Write a node package for Duaer when built-in nodes and custom operations are not enough and you will reuse the step.