Duaer

Integrations

Use Databricks in Duaer

In Duaer, the Databricks node works with Databricks from a workflow. It offers 40 operations on Databricks SQL, File, Genie Agent, Job, Model Serving, Unity Catalog, and Vector Search.

Add Databricks to a Duaer workflow

  1. On the Duaer canvas, open the node panel, search for Databricks, and connect it after the previous node.
  2. Under Authentication, choose Access Token or OAuth2, then pick or create the matching credential (Databricks or Databricks OAuth2 API) in Credential to connect with. Refer to Databricks credentials.
  3. Pick a Resource and an Operation. For example, to execute a SQL query and wait for results, pick Databricks SQL and Execute Query.
  4. Fill the fields that operation shows, such as Warehouse, Query, and Query Parameters.
  5. If needed, select Add Option for the optional settings listed below.
  6. Select Execute step and check the output.

Databricks operations in Duaer

The Databricks node in Duaer offers these operations, grouped by resource:

  • Databricks SQL: Execute Query
  • File: Create Directory, Delete Directory, Delete File, Download File, Get File Metadata, List Directory, Upload File
  • Genie Agent: Create Conversation Message, Execute Message SQL Query, Get Conversation Message, Get Genie Agent, Get Query Results, Start Conversation
  • Job: Get, Get Run, Get Run Output, Run
  • Model Serving: Query Endpoint
  • Unity Catalog: Create Catalog, Create Function, Create Table, Create Volume, Delete Catalog, Delete Function, Delete Table, Delete Volume, Get Catalog, Get Function, Get Table, Get Volume, List Catalogs, List Functions, List Tables, List Volumes, Update Catalog
  • Vector Search: Create Index, Get Index, List Indexes, Query Index

Databricks options in Duaer

Under Add Option, Databricks offers Page Size, Page Token, and Overwrite.

Use Databricks as a tool for an AI Agent in Duaer

In the Tool input of an AI Agent, search for Databricks and add it. The agent decides when to call it. For a field the model should fill, select the sparkle next to it or write $fromAI('name', 'what to put here'); fixed values stay as you set them.

Call a Databricks endpoint the node does not cover

Add an HTTP Request node, set Authentication to Predefined Credential Type, pick Databricks as the credential type, and select the same credential. Duaer signs the request with it, so you only fill in the method and URL. Refer to custom operations.

Questions

Which Databricks operations does Duaer support?

Duaer's Databricks node offers 40 operations on Databricks SQL, File, Genie Agent, Job, Model Serving, Unity Catalog, and Vector Search. For example, Databricks SQL has Execute Query.

Which credential does Databricks use in Duaer?

Duaer's Databricks uses Databricks or Databricks OAuth2 API, depending on the method you choose under Authentication.

In this section