A curated read of the Databricks docs product-update feed, scoped to the six things a bank-finance SQL/BI analyst actually does — modeling, quality, Power BI, Genie, agent skills, apps. Re-queried hourly.
Configuring telemetry for your Databricks apps is now generally available. Databricks Apps telemetry collects traces, logs, and metrics and persists them to Unity Catalog tables using the OpenTelemetry (OTel) protocol. After you enable app telemetry, Databricks automatically capt
Metastore-level ABAC policies are in Beta in Unity Catalog. You can now attach an ABAC policy (row filter, column mask, GRANT, or DENY) at the metastore level, so a single policy applies across every catalog in the metastore, including catalogs created later. This gives governanc
Genie One now supports account-only users, so users in a registered identity provider can access account-level Genie One without being assigned to a workspace or granted consumer access. When enabled, eligible users are enrolled automatically. Unity Catalog continues to govern wh
Data Classification can now scan Unity Catalog views in addition to tables, classifying columns for sensitive data using the same detection engine. This is a Beta feature. See Classify views.
Attribute-based access control (ABAC) row filters and column masks now extend to views, in addition to tables. This lets you use ABAC policies to control access to sensitive data exposed through views. Account admins can enable the ABAC on Views preview from the account console's
In early October 2026, running JAR tasks on serverless compute will be automatically enabled for workspaces with the compliance security profile enabled. Package your Java or Scala Spark code in a JAR and run it as a JAR task on serverless compute in a Lakeflow Job, without provi
You can now set performance_target to STANDARD in the Jobs API. Apache Airflow's DatabricksSubmitRunOperator also supports this. See Create and trigger a one-time run and Select a performance mode.
Restore the Python variables and Spark session from a serverless compute job run into a new interactive notebook, so you can debug a failure or explore results without rerunning the entire job. Databricks captures the snapshot automatically for eligible runs. See Session restore
In late September 2026, Genie Agents will be restricted to using only the data sources explicitly attached under the agent's Sources. Currently, a Genie Agent can go beyond its attached data sources if tables or Unity Catalog functions are referenced in its instructions. See Crea
You can now set a maintenance window on a continuous Lakeflow pipeline to control when Databricks applies platform updates that require a restart, such as new runtime versions and serverless infrastructure maintenance. Select a day of the week, a start hour, and a time zone, and
The Databricks Excel Add-in is now generally available. Connect Microsoft Excel to your Databricks workspace to browse and import governed Unity Catalog tables and views, run SQL queries, build pivot tables, use custom functions, and write data back to Unity Catalog. You can now
Chat in Genie One can now use Databricks-managed MCP connectors for Google Drive, Gmail, Microsoft 365, Atlassian, and Slack to search and act on your company's tools while answering questions. Every connection is governed through Unity Catalog and Unity Gateway, which authorizes
Genie One and Genie Code can now use Databricks-provided MCP connectors for Google Drive, Gmail, Google Calendar, Microsoft 365, Atlassian, Slack, and GitHub to search and act on your company's tools while answering questions. Every connection is governed through Unity Catalog an
You can now create managed tables in Lakeflow pipelines and write to them with one or more append flows. This feature is in Beta. You can also use import_checkpoint on an append flow to migrate an existing Structured Streaming workload into a pipeline without reprocessing the sou
External secrets connect a Unity Catalog schema to AWS Secrets Manager. The secrets appear in Unity Catalog as read-only securable objects that you govern with Unity Catalog privileges. Databricks reads their values from AWS Secrets Manager on demand. See External secrets in Unit
The Celigo connector is now available in Lakeflow Connect in Beta. Workspace admins can control access to this feature from the Previews page. The connector ingests audit log events, such as create, update, and delete operations on resources, from Celigo (integrator.io) into Data
The Anysphere Organization connector is now available in Lakeflow Connect in Beta. Workspace admins can control access to this feature from the Previews page. The connector uses the Anysphere (Cursor) Organization Admin API to ingest organization members, groups, and group member
The Anaplan connector is now available in Lakeflow Connect in Beta. Workspace admins can control access to this feature from the Previews page. The connector ingests audit trail events and user account records from your Anaplan tenant into Databricks. Authentication uses an Anapl
Incremental ingestion for Salesforce formula fields in Lakeflow Connect will soon be generally available. Today, Lakeflow Connect ingests formula fields by taking a full snapshot on each pipeline run by default. When incremental formula field ingestion is generally available, ful
ABAC DENY policies are in Beta in Unity Catalog. DENY policies can be used to explicitly deny the MANAGE ACCESS CONTROL privilege to prevent specified principals, including object owners, from performing access-management operations. They always take precedence over any grant. Fo
Ingesting into tables backed by default storage with Zerobus Ingest in Lakeflow Connect is now in Public Preview. See Create or identify the target table.
Data Classification will soon scan Unity Catalog views in addition to tables, with columns classified for sensitive data using the same detection engine as tables. This is a Beta feature.
Apache Arrow support for Zerobus Ingest in Lakeflow Connect is now generally available. See Use Arrow Flight with Zerobus Ingest.
Automatic change data feed (Auto CDF) computes row-level changes at query time using row tracking, without requiring you to manually enable change data feed on each Delta Lake or Apache Iceberg v3 table. Auto CDF removes write-time overhead and makes MERGE and UPDATE operations a
The pipeline_events system table is in Beta. This table records Lakeflow pipelines event log entries for pipelines in your account, capturing lifecycle transitions, flow progress, data quality metrics, errors, and other operational data across all pipelines and workspaces in a re
ABAC GRANT policies for models, model services, model provider services, Model Context Protocol (MCP) services, and agent services are now generally available. These policies dynamically grant Unity Catalog privileges to securable objects whose governed tags match a condition, in
You can now publish, govern, and share agent skills with Unity Catalog. A skill is a first-class Unity Catalog securable (catalog.schema.skill) that follows the SKILL.md specification, so you register it once and control who can discover, use, and update it with the same permissi
You can now run prompts with Genie Code as a task in a Lakeflow Job. Genie Code runs your prompt autonomously. It can read upstream task outputs and call tools as needed. The task returns a link to the resulting Genie Code conversation with its response. See Genie Code task for j
You can now use OpenSharing to share foreign Delta tables, which are Delta-format tables registered in a foreign catalog such as OneLake, a Hive metastore, or AWS Glue. Providers add foreign Delta tables to a share, and recipients access the shared data in read-only format. See A
The Lakeflow Designer August release adds the Unique operator, expands the Aggregate, Select, and Python operators, and improves the canvas, preview, and version-history experience. The following updates are now available: Unique operator: Use the new Unique operator to remove du
The Atlassian Audit Logs connector is now available in Lakeflow Connect in Beta. Workspace admins can control access to this feature from the Previews page. The connector ingests organization audit log events, such as user, security, and configuration changes, from Atlassian into
Ingesting into streaming tables with Zerobus Ingest in Lakeflow Connect is now generally available. Writing to a streaming table works the same way as writing to a managed Delta table, with the same limits and quotas. See Create or identify the target table.
LTAP Direct Writes speeds up how synced tables load into Lakebase. When you create a synced table, Lakebase loads a full copy of your Unity Catalog data into your Postgres branch. LTAP Direct Writes accelerates that initial load and full refreshes by writing directly to the stora
The Anysphere Audit Logs connector is now available in Lakeflow Connect in Beta. Workspace admins can control access to this feature from the Previews page. The connector uses the Anysphere (Cursor) Admin API to incrementally ingest team audit-log events into Databricks. Authenti
The INSERT, UPDATE, and DELETE privileges are in Beta in Unity Catalog. These privileges are least-privilege alternatives to MODIFY that let you grant write access to a table's data without also granting the ability to change its schema or other metadata. The privileges require D
Secrets in Unity Catalog will be available by default for workspaces with the compliance security profile enabled in late September 2026. Store, govern, and access secrets as securable objects in Unity Catalog. A Unity Catalog secret uses the three-level namespace (catalog.schema
The Verkada connector is now available in Lakeflow Connect in Beta. Workspace admins can control access to this feature from the Previews page. The connector ingests organization audit logs and access users from your Verkada organization into Databricks. Authentication uses a Ver
Configuring default Python package repositories is now generally available for Lakeflow pipelines and for classic compute created via the UI and API. Workspace admins can set private or authenticated registries as the workspace default for these workloads. See Configure default p
Context attributes for attribute-based access control (ABAC) policies are in Beta. You can now write Unity Catalog ABAC policy conditions that target the context of a request, such as which OAuth application is calling (request.client_id) and whether the request runs on behalf of
The unified trace table is in Beta. It captures every request and response across your Unity AI Gateway services into one Unity Catalog table in OpenTelemetry format, giving you a single place to monitor, debug, secure, and audit all AI activity. See Monitor all AI activity using
The Databricks Connector for Google Sheets now lets you write data from Google Sheets back to a Unity Catalog table. You can create a new table or overwrite an existing table without leaving Google Sheets. See Write data back to Databricks from Google Sheets.
The job-level performance mode setting now propagates to materialized view and streaming table refreshes triggered by dbt tasks. You can set these jobs to Standard mode to optimize for cost, or keep the default Performance-optimized mode for faster startup. Previously, dbt tasks
Mutual TLS (mTLS) authentication for the Salesforce connector in Lakeflow Connect is now generally available. With mTLS, Databricks and Salesforce exchange and verify client certificates to establish two-way trust, combined with the OAuth client credentials flow. Choose it for AP
Restore the Python variables and Spark session from a serverless compute job run into a new interactive notebook, so you can debug a failure or explore results without rerunning the job. Databricks automatically captures a state snapshot when an eligible run fails, runs 30 minute
Identity attributes are in Beta. You can now write Unity Catalog ABAC column mask policy conditions that target users by attributes synced from your identity provider, such as department or country, in addition to group membership. The has_identity_attribute_value and has_identit
The Workiva connector is now available in Lakeflow Connect in Beta. Workspace admins can control access to this feature from the Previews page. The connector ingests audit activity, users, and roles from your Workiva organization into Databricks. Authentication uses Workiva OAuth
You can now ingest data from a Gmail mailbox into Databricks using the managed Gmail connector in Lakeflow Connect. The connector ingests messages, labels, drafts, filters, and profile data using a Google service account, and syncs the messages and message_labels tables increment
The SQL alert task in Lakeflow Jobs now supports all compliance security profile standards that Databricks supports and is available by default for workspaces with the compliance security profile enabled. Use the task to evaluate a Databricks SQL alert as part of a Lakeflow Job.
The SendGrid connector is now available in Lakeflow Connect in Beta. Workspace admins can control access to this feature from the Previews page. The connector ingests the SendGrid subuser directory and IP access-management activity for the parent account and each subuser into Dat
The managed Google Drive Audit Logs connector in Lakeflow Connect is now available in Beta. You can use the connector to ingest Google Drive audit activity events such as file views, edits, downloads, and sharing changes from Google Workspace into Databricks. See Google Drive Aud
The Tags page in Governance Hub is now in Beta. The Tags page provides a centralized view of how tags are applied across your account. It summarizes governed tag usage, shows recent tag assignments and their sources, and surfaces recommendations to fix invalid tag values and add
Identity attributes are in Beta. Databricks can store nine IdP-sourced attributes, such as title, department, and cost center, on account users, so they can be referenced in Unity Catalog ABAC column-masking policies. Account admins provision these attributes from their identity
You can now use Pages to give business terms, acronyms, and KPIs a single governed definition. Part of Unity Catalog semantics, Pages form the human-modeled layer of the Genie Ontology that Genie One draws on to ground its answers. See Pages.
The managed Google Search Console connector is now available in Beta in Databricks Lakeflow Connect. Use it to ingest search performance data, site metadata, and sitemap information from Google Search Console into Databricks. The connector supports daily and hourly search analyti
The Amplitude connector in Lakeflow Connect is now in Beta. Ingest product analytics event data along with event, cohort, and annotation metadata from Amplitude. See Amplitude connector.
You can now ingest data from Glean into Databricks using the managed Glean connector in Lakeflow Connect. The connector ingests company-wide usage insights for search, Assistant, and agents, along with the shortcuts (go links) defined in your Glean deployment, using a Glean Clien
ABAC GRANT policies dynamically grant Unity Catalog privileges to securables whose governed tags match a condition. These policies were previously only available for models, but now also support model services, model provider services, Model Context Protocol (MCP) services, agent
Attribute-based access control (ABAC) GRANT policies dynamically grant Unity Catalog privileges to securables whose governed tags match a condition. They now support model services, model provider services, Model Context Protocol (MCP) services, and agent services, which are the
You can now run a continuous Lakeflow pipeline with a continuous job. When a continuous job orchestrates a pipeline, the job determines the execution mode, and the pipeline can use job-level features such as serverless Standard performance mode and additional notification destina
The system.alert schema is in Public Preview. This schema contains the alerts table, which records the configuration of every alert, and the alert_evaluation_history table, which records one row per alert evaluation. Use these tables to audit alert definitions, analyze evaluation
The READ METADATA privilege is now generally available in Unity Catalog. READ METADATA provides read-only visibility into the same metadata available to the object's owner or a user with MANAGE, including security-sensitive information that BROWSE doesn't expose, such as privileg
The managed Notion connector in Lakeflow Connect is now available in Beta. The connector ingests pages, data sources, databases, blocks, comments, and users from Notion into Databricks. See Notion connector.
Tag automations are now in Beta. A tag automation assigns or removes governed tags on the Unity Catalog tables or volumes that match conditions you define, so tags stay accurate as your data and metadata change. Use them to certify trusted data, deprecate stale data, roll up colu
You can now read a change data feed from a materialized view created in a Lakeflow pipeline or in Databricks SQL, using Databricks Runtime 18 LTS or above. Use this to replicate materialized view changes to destinations outside Databricks, or to keep a history of materialized vie
Package Scala or Java code as a JAR and run it as a task in a Lakeflow Job on serverless compute. Your JAR must match the Scala, Java Development Kit (JDK), and Databricks Connect versions of your serverless environment version. See Create and run JARs on serverless compute.
The Zerobus Ingest connector in Lakeflow Connect is now enabled by default for workspaces with the compliance security profile enabled. See Zerobus Ingest overview.
REPLACE USING flows are now available in Lakeflow pipelines in Beta. Use a REPLACE USING flow when your source is a series of partial snapshots keyed by column. On each update, the flow replaces all rows that match the specified key columns and leaves all other rows unchanged. A
Unity AI Gateway is now generally available. Unity AI Gateway is the Databricks governance solution for enterprise AI, part of Unity Catalog. With Unity AI Gateway you can: Control which AI services teams can use. Route and manage AI traffic across providers. Govern MCP servers t
The SharePoint connector in Lakeflow Connect is now Generally Available. See SharePoint connector.
The managed PagerDuty connector in Lakeflow Connect is now available in Beta. The connector ingests incident, on-call, service, and audit data from PagerDuty into Databricks. See PagerDuty connector.
The Google Drive connector in Lakeflow Connect is now Generally Available. See Google Drive connector.
Sharing Delta tables with Iceberg reads enabled is now generally available. See Delta Lake feature support matrix.
The managed NetSuite connector in Lakeflow Connect is now generally available. The connector allows you to ingest ERP and financial data from Oracle NetSuite into Databricks. See NetSuite connector.
Unity Gateway is now generally available. Unity Gateway is the Databricks governance solution for enterprise AI, part of Unity Catalog. With Unity Gateway you can: Control which AI services teams can use. Route and manage AI traffic across providers. Govern MCP servers to control
HTTP connections in Unity Catalog are now generally available at the schema level. You can create an HTTP connection inside a schema instead of only at the metastore level. A schema-level connection uses the three-level namespace (catalog.schema.connection) and inherits Unity Cat
You can now refresh a pipeline-managed materialized view or streaming table even when the pipeline owner or run-as identity is subject to an attribute-based access control (ABAC) policy. Previously, refreshing a materialized view or streaming table managed by a pipeline required
The MANAGE privilege no longer requires a usage privilege (USE CATALOG or USE SCHEMA) on the object where MANAGE is granted. This change makes MANAGE behave more consistently with object ownership. Previously, MANAGE on a catalog or schema took effect only if you also held the ap
Secrets in Unity Catalog is now generally available. You can store, govern, and access secrets as securable objects in Unity Catalog. A Unity Catalog secret uses the three-level namespace (catalog.schema.secret) and is governed by Unity Catalog privileges, so you can apply the sa
Environment variables for serverless Lakeflow Jobs tasks are in Beta. You can define named environment variable entries at the job level and select one for each task to pass deployment-specific configuration to your application code. A workspace admin must enable the preview from
The OpenAI connector is now available in Lakeflow Connect in Beta. Workspace admins can control access to this feature from the Previews page. The connector uses the OpenAI Organization Admin API to ingest organization administration data, such as users, projects, API keys, usage
Automatic upgrades begin rolling out row tracking and Checkpoint V2 to existing Unity Catalog managed tables, not just new tables. This rollout is gradual, so these features will be available to different customers at different times. Automatic upgrades turn on a feature only aft
Unity AI Gateway, the Databricks governance solution for enterprise AI, is scheduled for general availability soon. Built on Unity Catalog, Unity AI Gateway extends governance to the runtime interactions between models, agents, MCP servers, and tools. You can control which AI ser
Unity Gateway, the Databricks governance solution for enterprise AI, is scheduled for general availability soon. Built on Unity Catalog, Unity Gateway extends governance to the runtime interactions between models, agents, MCP servers, and tools. You can control which AI services
Registering Python user-defined table functions (UDTFs) in Unity Catalog is now generally available in Databricks Runtime 18. A Unity Catalog Python UDTF is a governed function that returns a table, invoked in the FROM clause of a SQL statement to return multiple rows and columns
You can now write and run Python unit tests for your Spark Declarative Pipelines on Lakeflow transformation logic directly in the Lakeflow Pipelines Editor. Validate Python and SQL transformations against mock data using catalog-table redirection, including Auto CDC, streaming ta
Lakebase now surfaces database issues and early warnings with Insights, and lets you investigate and fix them conversationally with Genie, using telemetry captured to Unity Catalog. See AI-assisted troubleshooting.
The Lakeflow Designer Summer Release adds new operators, expands the Output and Join operators, and improves the canvas editing experience. The following updates are now available: Prepare operator: Use the new Prepare operator for common data-cleansing tasks, including changing
The system.tags.governed_tags system table is in Beta. This table contains a record for each governed tag key in your account, including customer-created and system-generated tags. Use it to programmatically determine which tags in your account are governed. See Governed tags sys
Lakebase adds AI-assisted troubleshooting: database issues and early warnings are surfaced to you with Insights, and you can then investigate and fix them conversationally with Genie. Both draw on database telemetry captured to Unity Catalog. See AI-assisted troubleshooting.
The sample datasets /databricks-datasets mounted to DBFS are now also available in the samples catalog as samples.databricks.datasets, made available through OpenSharing. The datasets volume hosts a collection of Databricks-provided datasets that you can use to build and test dat
Transactions that write to Unity Catalog managed Delta tables are now generally available. Group multiple SQL statements across one or more tables into a single atomic transaction using BEGIN ATOMIC ... END; or BEGIN TRANSACTION; ... COMMIT; syntax. All changes succeed together o
Lakeflow Designer now supports all compliance security profile standards supported by Databricks and is available by default for workspaces with the compliance security profile enabled. For a full list of supported compliance standards, see Compliance security profile. See Lakefl
Genie One will soon support account-only users, allowing any user in your identity provider to access Genie One without being assigned to a workspace or granted the consumer entitlement. When enabled, all users in your identity provider are enrolled automatically. Unity Catalog w
The managed Reddit Ads connector in Lakeflow Connect is now available in Beta. You can use the connector to ingest advertising campaign data and performance metrics from Reddit Ads into Databricks. See Reddit Ads connector.
The Anthropic connector in Lakeflow Connect is now available in Beta. The connector allows you to ingest Compliance API data — audit activity, organizations, users, roles, groups, settings, and Claude chats and messages — from Anthropic into Databricks. See Anthropic connector.
Connect and govern any external model provider (such as OpenAI, Anthropic, Amazon Bedrock, and newly released models like Meta's Muse Spark 1.1) through Unity Gateway. Register a provider once as a governed Unity Catalog securable, and every team can query it through Unity Gatewa
MLflow trace storage in Unity Catalog tables will be available by default for workspaces with the compliance security profile enabled in mid-August 2026. Store MLflow traces in Unity Catalog tables for scalable, governed trace storage: storage is unlimited, traces are stored in O
You can now register Scala and Java user-defined functions (UDFs) in Unity Catalog and reuse them across notebooks, jobs, and SQL warehouses with Unity Catalog governance. Reuse your existing JVM logic and get better performance than Python UDFs on all compute, including serverle
MLflow trace storage in Unity Catalog tables is now generally available. Databricks recommends storing traces in Unity Catalog for new and production workloads: storage is unlimited, traces are stored in OpenTelemetry (OTel) format, access is governed through Unity Catalog schema
Databricks plans to launch the system.governance.governed_tags system table in Beta. This table contains versioned records for all governed tag keys in your account, including customer-created and system-generated tags.
Data Classification is now available by default for workspaces with the compliance security profile enabled and either C5, TISAX, or IRAP controls selected.
The MANAGE privilege lets users manage privileges on, transfer ownership of, and delete an object without being its owner. Generally, usage privileges (USE CATALOG and USE SCHEMA) are prerequisites for interacting with a Unity Catalog object. Today, the MANAGE privilege on a cata
In an upcoming release, Request for Access will be enabled by default for all workspaces, and access requests will be routed to the owner of the requested Unity Catalog object via email. You can configure access request destinations at any time in the metastore settings. The lega
Query-based connectors in Lakeflow Connect will soon be available by default for workspaces with the compliance security profile enabled. Query-based connectors ingest data from databases by querying the source directly using a cursor column, without requiring change data capture
Automatic upgrades apply recommended features to your Unity Catalog managed tables after verifying workload compatibility. Databricks is expanding the features that automatic upgrades apply to existing tables. Starting in July 2026, automatic upgrades will roll out row tracking a
The SharePoint connector in Lakeflow Connect will soon be generally available. You can ingest files and structured data from SharePoint sites into Databricks for transformation, analysis, and downstream pipelines. See SharePoint connector.
The Google Drive connector in Lakeflow Connect will soon be generally available. You can ingest files from Google Drive into Databricks for transformation, analysis, and downstream pipelines. See Google Drive connector.
You can now store, govern, and access secrets as securable objects in Unity Catalog. A Unity Catalog secret uses the three-level namespace (catalog.schema.secret) and is governed by Unity Catalog privileges, so you can apply the same access controls and auditing that you use for
The Lakeflow Pipelines Editor has been generally available since May 2026. In August, it will become the default editor for developing and debugging pipelines in workspaces with the compliance security profile enabled. At that time the legacy editor will be removed. For more info
The Strac connector is now available in Lakeflow Connect in Beta. Workspace admins can control access to this feature from the Previews page. The connector ingests data-security audit events from your Strac instance into Databricks. Authentication uses a Strac API key. See Strac
Materialized view and streaming table refreshes in Databricks SQL now inherit custom tags from the enclosing SQL warehouse environment. These tags propagate to billing surfaces like system.billing.usage, enabling proper cost attribution of materialized view and streaming table up
In early August 2026, continuous Lakeflow Spark Declarative Pipelines and jobs will receive updates to simplify configuration and state management. Continuous pipelines You will be able to configure a continuous schedule directly from the pipeline page, including job-level settin
The SQL alert task in Lakeflow Jobs is generally available and will be available by default in your workspace. Use the task to evaluate a Databricks SQL alert as part of a Lakeflow Job. The task returns its evaluation state as a task output value, so downstream tasks can branch o
You can now use Unity Catalog permissions to restrict which task-specific AI Functions your organization can access, independent of foundation model access. Contact your account team to enable this feature. See AI Functions Unity Catalog permissions.
REPLACE WHERE flows for pipelines and standalone streaming tables are now generally available. Use them to replace only rows matching a predicate on each refresh, without reprocessing the full table history. See Batch processing with REPLACE WHERE flows.
You can now create a materialized view that is compatible with external Iceberg readers. This feature is in Public Preview. To enable it, reach out to your Databricks account team. See Create a materialized view compatible with external Iceberg readers.
This serverless compute release includes updates from Databricks Runtime 18. New features Lakeflow Spark Declarative Pipelines streaming query ID: Lakeflow Spark Declarative Pipelines can now set the streaming query ID on demand. IP address functions (Public Preview): New SQL fun
Materialized view and streaming table refreshes that are orchestrated through a SQL task in a Lakeflow job now respect the job's Performance optimized setting. When the setting is disabled, the refresh uses standard performance mode, which consumes fewer DBUs. For more about perf
Row filtering in Lakeflow Connect is now generally available. Row filtering allows you to ingest only the rows you need by applying conditions similar to a SQL WHERE clause, improving performance and minimizing data duplication. Row filtering applies during both the initial load
The Veeva Vault connector is now available in Lakeflow Connect in Beta. Workspace admins can control access to this feature from the Previews page. The connector uses Veeva's Direct Data API to ingest all standard objects, custom objects, system tables, and audit trail tables fro
Lakehouse Real-Time (Lakehouse//RT) is now in Beta. Lakehouse//RT is a serverless SQL warehouse type built for low-latency, high-concurrency workloads, delivering sub-second SQL read queries against Unity Catalog tables. Use it to serve analytical data to applications, run operat
The SQL alert task in Lakeflow Jobs is now generally available. Use the task to evaluate a Databricks SQL alert as part of a Lakeflow Job. The task returns its evaluation state as a task output value, so downstream tasks can branch on the result. See SQL alert task for jobs.
You can now govern Databricks-hosted LLMs in Unity Catalog using model services, currently in Beta. A model service is a Unity Catalog securable that represents a governed LLM endpoint, so you can define an endpoint once and share it across workspaces using Unity Catalog privileg
Parquet v2 is now generally available for Delta Lake tables in Databricks Runtime 18.1 and above. Parquet v2 uses advanced encodings, v2 data page headers, and INT64 timestamps to improve query performance and reduce table sizes. To use, set the delta.parquet.format.version table
The managed Microsoft Dynamics 365 connector in Lakeflow Connect is now generally available. The connector allows you to ingest CRM and ERP data from Dynamics 365 into Databricks using Azure Synapse Link. See Microsoft Dynamics 365 connector.
You can now define parameters in metric views to bind values at query time, serving many query variants from a single definition instead of maintaining a separate metric view per variant. See Use parameters with metric views.
Account admins can now set an account-wide retention period from 30 to 3,650 days for supported system tables. See Configure system table data retention.
Unity Gateway can now track and cap spend on external model providers, such as Amazon Bedrock and Azure AI Foundry, not just Databricks-provided models. If your organization already has capacity commitments directly with a provider, Unity Gateway becomes the single point to track
Because SQL statements can contain sensitive information, Databricks now masks query text in the following places: statement_text in system.query.history returns <REDACTED>. query_text in the Query History API and the List Queries API returns <REDACTED>. Keys in request
The root_cause_analysis column in the data quality monitoring results system table is being deprecated. Deprecation begins August 18, 2026, and rolls out gradually across regions over the following several days. Until the rollout reaches your workspace, you might still be able to
The downstream_impact column in the data quality monitoring results system table is being deprecated. Deprecation begins September 7, 2026, and rolls out gradually across regions over the following week. Until the rollout reaches your workspace, you might still be able to query d
The web terminal in notebooks connected to serverless GPU compute (AI Runtime) is now in Public Preview. Use it to run shell commands, monitor GPU usage with nvidia-smi, install libraries, and manage files directly on the compute. This requires serverless GPU environment version
Governance Hub is in Beta. Governance Hub is a centralized, account-level UI in the account console for monitoring governance across your Databricks account. It provides a unified view of data health and coverage, AI usage and spend, and cost drivers, with prioritized insights an
The Activity details toggle in the SQL warehouse monitoring UI is now generally available. View color-coded annotations on the Running clusters chart that explain why a warehouse remains active, including query activity, fetching queries, open sessions, and idle states. Hover ove
Databricks SQL alerts now support all compliance security profile standards that Databricks supports, and are available by default for workspaces with the compliance security profile enabled. Use Databricks SQL alerts to monitor data and KPIs by running queries on a schedule, eva
When a Genie response includes a chart, the visualization now appears as an image in the Slack reply. If you installed the Databricks Genie app for Slack previously, reinstall it to enable this. See Visualizations.
You can now use Genie One directly in the Databricks Connector for Google Sheets. Query your governed Databricks data in natural language and import the results into Google Sheets as native rows and columns. See Use Genie in Google Sheets.
You can now use Genie One directly in the Databricks Excel Add-in. Query your governed Databricks data in natural language and import the results into Microsoft Excel as native rows and columns. See Use Genie in Microsoft Excel.
Visualization widget titles and descriptions support rich text formatting. Click a widget's title or description to open a formatting toolbar, where you can apply text styling, links, and tables, or type markdown directly. See Format widget titles and descriptions.
The Databricks Excel Add-in now supports cascading filters and case-insensitive string matching. Additionally, the LIKE, NOT LIKE, IN, and NOT IN filters are no longer available in the filters list. See Filter imported data.
You can now set a statement timeout on a single SQL warehouse so that different warehouses can apply different timeouts to their queries. Set the timeout with the statement_timeout field in the Create or Update warehouse APIs. This feature is in Beta and is API-only. See Warehous
Context-based ingress control now supports Partner Platforms as a network source. Select a partner platform to allowlist the IPs that third-party apps use to connect to Databricks, including Power BI, Tableau Cloud, and dbt platform. Databricks manages and updates these IP lists
Excel file format support is now available by default for all workspaces. You can ingest, parse, and query .xls, .xlsx, and .xlsm files directly using built-in support, without external libraries or manual conversions. See Read and stream Excel files.
Dashboard relationships (Public Preview): Build complex multi-fact data models scoped to an AI/BI dashboard. See Dashboard relationships.
A Genie One skill can now include multiple files and sub-folders, up to three folders deep and 50 files or folders per skill. Skills can load text files only. See User skills.
Genie Code now includes conversation controls that let you branch and revise a chat. You can fork a conversation into a new, independent thread from a point you choose, ask a quick side question with /btw without adding it to the thread, and edit an earlier message to regenerate
Genie One can now search the public web to answer questions that need current information, such as recent releases, third-party documentation, or news. Genie One decides when to search and cites the sources it uses, showing each as a link you can open. See Search the web.
Genie One can now search the public web to answer questions that need current information, such as recent release notes, third-party documentation, or news. Genie One cites the external sources it uses as links in its response. See Search the web.
Genie One and Genie Agents can now use models served through OpenAI on Databricks when partner-powered AI features are enabled. For the hosting provider used by each feature, see Hosting provider used when partner-powered AI features setting is enabled and disabled.
Genie Code scheduled tasks will be available by default for workspaces with the compliance security profile enabled in October 2026. You can schedule Genie Code to run a prompt on a recurring schedule. Each run executes your prompt as a full Genie Code session and produces a cont
Genie Code scheduled tasks are now generally available. You can schedule Genie Code to run a prompt on a recurring schedule. Each run executes your prompt as a full Genie Code session and produces a continuable Genie chat with the results, so you can turn recurring analysis and o
Use Genie Code to develop and troubleshoot deep learning workloads in notebooks connected to AI Runtime. Now in Public Preview, it generates distributed training code, resolves environment and dependency issues, and debugs GPU and distributed workload failures. See Use Genie Code
The Genie One desktop app is now in Beta. The native macOS app opens Genie One on your desktop instead of in a browser tab, so business users can chat with data in natural language, work with their threads and documents, and use Genie Agents without a browser. See Use Genie One o
When you sign in to the Databricks Genie app in Microsoft Teams, you can now enter your workspace URL instead of a server hostname to connect to your Databricks account. See Databricks Genie app in Microsoft Teams.
A new Genie entry in the Lakebase project sidebar opens Genie Code, the agentic Databricks assistant, scoped to your Lakebase project. Ask it in natural language to run multi-step data and AI tasks: explore your databases and tables, investigate and debug issues, and create and p
You can now set the effort level for Genie Code to balance response quality and cost. Auto (default) gives you the highest quality responses. For simpler tasks, select Low to use a faster, lower-cost model. See Select a level of effort.
You can now upload files to Genie Code to use as context for the current chat. See Attach files.
Search the public web (Beta): Genie One can now search the public web to answer questions that need current information, such as recent release notes, third-party documentation, or news. It searches automatically based on your request and cites the sources it uses, with each sour
You can now build custom trace views in the Databricks MLflow trace explorer. Describe the layout you want in plain language, and Genie generates a reusable view that surfaces the trace fields, metrics, and feedback controls most relevant to your review workflow. See Build a cust
All Databricks-managed MCP connectors for Genie One and Genie Code have migrated to the Unity AI Gateway. This brings Databricks-managed connectors under Unity AI Gateway, enabling centralized governance, access controls, and visibility alongside your other MCP servers and tools.
Genie Code can now search the public web to answer questions that need current information. Web search is disabled by default during the beta for eligible workspaces and must be turned on from the Previews page. See Search the web.
All Databricks-managed MCP connectors for Genie One and Genie Code have migrated to the Unity Gateway. This brings Databricks-managed connectors under Unity Gateway, enabling centralized governance, access controls, and visibility alongside your other MCP servers and tools. Users
Full page Genie Code is now generally available. Full page Genie Code is a command center experience where the active chat is shown prominently, notebooks and files open as tabs alongside it, and you can run multiple chats in parallel. Start work directly from Genie Code, and per
Free usage of Genie One and Genie Agents is extended through January 31, 2027. This promotion was previously set to end on July 31, 2026. Budget controls do not apply during the promotional period. The promotion covers usage by users only. Service principals are excluded, and the
Genie Code is now available on workspaces that have the compliance security profile enabled with the HIPAA compliance standard selected and partner-powered AI features disabled. On these workspaces, Genie Code is served by Databricks-hosted models rather than partner-powered mode
You can now schedule Genie Code to run a prompt on a recurring schedule. Each run executes your prompt as a full Genie Code session and produces a continuable Genie chat with the results, so you can turn recurring analysis into an unattended background task. Create a scheduled ta
Higher character limit for uploaded PDFs: The maximum number of characters per uploaded PDF has been raised from 4,000 to 15,000. See PDF files. Agent mode APIs (Beta): Agent mode APIs for Genie Agents are now available in Beta. See the Agent mode API reference. Analyze files in
Genie One and Genie Agents usage is free through July 31, 2026. Beginning July 21, 2026, Databricks is applying a correction so that Genie One and Genie Agents usage is properly reflected as free across your billing data and budgets: System tables: Correction records land in syst
You can now mention Genie Code in a notebook comment to get AI help without leaving the comment thread. Type @ in a comment, select Genie Code, and enter your request. Genie Code replies inline in the thread. See Code comments.
The Databricks Genie app in Microsoft Teams is now in Public Preview. The app brings Genie into Microsoft Teams so users can ask data questions and get answers without leaving Microsoft Teams. See Databricks Genie app in Microsoft Teams.
Save a chat as a Genie Agent: You can now save a Genie One thread as a Genie Agent. See Create an agent. Conversation sharing (Public Preview): Sharing an individual Genie Agent conversation is now in Public Preview. See Share a conversation. Access email terminology: Access-gran
The Lakebridge Agentic Converter is in Beta. Use it to convert legacy SQL dialects, such as T-SQL, Snowflake, Redshift, Oracle, BigQuery, and Teradata, to ANSI SQL in migration projects in your workspace. Powered by Genie Code, the converter analyzes each source script, validates
The agentic code converter is in Beta. Use it to convert legacy SQL dialects, such as T-SQL, Snowflake, Redshift, Oracle, BigQuery, and Teradata, to ANSI SQL in migration projects in your workspace. Powered by Genie Code, the converter analyzes each source script, validates synta
Save a chat as a Genie Agent: You can now save a Genie One thread as a Genie Agent. See Create an agent. Conversation sharing (Public Preview): Sharing an individual Genie Agent conversation is now in Public Preview. See Share a conversation. Access email terminology: Access-gran
Save a chat as a Genie Agent: You can now save a Genie One thread as a Genie Agent. See Create an agent. Conversation sharing (Public Preview): Sharing an individual Genie Agent conversation is now in Public Preview. See Share a conversation. Access email terminology: Access-gran
Save a chat as a Genie Agent: You can now save a Genie One thread as a Genie Agent. See Create an agent. Conversation sharing (Public Preview): Sharing an individual Genie Agent conversation is now in Public Preview. See Share a conversation. Access email terminology: Access-gran
Save a chat as a Genie Agent: You can now save a Genie One thread as a Genie Agent. See Create an agent. Conversation sharing (Public Preview): Sharing an individual Genie Agent conversation is now in Public Preview. See Share a conversation. Access email terminology: Access-gran
Genie One and Genie Agents usage is free through July 31, 2026. Budget controls do not apply during this time.
Genie One and Genie Agents usage is free through January 31, 2027. Budget controls do not apply during this time.
You can now configure front-end Private Link for account-level Genie One. Turn on the Front-end Private Link for Custom URLs and Account preview to get started. See Configure inbound Private Link for account-level resources.
Genie Spaces renamed to Genie Agents: Genie Spaces are now called Genie Agents. SQL expressions grouped with example SQL: In the authoring experience, SQL expressions are now grouped with example SQL queries so you can define and manage both in one place. See Define SQL expressio
Genie Agents (formerly Genie Spaces) renamed to Genie Agents: Genie Agents (formerly Genie Spaces) are now called Genie Agents. SQL expressions grouped with example SQL: In the authoring experience, SQL expressions are now grouped with example SQL queries so you can define and ma
Genie Agents (formerly Genie Spaces) renamed to Genie Agents: Genie Agents (formerly Genie Spaces) are now called Genie Agents. SQL expressions grouped with example SQL: In the authoring experience, SQL expressions are now grouped with example SQL queries so you can define and ma
Genie Agents (formerly Genie Spaces) renamed to Genie Agents: Genie Agents (formerly Genie Spaces) are now called Genie Agents. SQL expressions grouped with example SQL: In the authoring experience, SQL expressions are now grouped with example SQL queries so you can define and ma
Genie Agents (formerly Genie Spaces) renamed to Genie Agents: Genie Agents (formerly Genie Spaces) are now called Genie Agents. SQL expressions grouped with example SQL: In the authoring experience, SQL expressions are now grouped with example SQL queries so you can define and ma
Starting July 8, 2026 at 00:00 UTC, Genie Agents is billed following a pay-as-you-go pricing model that includes 150 DBUs of free large language model (LLM) usage every month, equivalent to about $10.50 in the US East region. Usage beyond the free amount is billed in DBUs, reflec
Genie Spaces are now called Genie Agents. The name changed across the documentation, but the product's capabilities are unchanged. For more information, see Genie Agents.
Starting July 7, 2026 at 00:00 UTC, Genie products, including Genie Spaces, Genie Code, and Genie One, are billed following a pay-as-you-go pricing model that includes 150 DBUs of free large language model (LLM) usage every month, equivalent to about $10.50 in the US East region.
Budgets, including budgets for Unity AI Gateway, are now generally available. Budgets let admins define spending thresholds. For requests managed through Unity AI Gateway, including Genie interactions, admins can set additional per-user thresholds and overrides, with configurable
Genie Spaces now follows a pay-as-you-go (PAYGO) pricing model. Each user receives a free monthly amount of large language model (LLM) usage, and usage beyond the free amount is billed in DBUs. With this change, the previous throughput limits for the Genie Spaces UI and Conversat
Agent mode is generally available: Agent mode in Genie Agents (formerly Genie Spaces) is now generally available. Agent mode uses multi-step reasoning to answer complex, exploratory questions with a report that includes citations, visualizations, and supporting tables. See Agent
Agent mode in Genie Spaces will be enabled by default for workspaces with the compliance security profile enabled in July 2026. Agentic mode uses multi-step reasoning to answer complex business questions by running multiple SQL queries, iterating on results, and returning a repor
The Chat/Agent mode selector has been removed from the Genie Code pane. Genie Code now runs exclusively in Agent mode. If you prefer a conversational response without autonomous task execution (what was previously called Chat mode), include that instruction in your prompt. For ex
Agent mode in Genie Agents will be enabled by default for workspaces with the compliance security profile enabled in July 2026. Agentic mode uses multi-step reasoning to answer complex business questions by running multiple SQL queries, iterating on results, and returning a repor
Genie Code space authoring skills: Genie Code now includes dedicated skills for authoring and maintaining Genie Agents (formerly Genie Spaces). See Create a Genie Agent and Debug responses with Genie Code.
Genie Spaces is being renamed to Genie Agents. In early July 2026, Genie Spaces is renamed to Genie Agents to better reflect the full capabilities of this feature.
Databricks Apps is now on by default for workspaces with the compliance security profile enabled. See Databricks Apps.
In early October 2026, horizontal scaling for Databricks Apps will be automatically enabled for workspaces with the compliance security profile enabled. Horizontal scaling lets you run an app across multiple instances behind a single app URL for higher availability and concurrenc
Model Serving now supports Google Gemini 3.8 Flash as a Databricks-hosted model. You can access this model using Foundation Model APIs. Customers are responsible for ensuring their compliance with applicable terms.
Model Serving now supports GLM 5.3 as a Databricks-hosted model in supported US and Americas regions. This text-only mixture of experts (MoE) model supports a context window of up to 1,048,576 tokens, up to 65,536 output tokens, function calling, structured output, coding, agenti
You can now call ai_parse_document, ai_extract, and ai_classify through the AI Functions REST API. See intelligent document processing for more details.
Model Serving now supports xAI Grok 4.6 as a Databricks-hosted model. This reasoning model has a 500,000-token context window and supports configurable reasoning effort and function calling for coding, agentic workflows, and other complex tasks. You can access this model using Fo
Model Serving now supports GLM 5.3 Flash as a Databricks-hosted model. This natively multimodal mixture of experts (MoE) model has 320 billion total parameters and 18 billion active parameters. It supports text and image input, a 1 million token context window, reasoning, coding,
The Supervisor API (Beta) reaches end of life on September 30, 2026. After that date, the API is no longer available. Databricks recommends migrating to custom agents on Databricks Apps. See Supervisor API (Beta) (deprecated).
You can now use ai_extract precision mode for advanced extraction workloads, including multi-page documents, schemas with 50 or more fields, many extracted items per document, and complex conditional field logic. See ai_extract function.
Model Serving now supports DeepSeek V4 Pro (0813) as a Databricks-hosted model in the us-west-2 region. This large mixture-of-experts language model supports reasoning and function calling for complex coding and agentic workflows. You can access this model using Foundation Model
Model Serving now supports Google Gemini 3.7 Flash as a Databricks-hosted model. You can access this model using Foundation Model APIs. Customers are responsible for ensuring their compliance with applicable terms.
Model Serving now supports DeepSeek V4 Flash (0731) as a Databricks-hosted model in the us-west-2 region. This hybrid mixture of experts (MoE) model has 284 billion total parameters and 13 billion active parameters and is optimized for fast, cost-efficient reasoning, coding, and
Model Serving now supports Kimi K3 as a Databricks-hosted model. This 2.8-trillion-parameter mixture of experts (MoE) model has native vision capabilities, supports a 1 million token context window, and is designed for long-horizon coding, knowledge work, and reasoning. You can a
Starting in early September 2026, Databricks Apps will be automatically on for workspaces with the compliance security profile enabled. See Databricks Apps.
Databricks Model Serving now supports Anthropic Claude Opus 5 as a Databricks-hosted model. To access this model, use: Foundation Model APIs pay-per-token Query reasoning models Query vision models
Model Serving now supports Google Gemini 3.6 Flash as a Databricks-hosted model. You can access this model using Foundation Model APIs. Customers are responsible for ensuring their compliance with applicable terms.
Model Serving now supports Google Gemini 3.5 Flash Lite as a Databricks-hosted model. You can access this model using Foundation Model APIs. Customers are responsible for ensuring their compliance with applicable terms.
Model Serving now supports Thinking Machine Labs Inkling as a Databricks-hosted model. This mixture of experts (MoE) model supports text and image inputs, a 1 million token context window, and is optimized for coding, reasoning, and agentic tool-use tasks. You can access this mod
The ai_extract and ai_classify SQL AI functions are now available by default for workspaces with the compliance security profile enabled and HIPAA, PCI-DSS, FedRAMP Moderate, CCCS Medium (Protected B), UK Cyber Essentials Plus, HITRUST, IRAP, C5, and TISAX controls selected. Use
Model Serving now supports OpenAI GPT-5.6 Sol, GPT-5.6 Terra, and GPT-5.6 Luna as Databricks-hosted models. You can access these models using Foundation Model APIs pay-per-token. Customers are responsible for ensuring their compliance with applicable terms.
For custom model serving endpoints with a tensor-based input signature, you can now send the request body as a serialized KServe v2 ModelInferRequest with Content-Type: application/x-protobuf, instead of JSON. This feature is in Public Preview and is only available on endpoints d
Model Serving now supports GLM 5.2 as a Databricks-hosted model. This mixture of experts (MoE) model supports a 1 million token context window and is optimized for long-horizon reasoning, coding, and agentic tool use. You can access this model using Foundation Model APIs. Custome
Model Serving now supports Google Gemini 3.1 Flash Image and Gemini 3 Pro Image as Databricks-hosted models. You can access these models using Foundation Model APIs. Customers are responsible for ensuring their compliance with applicable terms.
Grok models will soon be available as pay-per-token foundation models in Databricks Model Serving. See Supported foundation models on Model Serving.
Model Serving now supports Anthropic Claude Sonnet 5 as a Databricks-hosted model. Designed for coding, agentic workflows, and professional work at scale, Claude Sonnet 5 delivers near-Opus-level intelligence with Sonnet's cost efficiency and speed. You can access this model usin