Skip to content
Live
Trending storyPast story

Databricks launches OpenSharing

2 reports1 outlets12 days agoUpdate

The story so far

AI overview

Databricks has released the open protocol OpenSharing, based on Delta Lake and Iceberg, for directly reading customer tables without copying data. The protocol allows customers to share tables by authorization, enabling consumers without the need to maintain SFTP or API connections, and can track access records through system tables. Since the protocol is open, consumers do not need to be on the Databricks platform to read shared data. Shared tables can also expose change data feeds, allowing pipelines to read the feed at runtime to understand record creation, deletion, or updates. Databricks exposes shared Delta tables as real-time data sources through OpenSharing, with recipients reading incremental changes using Structured Streaming without local file tracking.

AI-written from the reports · Updated 11 days ago

Developments

2 developments

  1. 7 Nov, 06:13 · 1 reports
    OpenSharing
    Databricks Blog:Read, don't copy: replacing file feeds with OpenSharing - Part 2 (How to Implement)
  2. 7 Nov, 06:10 · 1 reports
    replacing file and API feeds with OpenSharing
    Databricks Blog:Read, don't copy: replacing file and API feeds with OpenSharing - Part 1 (The Why)

Coverage timeline

Follow the coverage to see every side of the story.

7 Nov
  1. Databricks Blog
    Read, don't copy: replacing file feeds with OpenSharing - Part 2 (How to Implement)

    Databricks exposes shared Delta tables as real-time data sources through OpenSharing, allowing recipients to read incremental changes using Structured Streaming without local file tracking.

  2. Databricks Blog
    Read, don't copy: replacing file and API feeds with OpenSharing - Part 1 (The Why)

    OpenSharing is an open protocol developed based on Delta Lake and Iceberg, used for directly reading customer tables without copying data. It supports incremental pull of change data, real-time access to the latest data, and smooth backfill of historical data, while reducing costs for customers and consumers in data management, storage, and access control. Consumers do not need to maintain SFTP or API connections; customers can share tables with authorization and can track access records through system tables.