Databricks launches OpenSharing
The story so far
Databricks has released the open protocol OpenSharing, based on Delta Lake and Iceberg, for directly reading customer tables without copying data. The protocol allows customers to share tables by authorization, enabling consumers without the need to maintain SFTP or API connections, and can track access records through system tables. Since the protocol is open, consumers do not need to be on the Databricks platform to read shared data. Shared tables can also expose change data feeds, allowing pipelines to read the feed at runtime to understand record creation, deletion, or updates. Databricks exposes shared Delta tables as real-time data sources through OpenSharing, with recipients reading incremental changes using Structured Streaming without local file tracking.
AI-written from the reports · Updated 11 days ago
Developments
2 developments
- 7 Nov, 06:13 · 1 reportsOpenSharingDatabricks Blog:Read, don't copy: replacing file feeds with OpenSharing - Part 2 (How to Implement)
- 7 Nov, 06:10 · 1 reportsreplacing file and API feeds with OpenSharingDatabricks Blog:Read, don't copy: replacing file and API feeds with OpenSharing - Part 1 (The Why)
Coverage timeline
Follow the coverage to see every side of the story.
- Databricks BlogRead, don't copy: replacing file feeds with OpenSharing - Part 2 (How to Implement)
Databricks exposes shared Delta tables as real-time data sources through OpenSharing, allowing recipients to read incremental changes using Structured Streaming without local file tracking.
- Databricks BlogRead, don't copy: replacing file and API feeds with OpenSharing - Part 1 (The Why)
OpenSharing is an open protocol developed based on Delta Lake and Iceberg, used for directly reading customer tables without copying data. It supports incremental pull of change data, real-time access to the latest data, and smooth backfill of historical data, while reducing costs for customers and consumers in data management, storage, and access control. Consumers do not need to maintain SFTP or API connections; customers can share tables with authorization and can track access records through system tables.