Exploring the Power of Shortcuts in Microsoft Fabric
Microsoft launched Microsoft Fabric, a new end-to-end data and analytics platform, at Build 2023.
Microsoft Fabric introduces a groundbreaking feature called ‘Shortcuts.’ This innovative capability allows for seamless data virtualization across domains and clouds ‘without the need for data duplication or movement’.
In this blog post, we will delve into the most noticeable features of shortcuts and understand how they can revolutionize data integration and utilization within the Microsoft Fabric ecosystem.
Virtualize Data without Duplication
Shortcuts in Microsoft Fabric offer a game-changing approach to data virtualization. By leveraging shortcuts, users can easily virtualize data across different domains and clouds without the hassle of duplicating the data. This means that you can access and utilize data from various sources while eliminating unnecessary data movement and replication.
Symbolic Linking
At its core, a shortcut is a symbolic link that establishes a connection between two data locations. It acts as a ‘reference point’, allowing seamless access and interaction between different datasets. By creating shortcuts, you can effortlessly integrate data from warehouses into your lakehouse, expanding your data utilization capabilities.
Consolidate Data across Workspaces
One of the key benefits of shortcuts within Microsoft Fabric is the ability to consolidate data across different items or workspaces without altering the ownership of the data. This means you can reuse data multiple times without duplicating it, optimizing storage resources and improving overall efficiency.
External Storage Account Management
Shortcuts also provide flexibility when it comes to managing storage accounts. With Microsoft Fabric, you can manage existing storage accounts externally while still virtualizing them into a unified namespace called OneLake. This integration empowers you to leverage the power of shortcuts while maintaining control over your storage resources.
Seamless Integration and Accessibility
Shortcuts ensure that all data within Microsoft Fabric is mapped to a unified namespace, enabling you to access it through the same set of APIs, including the Azure Data Lake Storage (ADLS) Gen2. This streamlined approach eliminates the need for complex data movement jobs and ensures data consistency across multiple sources.
Embedded References
Shortcuts within the OneLake lakehouse act as embedded references to file store locations. This unique feature makes it appear as if the files and folders are stored locally, providing a simplified and cohesive data management experience. In reality, the files and folders are located in their original storage locations, enabling efficient data utilization.
Simplified Data Synchronization
With shortcuts, the need for setting up and monitoring data movement jobs across different sources is eliminated. By leveraging shortcuts, you can keep your data in sync across various domains and clouds without the complexities associated with traditional data synchronization methods.
Cross-Cloud Data Analysis
Microsoft Fabric's shortcut capability is not limited to its own ecosystem. It extends its functionality to competitor's storage systems such as AWS S3, with plans for compatibility with Google Storage in the near future. This cross-cloud compatibility enables users to compose and analyze data seamlessly across different clouds, leveraging transparent and smart caching to reduce egress costs and optimize data accessibility.
Shortcuts in Microsoft Fabric offer a paradigm shift in data virtualization and management. With its ability to seamlessly integrate data across domains and clouds, eliminate duplication, and simplify data utilization, shortcuts empower organizations to maximize the value of their data. By leveraging this revolutionary feature, businesses can unlock new insights, improve efficiency, and drive innovation within their data ecosystems.