A monthly overview of things you need to know as an architect or aspiring architect. Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with ...

Five years ago, Databricks coined the term 'data lakehouse' to describe a new type of data architecture that combines a data lake with a data warehouse. That term and data architecture are now ...

Microsoft is moving another core database management component into the cloud, continuing its broader shift away from traditional on-premises infrastructure. According to Neowin, the company has ...

If you’re trying to manage governed tags in Azure Databricks, it’s important to know the correct limits. Many users are confused because the documentation mentions limits for both scopes, but the ...

In this tutorial, you build a dataflow to move data from a Northwind OData source to an ADLS Gen2 destination, and then read that data in a notebook in Databricks. To create a new Dataflow Gen2 in ...

Here’s an easy-to-follow guide to solve hierarchical data traversal issues in Spark using GraphFrames, along with some alternative methods to improve performance. If you’re working with hierarchical ...

Hi team/ maintainers, I love the work you're doing on Data API Builder. We’ve adopted it in different areas because it gives us a unified, secure, and standards-based API layer on top of multiple data ...