Architecture and Methodology
Snowflake architecture - DBT - Fivetran - Amazon S3
This is an example using Snowflake and DBT
Beyond “Modern” Data Architecture
“MODERN” DATA ARCHITECTURES
If you asked almost any current leader in data engineering to draw a “modern” data architecture on a whiteboard (or you searched online for one), you would most certainly get something like the following:
But what’s so modern about this systems-based...
Data Hub Azure architecture for DW
This is the data architecture I've been improving to my current client.
Serverless Streaming At Scale with Azure SQL for IOT
Just before Ignite, a very interesting case study done with RXR has been released, where they showcased their IoT solution to bring safety in buildings during COVID times. It uses Azure SQL to store warm data, allowing it to be served and consumed to all downstream users,...
SQL 2019 for Big Data Architecture and DM - Features of big data clusters
SQL Server PolyBase has eased the task of querying the external data sources for the SQL Server big data clusters, by reducing the effort of moving or copying the data for making a query. SQL Server 2019 preview has introduced new connectors to data sources.
Data Lake: The big...
CouchDB - Data Replication from On-Premise to Cloud in IBM Cloud
Once ClouchDB is installed we can set it up to cloud:
First, create your account in cloud for remote replication and create a database for replication:
https://cloud.ibm.com/
In CouchDB, add the new server name address and parameters:
This is the replicated data in cloud:
Azure high-availability
Availability Zones is a high-availability offering that protects your applications and data from datacenter failures. The physical separation of Availability Zones within a region protects applications and data from datacenter failures.
All the zones are in high-availabily, but...
Azure products and services prices and comparisons
Let's start by examining the purchasing options you have with Azure. There are three main customer types on which the available purchasing options for Azure products and services are contingent, including:
Enterprise - Enterprise customers sign an Enterprise Agreement with Azure that...
Azure Cloud - Differences between On-Prem - IaaS - PaaS - SaaS and Security
Management responsibilities
One thing to understand is that these categories are layers on top of each other. For example, PaaS adds a layer on top of IaaS by providing a level of abstraction. The abstraction has the benefit of hiding the details that you may not care about, so...
Compare Azure SQL Database vs. Azure SQL Data Warehouse: Definitions, Differences and When to Use
Azure SQL Database is one of the most used services in Microsoft Azure, and I use it a lot in my projects. It is basically SQL Server in the cloud, but fully managed and more intelligent. There is another service in Azure that is kind of similar, but not quite: Azure SQL Data Warehouse....