The SunnyData Blog

Explore insights and practical tips on mastering Databricks Data Intelligence Platform and the full spectrum of today's modern data ecosystem.

AWS

ETL

EDW

Integrations, Migrations, Databricks, ETL Nicanor Medina Integrations, Migrations, Databricks, ETL Nicanor Medina

Seamless Data Integration: SAP to Databricks

Learn how to integrate SAP data into Databricks with this comprehensive blog. Discover the essential components of the SAP ecosystem, including SAP HANA, S/4HANA, and BTP, and explore proven integration methods using SparkJDBC and Azure Data Factory. Perfect for data engineers and architects looking to combine SAP's enterprise management capabilities with Databricks' advanced analytics.

Read More
Migrations, Databricks, ETL, EDW, AWS Nicanor Medina Migrations, Databricks, ETL, EDW, AWS Nicanor Medina

Redshift to Databricks - Part 2: Technical Implementation Guide

This guide dives into the technical steps required to migrate from Amazon Redshift to Databricks. Covering everything from discovery and data evaluation to security protocols and cost estimation, it offers detailed, practical strategies for managing dependencies, optimizing queries, and planning for future scalability within Databricks’ robust ecosystem.

Read More
Migrations, Databricks, ETL, EDW, AWS Nicanor Medina Migrations, Databricks, ETL, EDW, AWS Nicanor Medina

Redshift to Databricks - Part 1: Why and How to Start Your Migration

This blog introduces the strategic benefits and challenges of migrating from Amazon Redshift to Databricks. It covers Redshift’s legacy limitations, Databricks' advantages, and critical migration factors. The article provides an overview of key planning steps, including architecture considerations and phased migration strategies, setting the stage for technical execution in the upcoming part two.

Read More
Migrations, Databricks, ETL, EDW, AWS, AI, Fabric, Hadoop, Snowflake Nicanor Medina Migrations, Databricks, ETL, EDW, AWS, AI, Fabric, Hadoop, Snowflake Nicanor Medina

How to migrate your ETL workloads and EDW from Snowflake to Databricks

In this blog, we outline the essential steps for migrating ETL workloads and EDW from Snowflake to Databricks. From data migration to report modernization, we break down five key phases for a seamless and efficient transition to Databricks.

Read More
Migrations, Databricks, Cost, AI, Snowflake Nicanor Medina Migrations, Databricks, Cost, AI, Snowflake Nicanor Medina

Why no one migrates from Databricks to Snowflake

This blog explores why companies are increasingly migrating from Snowflake to Databricks, highlighting Databricks’ integrated platform, cost-efficiency, and comprehensive data and AI capabilities. The post examines the pitfalls of Snowflake's pricing and its struggle to replicate Databricks' functionality.

Read More
Databricks, Migrations, Cost, AI Jeronimo Acosta Databricks, Migrations, Cost, AI Jeronimo Acosta

Why Migrate to Databricks?

Migrating to Databricks offers companies unmatched benefits, including cost efficiency, scalability, and advanced AI/ML capabilities. With a unified platform and robust data governance, Databricks empowers businesses to modernize their data estates, ensuring they’re future-ready and positioned for growth.

Read More
Migrations, Databricks, ETL, AWS, Hadoop Kailash Thapa Migrations, Databricks, ETL, AWS, Hadoop Kailash Thapa

Hadoop to Databricks: A Guide to Data Processing, Governance and Applications

In the intricate landscape of migration planning, it is imperative to map processes and prioritize them according to their criticality. This implies a strategic process to determine the sequence in which processes should be migrated according to business.

In addition, organizations will have to define whether to follow a "lift and shift" approach or a "refactor" approach. The good news is that here we will help you choose which option is best for the scenario.

Read More
Databricks, Migrations, ETL, EDW, AWS, Hadoop Kailash Thapa Databricks, Migrations, ETL, EDW, AWS, Hadoop Kailash Thapa

Migrating Hadoop to Databricks - a deeper dive

Migrating from a large Hadoop environment to Databricks is a complex and large project. In this blog we will dive into different areas of the migration process and the challenges that the customer should plan in these areas: Administration, Data Migration, Data Processing, Security and Governance, and Data Consumption (tools and processes)

Read More
Migrations, Databricks, EDW, AWS, AI, Hadoop Kailash Thapa Migrations, Databricks, EDW, AWS, AI, Hadoop Kailash Thapa

Hadoop to Databricks Lakehouse Migration Approach and Guide

Over the past 10 years of big data analytics and data lakes, Hadoop has proven unscalable, overly complex (both onPremise and cloud versions) and unable to deliver to the business for ease of consumption or meet their innovation aspirations.

Migrating from Hadoop to Databricks will help you scale effectively, simplify your data platform and accelerate innovation with support for analytics, machine learning and AI.

Read More