The SunnyData Blog

Explore insights and practical tips on mastering Databricks Data Intelligence Platform and the full spectrum of today's modern data ecosystem.

AWS

ETL

EDW

Migrations, Databricks, ETL, EDW, AWS Nicanor Medina Migrations, Databricks, ETL, EDW, AWS Nicanor Medina

Redshift to Databricks - Part 2: Technical Implementation Guide

This guide dives into the technical steps required to migrate from Amazon Redshift to Databricks. Covering everything from discovery and data evaluation to security protocols and cost estimation, it offers detailed, practical strategies for managing dependencies, optimizing queries, and planning for future scalability within Databricks’ robust ecosystem.

Read More
Migrations, Databricks, ETL, EDW, AWS Nicanor Medina Migrations, Databricks, ETL, EDW, AWS Nicanor Medina

Redshift to Databricks - Part 1: Why and How to Start Your Migration

This blog introduces the strategic benefits and challenges of migrating from Amazon Redshift to Databricks. It covers Redshift’s legacy limitations, Databricks' advantages, and critical migration factors. The article provides an overview of key planning steps, including architecture considerations and phased migration strategies, setting the stage for technical execution in the upcoming part two.

Read More
Databricks, Cost, EDW, AWS, AI, Fabric, Snowflake Nicanor Medina Databricks, Cost, EDW, AWS, AI, Fabric, Snowflake Nicanor Medina

Why Startups should consider Databricks as a top choice for their data platform for analytics, AI and data management.

Databricks is a top choice for startups seeking an all-in-one data platform for analytics, AI, and data management. Its cloud-native, scalable, and cost-efficient architecture allows startups to begin small, grow, and avoid complex migrations as needs evolve.

Read More
Migrations, Databricks, ETL, EDW, AWS, AI, Fabric, Hadoop, Snowflake Nicanor Medina Migrations, Databricks, ETL, EDW, AWS, AI, Fabric, Hadoop, Snowflake Nicanor Medina

How to migrate your ETL workloads and EDW from Snowflake to Databricks

In this blog, we outline the essential steps for migrating ETL workloads and EDW from Snowflake to Databricks. From data migration to report modernization, we break down five key phases for a seamless and efficient transition to Databricks.

Read More
Databricks, Cost, AWS, AI Kailash Thapa Databricks, Cost, AWS, AI Kailash Thapa

Databricks Model Serving for end-to-end AI life-cycle management

In the evolving world of AI and ML, businesses demand efficient, secure ways to deploy and manage AI models. Databricks Model Serving offers a unified solution, enhancing security and streamlining integration. This platform ensures low-latency, scalable model deployment via a REST API, perfectly suited for web and client applications. It smartly scales to demand, using serverless computing to cut costs and improve response times, providing an effective, economical framework for enterprises navigating the complexities of AI model management.

Read More
Migrations, Databricks, ETL, AWS, Hadoop Kailash Thapa Migrations, Databricks, ETL, AWS, Hadoop Kailash Thapa

Hadoop to Databricks: A Guide to Data Processing, Governance and Applications

In the intricate landscape of migration planning, it is imperative to map processes and prioritize them according to their criticality. This implies a strategic process to determine the sequence in which processes should be migrated according to business.

In addition, organizations will have to define whether to follow a "lift and shift" approach or a "refactor" approach. The good news is that here we will help you choose which option is best for the scenario.

Read More
Databricks, Migrations, ETL, EDW, AWS, Hadoop Kailash Thapa Databricks, Migrations, ETL, EDW, AWS, Hadoop Kailash Thapa

Migrating Hadoop to Databricks - a deeper dive

Migrating from a large Hadoop environment to Databricks is a complex and large project. In this blog we will dive into different areas of the migration process and the challenges that the customer should plan in these areas: Administration, Data Migration, Data Processing, Security and Governance, and Data Consumption (tools and processes)

Read More
Migrations, Databricks, EDW, AWS, AI, Hadoop Kailash Thapa Migrations, Databricks, EDW, AWS, AI, Hadoop Kailash Thapa

Hadoop to Databricks Lakehouse Migration Approach and Guide

Over the past 10 years of big data analytics and data lakes, Hadoop has proven unscalable, overly complex (both onPremise and cloud versions) and unable to deliver to the business for ease of consumption or meet their innovation aspirations.

Migrating from Hadoop to Databricks will help you scale effectively, simplify your data platform and accelerate innovation with support for analytics, machine learning and AI.

Read More