The SunnyData Blog

Explore insights and practical tips on mastering Databricks Data Intelligence Platform and the full spectrum of today's modern data ecosystem.

AWS

ETL

EDW

Cost, AI Josue Bogran Cost, AI Josue Bogran

Cost allocation, cloud tags, and other relevant things on Databricks

In this three-part video series, Databricks MVP Josue Bogran and Greg Kroleski from Databricks’ “Money Team” discuss cost allocation, tagging best practices, cloud innovations, and performance enhancements. The series explores Databricks' efforts to optimize cost reporting, leverage AI for insights, and empower businesses to make smarter, growth-driven decisions in 2024 and beyond.

Read More
AI Josue Bogran AI Josue Bogran

Are we in an AI Bubble?

There is a lot of buzz around GenAI, LLMs, AI, and ML. Knowing what you should implement or not implement is tough.
In this set of 3 videos, our Technical Advisor Josue Bogran has a frank and open conversation about these subjects with Denny Lee, Principal Developer Advocate at Databricks.

Read More
Integrations, Databricks, AI Josue Bogran Integrations, Databricks, AI Josue Bogran

Sigma + Databricks: A Great BI Tool for the Data Intelligence Platform

Sigma offers a user-friendly BI tool ideal for building and managing dashboards. With intuitive features, seamless embedding, and live data connections, it excels in usability. However, its steep pricing and lack of Git integration may deter small businesses. SunnyData recommends Sigma for startups and enterprises seeking responsive, customizable solutions.

Read More
Databricks, Cost, EDW, AWS, AI, Fabric, Snowflake Nicanor Medina Databricks, Cost, EDW, AWS, AI, Fabric, Snowflake Nicanor Medina

Why Startups should consider Databricks as a top choice for their data platform for analytics, AI and data management.

Databricks is a top choice for startups seeking an all-in-one data platform for analytics, AI, and data management. Its cloud-native, scalable, and cost-efficient architecture allows startups to begin small, grow, and avoid complex migrations as needs evolve.

Read More
Migrations, Databricks, ETL, EDW, AWS, AI, Fabric, Hadoop, Snowflake Nicanor Medina Migrations, Databricks, ETL, EDW, AWS, AI, Fabric, Hadoop, Snowflake Nicanor Medina

How to migrate your ETL workloads and EDW from Snowflake to Databricks

In this blog, we outline the essential steps for migrating ETL workloads and EDW from Snowflake to Databricks. From data migration to report modernization, we break down five key phases for a seamless and efficient transition to Databricks.

Read More
Migrations, Databricks, Cost, AI, Snowflake Nicanor Medina Migrations, Databricks, Cost, AI, Snowflake Nicanor Medina

Why no one migrates from Databricks to Snowflake

This blog explores why companies are increasingly migrating from Snowflake to Databricks, highlighting Databricks’ integrated platform, cost-efficiency, and comprehensive data and AI capabilities. The post examines the pitfalls of Snowflake's pricing and its struggle to replicate Databricks' functionality.

Read More
Databricks, Migrations, Cost, AI Jeronimo Acosta Databricks, Migrations, Cost, AI Jeronimo Acosta

Why Migrate to Databricks?

Migrating to Databricks offers companies unmatched benefits, including cost efficiency, scalability, and advanced AI/ML capabilities. With a unified platform and robust data governance, Databricks empowers businesses to modernize their data estates, ensuring they’re future-ready and positioned for growth.

Read More
Benchmark, AI Nicanor Medina Benchmark, AI Nicanor Medina

Step Away From “The State Of The Art”

This blog argues against the rush to adopt the latest AI technologies, emphasizing the importance of strong data engineering foundations and "Classic Analytics." It advocates for a balanced, pragmatic approach to AI adoption, ensuring long-term success over short-term gains.

Read More
Databricks, Integrations, ETL, Benchmark, AI, Fabric Jeronimo Acosta Databricks, Integrations, ETL, Benchmark, AI, Fabric Jeronimo Acosta

Fabric Meets Databricks: A Preliminary Review for Data Practitioners

This article provides an initial analysis of Microsoft Fabric, comparing it with Databricks. It discusses why Fabric may not meet enterprise needs and explores potential integrations between Fabric and Databricks, highlighting how they can complement each other in data projects.

Read More
Tools, Databricks, AI Josue Bogran Tools, Databricks, AI Josue Bogran

Databricks AI Assistant: SQL Review

Databricks' AI Assistant is now GA and excels in SQL tasks, leveraging Unity Catalog metadata. It consistently delivers functional SQL queries and follows instructions well, proving itself superior to alternatives like ChatGPT for SQL code generation. Watch the video for insights.

Read More
AI Kailash Thapa AI Kailash Thapa

Demystifying the Data Mesh: Key Aspects and Strategic Considerations.

The Data Mesh approach decentralizes data management to empower business units, facilitating quicker and informed decision-making. While promising for large institutions with mature data strategies, it presents challenges such as complexity, data fragmentation, and loss of economies of scale. SunnyData offers insights into whether Data Mesh is suitable for your organization.

Read More
Databricks, Cost, AI Jeronimo Acosta Databricks, Cost, AI Jeronimo Acosta

Winter Is So Over: Quick Guide on the 18 Big Announcements

Here we present Databricks Summit 2024 18 biggest announcements, including Generative AI tools, AI-powered BI dashboards, open-source Unity Catalog, no-code data ingestion, serverless compute, secure data collaboration, built-in AI functions for data warehousing, and the all-new Delta Lake 4.0. Discover how these advancements can unlock the full potential of your data. Get the details and see how SunnyData can help - read now!

Read More
Databricks, Cost, AI Josue Bogran Databricks, Cost, AI Josue Bogran

Cost Saving Best Practices For Databricks Workflows

Discover how to manage pipeline costs effectively with Databricks Workflows. This article offers practical tips to reduce total cost of ownership without sacrificing performance, and provides insights into understanding your costs better. Learn strategies like using job compute and spot instances, setting warnings and timeouts, leveraging task dependencies, and implementing autoscaling and tagging. Optimize your resource usage and get the most out of your Databricks environment. Read on for actionable advice to streamline your data processes.

Read More
Cost, AI Kailash Thapa Cost, AI Kailash Thapa

A Roadmap to a Successful AI Project: Planning, Execution & ROI

Disappointed by the high failure rate of AI initiatives? You're not alone. This post unveils the secrets to planning and executing a successful AI project. We detail our proven methodology for ensuring AI success, focusing on identifying high-ROI use cases and navigating the Proof-of-Concept stage effectively. Learn how to choose the right supplier, avoid common pitfalls, and ensure your AI project transitions smoothly from pilot to production, delivering real business results and a competitive edge.

Read More