Some organizations approach data quality like a crash diet. Instead, try these 6 steps for sustainable data quality at scale.
Making Data
I like to think of operationalizing data reliability within the context of physical fitness.
You can get in shape with hard work,but staying in shape requires good habits.And above all else it’s a mindset and a lifestyle.
You…
The post-modern data stack is coming. Are we ready?
Zero-ETL
If you don’t like change, data engineering is not for you. Little in this space has escaped reinvention.
The most prominent, recent examples are Snowflake and Databricks disrupting the concept of the database and ushering in the modern data stack era.
As part of this movement, Fivetran and dbt fundamentally…
I wanted to share this article we put together that illustrates how real data teams are benefiting from data observability.
Data observability, an organization’s ability to fully understand the health and quality of the data in their systems, has become one of the hottest technologies in modern data engineering.
In less than three years it has gone from anidea sketched out in…
The modern data stacks allow you to do things differently, not just at a larger scale. Take advantage of it.
Imagine you’ve been building houses with a hammer and nails for most of your career, and I gave you a nail gun. But instead of pressing it to the wood and pulling the trigger, you turn it sideways and hit the nail just like you would as if it were a hammer.
You would…
Getting started with LLMs? Here are 5 popular applications data teams at OpenAI, Vimeo, and other companies are putting into practice today.
The hype around generative AI is real, and data and ML teams are feeling the heat.
Generative
Across industries,executives are pushing their data leadersto build AI-powered products that will save time, drive revenue, or give them…
(adsbygoogle = window.adsbygoogle || []).push({});
To succeed with generative AI at scale, we need to give LLMs the diligence they deserve. Enter RAG and fine tuning.
Enterprise AI
The hype around LLMs is unprecedented, but it’s warranted. From AI-generated images of the Pope in head-to-toe Balenciaga to customer support agents without pulses, generative AI has the potential to transform society as we know it.
And in many…
GenAI that drives real business value takes real work. But it’s worth it.
5 Hard Truths About Generative AI for Technology Leaders
GenAI is everywhere you look, and organizations across industries are putting pressure on their teams to join the race — 77% of business leaders fear they’re already missing out on the benefits of GenAI.
Data teams are scrambling to answer the…
Hype is a funny thing. Sometimes you find yourself in a Godfather Part 2 situation where the hype is totally justified. You hear about it. You try it. Life is changed. Hooray!
Data Mesh
Other times, you find yourself in more of an Avatar: The Way of Water situation…where everyone around you is muttering things like “stunningly immersive,” and you’re on the sidelines…
GenAI is an ethical quagmire. What responsibility do data leaders have to navigate it? In this article, we consider the need for ethical AI and why data ethics are AI ethics.
Ethical AI
When it comes to the technology race, moving quickly has always been the hallmark of future success.
Unfortunately, moving too quickly also means we can risk overlooking the hazards waiting…
From LLMs transforming the modern data stack to data observability for vector databases, here are my predictions for the top data engineering trends in 2024.
“The data and AI space moves fast. If you don’t stop and look around once in a while, you just might miss it.”
Data & AI
2023 was the year of GenAI. And 2024 is shaping up to be…another year of GenAI.
But where…