+

Data Feast Weekly

Get weekly insights on modern data delivered to your inbox, straight from our hand-picked curations!

Blog

We curate exciting data updates from the perspective of data engineers, data leaders, and data architects across the globe.

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.

Evolving Data Models: Backbone of Rich User Experiences (UX) for Data Citizens

Hegel's Framework to Distill Value of Data Models underneath ANY and ALL User Interfaces, Good Traits of UX/UI in Data, and Addressing Fundamental User Emotions

Animesh Kumar
,
Travis Thompson
,
Samadrita Ghosh
,

Federated Modeling: When and Why to Adopt

The Most Straightforward Business Case You'll Find for Data Modeling

Francesco De Cassai
,
,
,

Back to Basics of Knowledge Management

Whats, Whys, and Hows of Knowledge Graphs.

Samadrita Ghosh
,
,
,

Evolution of AI in Enterprises: A Tale of How We Started Using AI for Business

Mapping the Journey of AI in enterprises, Challenges Along the Way, Strategies that Enabled Experimental AI Solutions. Bonus: Dedicated Trajectory of AI Agents.

Brij Mohan Singh
,
Ritwika Chowdhury
,
,

The Art of Discoverability and Reverse Engineering User Happiness

Core Challenges, Range of Discoverability Solutions, User Motivations, Metadata Fundamentals, and Infrastructures that Back This!

Animesh Kumar
,
Travis Thompson
,
,

Governance for AI Agents with Data Developer Platforms

Facets of Governance for AI Agents, Current Challenges/Risks and Data/AI Architectures that Address them.

Brij Mohan Singh
,
Travis Thompson
,
Ritwika Chowdhury
,

A Data Engineer's POV on the Missing Links in the Data Stack and More | S1:E4

Data Pipelines to Data Products, Shift to Unified Platforms, Nuances of On-Prem to Cloud and a dozen other hot takes!

Abhinav Singh
,
,
,

5000 Minds Strong Today. Our Journey to 5K and Beyond!

Community Favourites, Featured Voices and Works, A View Into MD101's Growth Trajectory with You, and More!

Modern Data 101
,
,
,

Data Leadership Extends Beyond Core-Data Professionals

Core-Data Leaders, Business Data Leaders, and Enablement Strategies to Lead with Data In the face of Low Data Literacy or Analytics Training

James Miller
,
Travis Thompson
,
,

A Data Manager’s True Priority Isn’t Data and More Twists with Dr. Neumann | S1:S3

Data to Dollars: Bridging Business Needs and Technical Feasibility

Dr. Dominik Neumann
,
Abhyudai Verma
,
Modern Data 101
,

So I Have A Data Product... Now What?

Assets in a Data Product Portfolio, Portfolio Management, Implementation Guidance & Other Considerations After Data Product Adoption.

Ryan Duffy
,
,
,

Crunching Data and Printing Profits with Ryan Brown | S1:E2

How every data effort drives business value by boosting revenue or reducing cost

Ryan Brown
,
Abhyudai Verma
,
Modern Data 101
,

The Power Combo of AI Agents and the Modular Data Stack: AI that Reasons

What are AI Agents, Types, Workflows, Leverage of Consistent Design Across Data & AI Stacks, Solutions for LLM Limitations, and much more!

Animesh Kumar
,
Brij Mohan Singh
,
Ritwika Chowdhury
,

The Data Product Marketplace: A Single Interface for Business

WHATs and WHYs of Marketplaces, Contrasts with Catalogs, and Marketplace Implementation Options

Arielle Rolland
,
,
,

Don’t Trust Decentralisation Yet? Game Theory Might Change Your Stance

Failures in Centralisation as a Pattern, Misinterpreted Decentralisation Techniques, and Data Products as the Prime "Players" of Smart Decentralisation.

Animesh Kumar
,
Travis Thompson
,
,

The Skill-Set to Master Your Data PM Role | A Practicing Data PM's Guide

Key Competencies, Collaborations, Responsibilities, Career Progression, and More!

Gaëlle SERET
,
,
,

Solve Governance Debt with Data Products

What exactly makes data governed, what to govern, where to integrate AI, and more!

Animesh Kumar
,
Shubhanshu Jain
,
,

The Analytics Engineering Flywheel, Shifting Left, & More With Madison Schott | S1:E1

Everything from Data Modeling and Governance to Industry Trends and Best Practices

Madison Schott
,
Abhyudai Verma
,
,

Upscaling Marketing Analytics: A CDO’s Guide to Building Data-Driven Domains

How a Data Product Stack Influences the Marketing Landscape and Redefines Prospect Journeys and much more!

Animesh Kumar
,
Bhava Kompala
,
,

Operationalizing Data Product Delivery in the Data Ecosystem

Defining the Foundations to Underpin Data Products and the Operational Processes to Build Them

Dylan Anderson
,
,
,

How to Turn Your Data Team Into Governance Heroes🦸🏻

Building Star Governance Teams, Roles & Responsibilities, Impact Overview, Tech Enablers, Best Practices, and more!

Tiankai Feng
,
Vivek Dubey
,
,

What an Actual Lean AI Strategy Looks Like?

Avoiding Compounding Costs, Multiplying Impact of AI Initiatives, Mitigating Fatal or Hidden Risks, and Always Putting Data First 🥇

Michele Nieberding
,
,
,

Our Journey to 3K! ✈️

All things Modern Data, Community Initiatives, and New Resources!

Modern Data 101
,
,
,

AI Augmentation to Scale Data Products to a Data Product Ecosystem

Where AI Augments the Data Product Lifecycle, The Significance of User Experience, and The Ability to Focus on Advanced Verticals with Less Resources at Hand

Brij Mohan Singh
,
Ritwika Chowdhury
,
Rakesh Vishvakarma
,

Where Exactly Data Becomes Product: Illustrated Guide to Data Products in Action

Concrete Step-by-Step Journey, Debunking Confusion and Dilution, and Importance of Social / Cultural Structures

Animesh Kumar
,
Travis Thompson
,
,

Could Data Products Save (Real) Money?

Value Evaluation Model, Calculation Functions, Product Remediation, and more!

Francesco De Cassai
,
,
,

Semantics and Data Product Enablement - A Practitioner's Secret

Bare-bone Purpose & Key Components of the Semantic Layer, The Data Product Divergence and Impact, and Driving Business Value at Scale.

Frances O'Rafferty
,
,
,

Tearing Down the Monolith | The Rise of Microservices & Modular Architecture in Data Engineering

Common Anti-Patterns, the Most Immediate Alternatives, and Existing Stack Boosters.

Hugo Lu
,
Vivek Dubey
,
,

Does your LLMs speak the Truth: Ensure Optimal Reliability of LLMs with the Semantic Layer

Are you building your LLMs wrong? Bring in the semantics layer as the cushioning interface for the LLM.

Animesh Kumar
,
Ritwika Chowdhury
,
,

dbt for Data Products: Cost Savings, Experience, & Monetisation | Part 3

Part 3 of the Series on Leveraging Your Existing Stacks/Tools to Build Data Products

Animesh Kumar
,
Modern Data 101
,
,

Medallion Approach to Data Products: Beyond the Promised "Gold"

Trustworthy Doesn't Mean Certified: The Different Degrees of Trust in a Data Mesh

Francesco De Cassai
,
Modern Data 101
,
,

Usage Analytics Roadblocks: Solving with Model-First Data Products

The pangs of usage analytics, purpose-driven and measurable solutions, and a direct bridge between data and business like never before!

Shubhanshu Jain
,
Soumadip De
,
Ritwika Chowdhury
,

Snowflake for Data Products: Data Monetisation & Experience | Part 2

Part 2 on Leveraging Existing Stacks by Optimising the Three Forks of Business: Cost Savings, Monetisation, and Experience of Data Citizens

Animesh Kumar
,
Dr. Balaji Muthusubramanian
,
Samadrita Ghosh
,

Build Data Products With Snowflake | Part 1: Leveraging Existing Stacks

Optimising Snowflake Cost, Integrating Snowflake Sources, and Driving Faster Bus

Animesh Kumar
,
Dr. Balaji Muthusubramanian
,
Samadrita Ghosh
,

How to Create a Governance Strategy That Fits Decentralisation Like a Glove

Need to Shift Right, Federated Governance Fundamentals, & Resolving Policy Confl

Charlotte Ledoux
,
Vivek Dubey
,
Modern Data 101
,

How to Supercharge Your MarTech Stack

Recipe for a "Secret Sauce", Centralised Data Platforms, and the Before and Afte

Michele Nieberding
,
Modern Data 101
,
,

Building Data Platforms: The Mistake Organisations Make

Thinking of Building Your Own Data Developer Platform? Here's a note from platfo

Travis Thompson
,
Modern Data 101
,
,

The Semantic Layer Movement: The Rise & Current State

Semantic Mistrust, The Reliable Semantic Stack, Data APIs & Products

Animesh Kumar
,
Modern Data 101
,
,

Data Products Speak Revenue. How?

Purpose-Driven Capability of Data Products to Generate Revenue Streams

Shubhanshu Jain
,
Ritwika Chowdhury
,
,

Our Journey to 2K! ✈️

All things Data Products, Impactful Approaches, Community Perspectives, and New

Modern Data 101
,
,
,

🎖️ Special Edition: Celebrating Women in Data!

Women In Data: Building Today, Shaping Tomorrow!

Modern Data 101
,
,
,

🎮 Unlocking Actionable Insights: A Primer from a Product Team

The power of simplicity and building it as an experience for all your data citiz

Animesh Kumar
,
Shubhanshu Jain
,
Samadrita Ghosh
,

Versioning, Cataloging, and Decommissioning Data Products

Non-Disruptive Management Of The Evolving Landscape Of Data Products: Part 2

Ayush Sharma
,
Modern Data 101
,
,

How does a Data Product Strategy Impact the Day-to-Days of Your CMO, CDO, or CFO

Have faith in data products after consistent research? Here's one way to bring y

Bhava Kompala
,
Animesh Kumar
,
,

🎯 End-to-End Guide to Building Data Products

Collection of our Top Resources, from Strategy to Data Product Evolution, and mo

Modern Data 101
,
,
,

Our Journey to 1K ✈️

Conversations, Innovations, Milestones, and More!

Modern Data 101
,
,
,

Transitioning to a Data Product Ecosystem: Leveraging the Evolutionary Architecture

4D Architectures, Data-Driven Routing, Feature Toggles, and more!

Travis Thompson
,
Animesh Kumar
,
,

Best Practices to Optimize Generative AI Implementation

AI Applications as Consumers, Data as a Product for Fuel

Abhyudai Verma
,
Modern Data 101
,
,

The Uncanny Resemblance b/w Data Products on DDPs and Software Development

Software for Data, Community Conversations, Upcoming Events, and more!

Animesh Kumar
,
Modern Data 101
,
,

💡 Data Community Roundup: Designing Data Products

Foundational Laws, Independent Papers, and Gripping Design Recipes

Animesh Kumar
,
Swami Achari
,
,

Why Data Craves Product Managers Beyond Doubt

The Data Product Manager, Product Strategies, and the Pointless War on Definitio

Animesh Kumar
,
Modern Data 101
,
,

The Data Product Strategy - Becoming Metrics-First

Proven Models, Metric Model as a reflection, and Metric Model Enablement

Animesh Kumar
,
Travis Thompson
,
Samadrita Ghosh
,

The Data Industry's Convergence: Fragmented to Unified Experiences

Trajectories of Big Players in Data and the Open Data Infrastructure Specificati

Animesh Kumar
,
Modern Data 101
,
,

Figma for Data Products: Novel tech requires enough experimentation and a big playground

Designing Data Products without Collateral Damage

Animesh Kumar
,
Modern Data 101
,
,

What comes to mind when you think Data Infrastructure?

Data Infrastructure in the context of Data Products

Animesh Kumar
,
Modern Data 101
,
,

The Infrastructure Subset of Data Products

Experiencing the Data Infrastructure as a Product

Animesh Kumar
,
Travis Thompson
,
,

Data Product Mart? Can Data Really be treated as a Product

Short Answer: Yes. Read on for the long version

Animesh Kumar
,
Modern Data 101
,
,

The Long Due Renewal of Data Storage for Accelerated Data Applications - Part 1

Design, Approach, and Experience

Animesh Kumar
,
Travis Thompson
,
,

Evolution of the Data Landscape: Fragmented Tools to Unified Interfaces

From the perspectives of Business, Technology, and Product

Animesh Kumar
,
Travis Thompson
,
Srujan Akula
,

Role of Contracts in a Unified Data Infrastructure

Animesh Kumar
,
Modern Data 101
,
,

The Essence of Having Your Own Data Developer Platform

DDP value in context of data design patterns, fundamental principles, and core p

Animesh Kumar
,
Travis Thompson
,
,

Re-Engineering the Data Value Chain - Part 1

Challenges of the prevalent data value chain and transforming it with a Data-Fir

Animesh Kumar
,
Modern Data 101
,
,

Data Modeling: Resurrection Stone for Scalable and Independent AI/ML

Current data challenges, potential solutions, and lame gifs 🫣

Animesh Kumar
,
Modern Data 101
,
,

Agile for Data

Agile Data Mindset, Data Modeling, and Data Debt Dissolution

Animesh Kumar
,
Modern Data 101
,
,

Are you feeding your data debt?

The four horsemen of data debt, generational changes, and potential solutions

Animesh Kumar
,
Modern Data 101
,
,

Data-First Stack as an enabler for Data Products

The Data Product Quantum, the Contractual Landscape, and Right-to-Left Data Mode

Animesh Kumar
,
Modern Data 101
,
,

Optimising Data Modeling for the Data-First Stack

Existing Challenges, Solutions, and Proposed Data Flow

Animesh Kumar
,
Modern Data 101
,
,

The Go-To Metrics for Data Products: Start with these Few

We are talking about data products, so of course we should speak about metrics

Timo Dechau
,
Modern Data 101
,
,

Data Pipelines for Data Products

Key Components, Recommended Tools, and Fundamental Development Concepts

Bruno Gonzalez
,
Modern Data 101
,
,

How to Build Data Products - Design: Part 1/4

Metric-Targeting, Semantic Engineering, Model Validation, and More.

Animesh Kumar
,
Shubhanshu Jain
,
Samadrita Ghosh
,

How to Build Data Products - Evolve: Part 4/4

Advanced SLOs, Feedback Loops, Optimised Data Product, and more!

Animesh Kumar
,
Manisha Jain
,
Samadrita Ghosh
,
Nikhil Singh

How to Build Data Products - Deploy: Part 3/4

Doubling down on the power of Unified Experiences

Manisha Jain
,
Animesh Kumar
,
Shubhanshu Jain
,
Samadrita Ghosh

The Approach vs Technology Confusion: Where do Data Products Fit In?

Lifecycles, Fundamental Anatomy, and Value for Aspiring Metric-Driven Orgs

Modern Data 101
,
Animesh Kumar
,
,

Role of Interoperability in End-to-End Data Governance

As Implemented by Data Developer Platforms

Travis Thompson
,
Animesh Kumar
,
,

The Essential "Personality Traits" You Need in Your Data Platform

Revamping Your Data Platforms: Embracing the ‘Composable’ Approach

Ritwika Chowdhury
,
Modern Data 101
,
,

Challenges of Multiple Data Products, Duplication Management, and Governance

Non-Disruptive Management of the Evolving Landscape Of Data Products: Part 1

Ayush Sharma
,
Modern Data 101
,
,

The Complete Data Product Lifecycle at a Glance

Purpose of every stage, end products, stakeholders (an approach not technology)

Bhava Kompala
,
Animesh Kumar
,
,

Recap of 2023's Transformative Data Landscape

State of the MDS, Aspirational GenAI Projects, Internet-Breaking Controversies

Swami Achari
,
Modern Data 101
,
,

Understanding the Clear Bounds for Data Products in the Organizational Data Mesh Journey

Demystifying the Blurry Boundaries of Data Products

Ayush Sharma
,
,
,

Data Modeling from the POV of a Data Product Developer

Solving the persistent challenges of data modeling

Animesh Kumar
,
Travis Thompson
,
,

Building your Sausage Machine for Data Products 🌭: Less Tech, More Strategy

Product Mindset, Bizarre Analogies, and Your Compact Canvas

Travis Thompson
,
Modern Data 101
,
,

Weight of the Modern Data Stack

Double-edged outcome, alignment with Agile, and Impact

Animesh Kumar
,
Modern Data 101
,
,

What's "Modern" in the Modern Data Stack

Industry scenarios in 2024, community reviews, platform standards, and more!

Modern Data 101
,
,
,

Evolution of the Data Stack: The story of how we interpret ever-growing data

Traditional Data Stack → Modern Data Stack → Data-First Stack

Animesh Kumar
,
Modern Data 101
,
,

How to Build Data Products - Develop: Part 2/4

Ingredients, Experience, Platform Abilities, and More!

Animesh Kumar
,
Shubhanshu Jain
,
Manish Agrawal
,

Data Orchestration for Data Products - Hugo Lu

Open Source Tools, All-in-One Control Planes, & Impact on Data Product Velocity

Hugo Lu
,
Modern Data 101
,
Vivek Dubey
,

Bringing Home Your Very First Data Product

From Logical Modeling and Product Ideation to Data Product Improvement

Francesco De Cassai
,
Modern Data 101
,
,

The Data Contract Pivot in Data Engineering

Community Highlights & Pivotal Pieces that Shaped the Data Contracts Journey

Animesh Kumar
,
Abhi Sivasailam
,
Amy Raygada
,
Andrea Gioia

Metrics-Focused Data Strategy with Model-First Data Products

Purpose-driven data, metric dependency trees, product prototypes, and more!

Animesh Kumar
,
Shubhanshu Jain
,
Samadrita Ghosh
,
Nikhil Singh
All
Data Platform
Data Operations
Data Strategy
Data Lifecycle
Data Architecture

Evolving Data Models: Backbone of Rich User Experiences (UX) for Data Citizens

14 min
|
Hegel's Framework to Distill Value of Data Models underneath ANY and ALL User Interfaces, Good Traits of UX/UI in Data, and Addressing Fundamental User Emotions
Animesh Kumar
,
 and
Travis Thompson
,
 and
Samadrita Ghosh
,
 and

Federated Modeling: When and Why to Adopt

7 min
|
The Most Straightforward Business Case You'll Find for Data Modeling
Francesco De Cassai
,
 and
,
 and
,
 and

Back to Basics of Knowledge Management

6 min
|
Whats, Whys, and Hows of Knowledge Graphs.
Samadrita Ghosh
,
 and
,
 and
,
 and

Evolution of AI in Enterprises: A Tale of How We Started Using AI for Business

10 min
|
Mapping the Journey of AI in enterprises, Challenges Along the Way, Strategies that Enabled Experimental AI Solutions. Bonus: Dedicated Trajectory of AI Agents.
Brij Mohan Singh
,
 and
Ritwika Chowdhury
,
 and
,
 and

The Art of Discoverability and Reverse Engineering User Happiness

15 min
|
Core Challenges, Range of Discoverability Solutions, User Motivations, Metadata Fundamentals, and Infrastructures that Back This!
Animesh Kumar
,
 and
Travis Thompson
,
 and
,
 and

Governance for AI Agents with Data Developer Platforms

14 min
|
Facets of Governance for AI Agents, Current Challenges/Risks and Data/AI Architectures that Address them.
Brij Mohan Singh
,
 and
Travis Thompson
,
 and
Ritwika Chowdhury
,
 and

A Data Engineer's POV on the Missing Links in the Data Stack and More | S1:E4

24 min
|
Data Pipelines to Data Products, Shift to Unified Platforms, Nuances of On-Prem to Cloud and a dozen other hot takes!
Abhinav Singh
,
 and
,
 and
,
 and

5000 Minds Strong Today. Our Journey to 5K and Beyond!

4 min
|
Community Favourites, Featured Voices and Works, A View Into MD101's Growth Trajectory with You, and More!
Modern Data 101
,
 and
,
 and
,
 and

Data Leadership Extends Beyond Core-Data Professionals

11 min
|
Core-Data Leaders, Business Data Leaders, and Enablement Strategies to Lead with Data In the face of Low Data Literacy or Analytics Training
James Miller
,
 and
Travis Thompson
,
 and
,
 and

A Data Manager’s True Priority Isn’t Data and More Twists with Dr. Neumann | S1:S3

38 min
|
Data to Dollars: Bridging Business Needs and Technical Feasibility
Dr. Dominik Neumann
,
 and
Abhyudai Verma
,
 and
Modern Data 101
,
 and

So I Have A Data Product... Now What?

10 min
|
Assets in a Data Product Portfolio, Portfolio Management, Implementation Guidance & Other Considerations After Data Product Adoption.
Ryan Duffy
,
 and
,
 and
,
 and

Crunching Data and Printing Profits with Ryan Brown | S1:E2

85 min
|
How every data effort drives business value by boosting revenue or reducing cost
Ryan Brown
,
 and
Abhyudai Verma
,
 and
Modern Data 101
,
 and

The Power Combo of AI Agents and the Modular Data Stack: AI that Reasons

13 min
|
What are AI Agents, Types, Workflows, Leverage of Consistent Design Across Data & AI Stacks, Solutions for LLM Limitations, and much more!
Animesh Kumar
,
 and
Brij Mohan Singh
,
 and
Ritwika Chowdhury
,
 and

The Data Product Marketplace: A Single Interface for Business

7 min
|
WHATs and WHYs of Marketplaces, Contrasts with Catalogs, and Marketplace Implementation Options
Arielle Rolland
,
 and
,
 and
,
 and

Don’t Trust Decentralisation Yet? Game Theory Might Change Your Stance

10 min
|
Failures in Centralisation as a Pattern, Misinterpreted Decentralisation Techniques, and Data Products as the Prime "Players" of Smart Decentralisation.
Animesh Kumar
,
 and
Travis Thompson
,
 and
,
 and

The Skill-Set to Master Your Data PM Role | A Practicing Data PM's Guide

9 min
|
Key Competencies, Collaborations, Responsibilities, Career Progression, and More!
Gaëlle SERET
,
 and
,
 and
,
 and

Solve Governance Debt with Data Products

8 min
|
What exactly makes data governed, what to govern, where to integrate AI, and more!
Animesh Kumar
,
 and
Shubhanshu Jain
,
 and
,
 and

The Analytics Engineering Flywheel, Shifting Left, & More With Madison Schott | S1:E1

5 min
|
Everything from Data Modeling and Governance to Industry Trends and Best Practices
Madison Schott
,
 and
Abhyudai Verma
,
 and
,
 and

Upscaling Marketing Analytics: A CDO’s Guide to Building Data-Driven Domains

16 min
|
How a Data Product Stack Influences the Marketing Landscape and Redefines Prospect Journeys and much more!
Animesh Kumar
,
 and
Bhava Kompala
,
 and
,
 and

Operationalizing Data Product Delivery in the Data Ecosystem

16 min
|
Defining the Foundations to Underpin Data Products and the Operational Processes to Build Them
Dylan Anderson
,
 and
,
 and
,
 and

How to Turn Your Data Team Into Governance Heroes🦸🏻

13 min
|
Building Star Governance Teams, Roles & Responsibilities, Impact Overview, Tech Enablers, Best Practices, and more!
Tiankai Feng
,
 and
Vivek Dubey
,
 and
,
 and

What an Actual Lean AI Strategy Looks Like?

8 min
|
Avoiding Compounding Costs, Multiplying Impact of AI Initiatives, Mitigating Fatal or Hidden Risks, and Always Putting Data First 🥇
Michele Nieberding
,
 and
,
 and
,
 and

Our Journey to 3K! ✈️

4 min
|
All things Modern Data, Community Initiatives, and New Resources!
Modern Data 101
,
 and
,
 and
,
 and

AI Augmentation to Scale Data Products to a Data Product Ecosystem

10 min
|
Where AI Augments the Data Product Lifecycle, The Significance of User Experience, and The Ability to Focus on Advanced Verticals with Less Resources at Hand
Brij Mohan Singh
,
 and
Ritwika Chowdhury
,
 and
Rakesh Vishvakarma
,
 and

Where Exactly Data Becomes Product: Illustrated Guide to Data Products in Action

12 min
|
Concrete Step-by-Step Journey, Debunking Confusion and Dilution, and Importance of Social / Cultural Structures
Animesh Kumar
,
 and
Travis Thompson
,
 and
,
 and

Could Data Products Save (Real) Money?

7 min
|
Value Evaluation Model, Calculation Functions, Product Remediation, and more!
Francesco De Cassai
,
 and
,
 and
,
 and

Semantics and Data Product Enablement - A Practitioner's Secret

11 min
|
Bare-bone Purpose & Key Components of the Semantic Layer, The Data Product Divergence and Impact, and Driving Business Value at Scale.
Frances O'Rafferty
,
 and
,
 and
,
 and

Tearing Down the Monolith | The Rise of Microservices & Modular Architecture in Data Engineering

9 min
|
Common Anti-Patterns, the Most Immediate Alternatives, and Existing Stack Boosters.
Hugo Lu
,
 and
Vivek Dubey
,
 and
,
 and

Does your LLMs speak the Truth: Ensure Optimal Reliability of LLMs with the Semantic Layer

12 min
|
Are you building your LLMs wrong? Bring in the semantics layer as the cushioning interface for the LLM.
Animesh Kumar
,
 and
Ritwika Chowdhury
,
 and
,
 and

dbt for Data Products: Cost Savings, Experience, & Monetisation | Part 3

15 min
|
Part 3 of the Series on Leveraging Your Existing Stacks/Tools to Build Data Products
Animesh Kumar
,
 and
Modern Data 101
,
 and
,
 and

Medallion Approach to Data Products: Beyond the Promised "Gold"

8 min
|
Trustworthy Doesn't Mean Certified: The Different Degrees of Trust in a Data Mesh
Francesco De Cassai
,
 and
Modern Data 101
,
 and
,
 and

Usage Analytics Roadblocks: Solving with Model-First Data Products

15 min
|
The pangs of usage analytics, purpose-driven and measurable solutions, and a direct bridge between data and business like never before!
Shubhanshu Jain
,
 and
Soumadip De
,
 and
Ritwika Chowdhury
,
 and

Snowflake for Data Products: Data Monetisation & Experience | Part 2

9 min
|
Part 2 on Leveraging Existing Stacks by Optimising the Three Forks of Business: Cost Savings, Monetisation, and Experience of Data Citizens
Animesh Kumar
,
 and
Dr. Balaji Muthusubramanian
,
 and
Samadrita Ghosh
,
 and

Build Data Products With Snowflake | Part 1: Leveraging Existing Stacks

10 min
|
Optimising Snowflake Cost, Integrating Snowflake Sources, and Driving Faster Bus
Animesh Kumar
,
 and
Dr. Balaji Muthusubramanian
,
 and
Samadrita Ghosh
,
 and

How to Supercharge Your MarTech Stack

14 min
|
Recipe for a "Secret Sauce", Centralised Data Platforms, and the Before and Afte
Michele Nieberding
,
 and
Modern Data 101
,
 and
,
 and

The Semantic Layer Movement: The Rise & Current State

14 min
|
Semantic Mistrust, The Reliable Semantic Stack, Data APIs & Products
Animesh Kumar
,
 and
Modern Data 101
,
 and
,
 and

Data Products Speak Revenue. How?

10 min
|
Purpose-Driven Capability of Data Products to Generate Revenue Streams
Shubhanshu Jain
,
 and
Ritwika Chowdhury
,
 and
,
 and

How to Create a Governance Strategy That Fits Decentralisation Like a Glove

10 min
|
Need to Shift Right, Federated Governance Fundamentals, & Resolving Policy Confl
Charlotte Ledoux
,
 and
Vivek Dubey
,
 and
Modern Data 101
,
 and

Our Journey to 2K! ✈️

7 min
|
All things Data Products, Impactful Approaches, Community Perspectives, and New
Modern Data 101
,
 and
,
 and
,
 and

Data Orchestration for Data Products - Hugo Lu

7 min
|
Open Source Tools, All-in-One Control Planes, & Impact on Data Product Velocity
Hugo Lu
,
 and
Modern Data 101
,
 and
Vivek Dubey
,
 and

Building Data Platforms: The Mistake Organisations Make

7 min
|
Thinking of Building Your Own Data Developer Platform? Here's a note from platfo
Travis Thompson
,
 and
Modern Data 101
,
 and
,
 and

Bringing Home Your Very First Data Product

6 min
|
From Logical Modeling and Product Ideation to Data Product Improvement
Francesco De Cassai
,
 and
Modern Data 101
,
 and
,
 and

Metrics-Focused Data Strategy with Model-First Data Products

10 min
|
Purpose-driven data, metric dependency trees, product prototypes, and more!
Animesh Kumar
,
 and
Shubhanshu Jain
,
 and
Samadrita Ghosh
,
 and
Nikhil Singh

🎖️ Special Edition: Celebrating Women in Data!

6 min
|
Women In Data: Building Today, Shaping Tomorrow!
Modern Data 101
,
 and
,
 and
,
 and

🎮 Unlocking Actionable Insights: A Primer from a Product Team

9 min
|
The power of simplicity and building it as an experience for all your data citiz
Animesh Kumar
,
 and
Shubhanshu Jain
,
 and
Samadrita Ghosh
,
 and

What's "Modern" in the Modern Data Stack

10 min
|
Industry scenarios in 2024, community reviews, platform standards, and more!
Modern Data 101
,
 and
,
 and
,
 and

Role of Interoperability in End-to-End Data Governance

5 min
|
As Implemented by Data Developer Platforms
Travis Thompson
,
 and
Animesh Kumar
,
 and
,
 and

Versioning, Cataloging, and Decommissioning Data Products

9 min
|
Non-Disruptive Management Of The Evolving Landscape Of Data Products: Part 2
Ayush Sharma
,
 and
Modern Data 101
,
 and
,
 and

Challenges of Multiple Data Products, Duplication Management, and Governance

5 min
|
Non-Disruptive Management of the Evolving Landscape Of Data Products: Part 1
Ayush Sharma
,
 and
Modern Data 101
,
 and
,
 and

The Essential "Personality Traits" You Need in Your Data Platform

7 min
|
Revamping Your Data Platforms: Embracing the ‘Composable’ Approach
Ritwika Chowdhury
,
 and
Modern Data 101
,
 and
,
 and

Understanding the Clear Bounds for Data Products in the Organizational Data Mesh Journey

7 min
|
Demystifying the Blurry Boundaries of Data Products
Ayush Sharma
,
 and
,
 and
,
 and

The Approach vs Technology Confusion: Where do Data Products Fit In?

4 min
|
Lifecycles, Fundamental Anatomy, and Value for Aspiring Metric-Driven Orgs
Modern Data 101
,
 and
Animesh Kumar
,
 and
,
 and

Building your Sausage Machine for Data Products 🌭: Less Tech, More Strategy

6 min
|
Product Mindset, Bizarre Analogies, and Your Compact Canvas
Travis Thompson
,
 and
Modern Data 101
,
 and
,
 and

Recap of 2023's Transformative Data Landscape

10 min
|
State of the MDS, Aspirational GenAI Projects, Internet-Breaking Controversies
Swami Achari
,
 and
Modern Data 101
,
 and
,
 and

The Complete Data Product Lifecycle at a Glance

6 min
|
Purpose of every stage, end products, stakeholders (an approach not technology)
Bhava Kompala
,
 and
Animesh Kumar
,
 and
,
 and

How does a Data Product Strategy Impact the Day-to-Days of Your CMO, CDO, or CFO

7 min
|
Have faith in data products after consistent research? Here's one way to bring y
Bhava Kompala
,
 and
Animesh Kumar
,
 and
,
 and

🎯 End-to-End Guide to Building Data Products

5 min
|
Collection of our Top Resources, from Strategy to Data Product Evolution, and mo
Modern Data 101
,
 and
,
 and
,
 and

Our Journey to 1K ✈️

9 min
|
Conversations, Innovations, Milestones, and More!
Modern Data 101
,
 and
,
 and
,
 and

Transitioning to a Data Product Ecosystem: Leveraging the Evolutionary Architecture

10 min
|
4D Architectures, Data-Driven Routing, Feature Toggles, and more!
Travis Thompson
,
 and
Animesh Kumar
,
 and
,
 and

How to Build Data Products - Evolve: Part 4/4

18 min
|
Advanced SLOs, Feedback Loops, Optimised Data Product, and more!
Animesh Kumar
,
 and
Manisha Jain
,
 and
Samadrita Ghosh
,
 and
Nikhil Singh

Data Pipelines for Data Products

14 min
|
Key Components, Recommended Tools, and Fundamental Development Concepts
Bruno Gonzalez
,
 and
Modern Data 101
,
 and
,
 and

Best Practices to Optimize Generative AI Implementation

8 min
|
AI Applications as Consumers, Data as a Product for Fuel
Abhyudai Verma
,
 and
Modern Data 101
,
 and
,
 and

How to Build Data Products - Deploy: Part 3/4

17 min
|
Doubling down on the power of Unified Experiences
Manisha Jain
,
 and
Animesh Kumar
,
 and
Shubhanshu Jain
,
 and
Samadrita Ghosh

The Uncanny Resemblance b/w Data Products on DDPs and Software Development

8 min
|
Software for Data, Community Conversations, Upcoming Events, and more!
Animesh Kumar
,
 and
Modern Data 101
,
 and
,
 and

How to Build Data Products - Develop: Part 2/4

8 min
|
Ingredients, Experience, Platform Abilities, and More!
Animesh Kumar
,
 and
Shubhanshu Jain
,
 and
Manish Agrawal
,
 and

💡 Data Community Roundup: Designing Data Products

8 min
|
Foundational Laws, Independent Papers, and Gripping Design Recipes
Animesh Kumar
,
 and
Swami Achari
,
 and
,
 and

How to Build Data Products - Design: Part 1/4

12 min
|
Metric-Targeting, Semantic Engineering, Model Validation, and More.
Animesh Kumar
,
 and
Shubhanshu Jain
,
 and
Samadrita Ghosh
,
 and

Why Data Craves Product Managers Beyond Doubt

7 min
|
The Data Product Manager, Product Strategies, and the Pointless War on Definitio
Animesh Kumar
,
 and
Modern Data 101
,
 and
,
 and

The Data Product Strategy - Becoming Metrics-First

15 min
|
Proven Models, Metric Model as a reflection, and Metric Model Enablement
Animesh Kumar
,
 and
Travis Thompson
,
 and
Samadrita Ghosh
,
 and

The Data Contract Pivot in Data Engineering

7 min
|
Community Highlights & Pivotal Pieces that Shaped the Data Contracts Journey
Animesh Kumar
,
 and
Abhi Sivasailam
,
 and
Amy Raygada
,
 and
Andrea Gioia

The Data Industry's Convergence: Fragmented to Unified Experiences

10 min
|
Trajectories of Big Players in Data and the Open Data Infrastructure Specificati
Animesh Kumar
,
 and
Modern Data 101
,
 and
,
 and

Figma for Data Products: Novel tech requires enough experimentation and a big playground

11 min
|
Designing Data Products without Collateral Damage
Animesh Kumar
,
 and
Modern Data 101
,
 and
,
 and

What comes to mind when you think Data Infrastructure?

8 min
|
Data Infrastructure in the context of Data Products
Animesh Kumar
,
 and
Modern Data 101
,
 and
,
 and

The Long Due Renewal of Data Storage for Accelerated Data Applications - Part 1

13 min
|
Design, Approach, and Experience
Animesh Kumar
,
 and
Travis Thompson
,
 and
,
 and

Evolution of the Data Landscape: Fragmented Tools to Unified Interfaces

21 min
|
From the perspectives of Business, Technology, and Product
Animesh Kumar
,
 and
Travis Thompson
,
 and
Srujan Akula
,
 and

The Infrastructure Subset of Data Products

15 min
|
Experiencing the Data Infrastructure as a Product
Animesh Kumar
,
 and
Travis Thompson
,
 and
,
 and

The Go-To Metrics for Data Products: Start with these Few

12 min
|
We are talking about data products, so of course we should speak about metrics
Timo Dechau
,
 and
Modern Data 101
,
 and
,
 and

Data Product Mart? Can Data Really be treated as a Product

8 min
|
Short Answer: Yes. Read on for the long version
Animesh Kumar
,
 and
Modern Data 101
,
 and
,
 and

Role of Contracts in a Unified Data Infrastructure

14 min
|
Animesh Kumar
,
 and
Modern Data 101
,
 and
,
 and

Data Modeling from the POV of a Data Product Developer

10 min
|
Solving the persistent challenges of data modeling
Animesh Kumar
,
 and
Travis Thompson
,
 and
,
 and

The Essence of Having Your Own Data Developer Platform

24 min
|
DDP value in context of data design patterns, fundamental principles, and core p
Animesh Kumar
,
 and
Travis Thompson
,
 and
,
 and

Re-Engineering the Data Value Chain - Part 1

17 min
|
Challenges of the prevalent data value chain and transforming it with a Data-Fir
Animesh Kumar
,
 and
Modern Data 101
,
 and
,
 and

Data-First Stack as an enabler for Data Products

14 min
|
The Data Product Quantum, the Contractual Landscape, and Right-to-Left Data Mode
Animesh Kumar
,
 and
Modern Data 101
,
 and
,
 and

Evolution of the Data Stack: The story of how we interpret ever-growing data

10 min
|
Traditional Data Stack → Modern Data Stack → Data-First Stack
Animesh Kumar
,
 and
Modern Data 101
,
 and
,
 and

Data Modeling: Resurrection Stone for Scalable and Independent AI/ML

9 min
|
Current data challenges, potential solutions, and lame gifs 🫣
Animesh Kumar
,
 and
Modern Data 101
,
 and
,
 and

Optimising Data Modeling for the Data-First Stack

11 min
|
Existing Challenges, Solutions, and Proposed Data Flow
Animesh Kumar
,
 and
Modern Data 101
,
 and
,
 and

Agile for Data

10 min
|
Agile Data Mindset, Data Modeling, and Data Debt Dissolution
Animesh Kumar
,
 and
Modern Data 101
,
 and
,
 and

Weight of the Modern Data Stack

6 min
|
Double-edged outcome, alignment with Agile, and Impact
Animesh Kumar
,
 and
Modern Data 101
,
 and
,
 and

Are you feeding your data debt?

10 min
|
The four horsemen of data debt, generational changes, and potential solutions
Animesh Kumar
,
 and
Modern Data 101
,
 and
,
 and

Governance for AI Agents with Data Developer Platforms

Facets of Governance for AI Agents, Current Challenges/Risks and Data/AI Architectures that Address them.
Dec 5, 2024
Data Platform
14 min
Brij Mohan Singh
,
and
Travis Thompson
,
and
Ritwika Chowdhury
,
 and

How to Build Data Products - Evolve: Part 4/4

Advanced SLOs, Feedback Loops, Optimised Data Product, and more!
Nov 2, 2023
Data Platform
18 min
Animesh Kumar
,
and
Manisha Jain
,
and
Samadrita Ghosh
,
 and
Nikhil Singh

Building your Sausage Machine for Data Products 🌭: Less Tech, More Strategy

Product Mindset, Bizarre Analogies, and Your Compact Canvas
Dec 22, 2023
Data Platform
6 min
Travis Thompson
,
and
Modern Data 101
,
and
,
 and

Evolution of the Data Stack: The story of how we interpret ever-growing data

Traditional Data Stack → Modern Data Stack → Data-First Stack
Feb 21, 2023
Data Platform
10 min
Animesh Kumar
,
and
Modern Data 101
,
and
,
 and

The Data Contract Pivot in Data Engineering

Community Highlights & Pivotal Pieces that Shaped the Data Contracts Journey
Aug 17, 2023
Data Platform
7 min
Animesh Kumar
,
and
Abhi Sivasailam
,
and
Amy Raygada
,
 and
Andrea Gioia

The Art of Discoverability and Reverse Engineering User Happiness

Core Challenges, Range of Discoverability Solutions, User Motivations, Metadata Fundamentals, and Infrastructures that Back This!
Dec 12, 2024
Data Operations
15 min
Animesh Kumar
,
and
Travis Thompson
,
and
,
 and

A Data Engineer's POV on the Missing Links in the Data Stack and More | S1:E4

Data Pipelines to Data Products, Shift to Unified Platforms, Nuances of On-Prem to Cloud and a dozen other hot takes!
Nov 28, 2024
Data Operations
24 min
Abhinav Singh
,
and
,
and
,
 and

So I Have A Data Product... Now What?

Assets in a Data Product Portfolio, Portfolio Management, Implementation Guidance & Other Considerations After Data Product Adoption.
Nov 7, 2024
Data Operations
10 min
Ryan Duffy
,
and
,
and
,
 and

How to Turn Your Data Team Into Governance Heroes🦸🏻

Building Star Governance Teams, Roles & Responsibilities, Impact Overview, Tech Enablers, Best Practices, and more!
Aug 29, 2024
Data Operations
13 min
Tiankai Feng
,
and
Vivek Dubey
,
and
,
 and

Evolving Data Models: Backbone of Rich User Experiences (UX) for Data Citizens

Hegel's Framework to Distill Value of Data Models underneath ANY and ALL User Interfaces, Good Traits of UX/UI in Data, and Addressing Fundamental User Emotions
Jan 10, 2025
Data Strategy
14 min
Animesh Kumar
,
and
Travis Thompson
,
and
Samadrita Ghosh
,
 and

Back to Basics of Knowledge Management

Whats, Whys, and Hows of Knowledge Graphs.
Dec 26, 2024
Data Strategy
6 min
Samadrita Ghosh
,
and
,
and
,
 and

Evolution of AI in Enterprises: A Tale of How We Started Using AI for Business

Mapping the Journey of AI in enterprises, Challenges Along the Way, Strategies that Enabled Experimental AI Solutions. Bonus: Dedicated Trajectory of AI Agents.
Dec 19, 2024
Data Strategy
10 min
Brij Mohan Singh
,
and
Ritwika Chowdhury
,
and
,
 and

Data Leadership Extends Beyond Core-Data Professionals

Core-Data Leaders, Business Data Leaders, and Enablement Strategies to Lead with Data In the face of Low Data Literacy or Analytics Training
Nov 21, 2024
Data Strategy
11 min
James Miller
,
and
Travis Thompson
,
and
,
 and

A Data Manager’s True Priority Isn’t Data and More Twists with Dr. Neumann | S1:S3

Data to Dollars: Bridging Business Needs and Technical Feasibility
Nov 14, 2024
Data Strategy
38 min
Dr. Dominik Neumann
,
and
Abhyudai Verma
,
and
Modern Data 101
,
 and

Crunching Data and Printing Profits with Ryan Brown | S1:E2

How every data effort drives business value by boosting revenue or reducing cost
Oct 30, 2024
Data Strategy
85 min
Ryan Brown
,
and
Abhyudai Verma
,
and
Modern Data 101
,
 and

The Power Combo of AI Agents and the Modular Data Stack: AI that Reasons

What are AI Agents, Types, Workflows, Leverage of Consistent Design Across Data & AI Stacks, Solutions for LLM Limitations, and much more!
Oct 24, 2024
Data Strategy
13 min
Animesh Kumar
,
and
Brij Mohan Singh
,
and
Ritwika Chowdhury
,
 and

The Data Product Marketplace: A Single Interface for Business

WHATs and WHYs of Marketplaces, Contrasts with Catalogs, and Marketplace Implementation Options
Oct 17, 2024
Data Strategy
7 min
Arielle Rolland
,
and
,
and
,
 and

Don’t Trust Decentralisation Yet? Game Theory Might Change Your Stance

Failures in Centralisation as a Pattern, Misinterpreted Decentralisation Techniques, and Data Products as the Prime "Players" of Smart Decentralisation.
Oct 11, 2024
Data Strategy
10 min
Animesh Kumar
,
and
Travis Thompson
,
and
,
 and

The Skill-Set to Master Your Data PM Role | A Practicing Data PM's Guide

Key Competencies, Collaborations, Responsibilities, Career Progression, and More!
Oct 3, 2024
Data Strategy
9 min
Gaëlle SERET
,
and
,
and
,
 and

Solve Governance Debt with Data Products

What exactly makes data governed, what to govern, where to integrate AI, and more!
Sep 27, 2024
Data Strategy
8 min
Animesh Kumar
,
and
Shubhanshu Jain
,
and
,
 and

The Analytics Engineering Flywheel, Shifting Left, & More With Madison Schott | S1:E1

Everything from Data Modeling and Governance to Industry Trends and Best Practices
Sep 19, 2024
Data Strategy
5 min
Madison Schott
,
and
Abhyudai Verma
,
and
,
 and

Upscaling Marketing Analytics: A CDO’s Guide to Building Data-Driven Domains

How a Data Product Stack Influences the Marketing Landscape and Redefines Prospect Journeys and much more!
Sep 13, 2024
Data Strategy
16 min
Animesh Kumar
,
and
Bhava Kompala
,
and
,
 and

What an Actual Lean AI Strategy Looks Like?

Avoiding Compounding Costs, Multiplying Impact of AI Initiatives, Mitigating Fatal or Hidden Risks, and Always Putting Data First 🥇
Aug 22, 2024
Data Strategy
8 min
Michele Nieberding
,
and
,
and
,
 and

Our Journey to 3K! ✈️

All things Modern Data, Community Initiatives, and New Resources!
Aug 15, 2024
Data Strategy
4 min
Modern Data 101
,
and
,
and
,
 and

AI Augmentation to Scale Data Products to a Data Product Ecosystem

Where AI Augments the Data Product Lifecycle, The Significance of User Experience, and The Ability to Focus on Advanced Verticals with Less Resources at Hand
Aug 9, 2024
Data Strategy
10 min
Brij Mohan Singh
,
and
Ritwika Chowdhury
,
and
Rakesh Vishvakarma
,
 and

Could Data Products Save (Real) Money?

Value Evaluation Model, Calculation Functions, Product Remediation, and more!
Jul 25, 2024
Data Strategy
7 min
Francesco De Cassai
,
and
,
and
,
 and

Semantics and Data Product Enablement - A Practitioner's Secret

Bare-bone Purpose & Key Components of the Semantic Layer, The Data Product Divergence and Impact, and Driving Business Value at Scale.
Jul 18, 2024
Data Strategy
11 min
Frances O'Rafferty
,
and
,
and
,
 and

Tearing Down the Monolith | The Rise of Microservices & Modular Architecture in Data Engineering

Common Anti-Patterns, the Most Immediate Alternatives, and Existing Stack Boosters.
Jul 11, 2024
Data Strategy
9 min
Hugo Lu
,
and
Vivek Dubey
,
and
,
 and

Federated Modeling: When and Why to Adopt

The Most Straightforward Business Case You'll Find for Data Modeling
Jan 2, 2025
Data Lifecycle
7 min
Francesco De Cassai
,
and
,
and
,
 and

5000 Minds Strong Today. Our Journey to 5K and Beyond!

Community Favourites, Featured Voices and Works, A View Into MD101's Growth Trajectory with You, and More!
Nov 28, 2024
Data Lifecycle
4 min
Modern Data 101
,
and
,
and
,
 and

Operationalizing Data Product Delivery in the Data Ecosystem

Defining the Foundations to Underpin Data Products and the Operational Processes to Build Them
Sep 5, 2024
Data Lifecycle
16 min
Dylan Anderson
,
and
,
and
,
 and

Where Exactly Data Becomes Product: Illustrated Guide to Data Products in Action

Concrete Step-by-Step Journey, Debunking Confusion and Dilution, and Importance of Social / Cultural Structures
Aug 1, 2024
Data Lifecycle
12 min
Animesh Kumar
,
and
Travis Thompson
,
and
,
 and

How to Build Data Products - Design: Part 1/4

Metric-Targeting, Semantic Engineering, Model Validation, and More.
Sep 7, 2023
Data Lifecycle
12 min
Animesh Kumar
,
and
Shubhanshu Jain
,
and
Samadrita Ghosh
,
 and
No items found.
ModulesResourcesNetworkBlogPlaybook
Managed by Team @ Modern