Knowledge Modeling Methods for the Publish-Trendy Knowledge Stack | by Mahdi Karabiben | Jul, 2024

A set of generic strategies and rules to design a sturdy, cost-efficient, and scalable knowledge mannequin on your post-modern knowledge stack.

Over the previous few years, because the Trendy Knowledge Stack (MDS) launched new patterns and requirements for transferring, reworking, and interacting with knowledge, dimensional knowledge modeling steadily turned a relic of the previous. As a replacement, knowledge groups relied on One-Massive-Tables (OBT) and stacking layer upon layer of dbt fashions to deal with new use instances. Nonetheless, these approaches led to unlucky conditions by which knowledge groups turned a value middle with unscalable processes. So, as we enter a “post-modern” knowledge stack period, outlined by the pursuit to cut back prices, tidy up knowledge platforms, and restrict mannequin sprawl, knowledge modeling is witnessing a resurrection.

This transition places knowledge groups in entrance of a dilemma: ought to we revert again to strict knowledge modeling approaches that have been outlined many years in the past for a very totally different knowledge ecosystem, or can we introduce new rules which can be outlined based mostly on right now’s expertise and enterprise issues?

I imagine that, for many corporations, the suitable reply lies someplace within the center. On this article, I’ll focus on a set of knowledge modeling requirements to maneuver away from…