All content for Agile Data N’ Info is the property of AgileData and is served directly from their servers
with no modification, redirects, or rehosting. The podcast is not affiliated with or endorsed by Podjoint in any way.
Join the AgileData podcast where we discuss how data and analytics teams can apply agile, product and data patterns to change the way they work.
Data Match, AgileData Engineering Pattern #7 - Episode #75
Agile Data N’ Info
10 minutes
2 months ago
Data Match, AgileData Engineering Pattern #7 - Episode #75
Join Shane Gibson and Nigel Vining as they describe and discuss the AgileData Engineering Pattern for the Data Match.
The Data Match pattern provides an automated, granular comparison capability to efficiently identify and report discrepancies between two datasets, moving from row counts to specific data values.
This 'data diff' solution transforms hours of manual data reconciliation into minutes by optimising comparisons for cloud analytics databases like BigQuery, serving as a support feature for on-demand exception handling rather than a continuous trust rule.
An AgileData Engineering Pattern is a repeatable, proven approach for solving a common data engineering challenge in a simple, consistent, and scalable way, designed to reduce rework, speed up delivery, and embed quality by default.
If you want a copy of the pattern template head over to:
https://agiledata.substack.com/i/172820886/pattern-name
Discover more AgileData Engineering Patterns over at https://agiledata.substack.com/s/agiledata-engineering-patterns
If you just want to talk about making magic happen with agile and data you can connect with Shane @shagility on LinkedIn.
Subscribe: Apple Podcast | Spotify | Google Podcast | Amazon Audible | TuneIn | iHeartRadio | PlayerFM | Listen Notes | Podchaser | Deezer | Podcast Addict |
Buy the Green Book now!
Simply Magical Data Ways of Working
Agile Data N’ Info
Join the AgileData podcast where we discuss how data and analytics teams can apply agile, product and data patterns to change the way they work.