Agile Data N’ Info
Talking about Patterns that span the Data, Product and AI Domains.
88 episodes
latest
monthly cadence
English language
https://podcast.agiledata.io/feed.xml
Episodes
Reading the feed…
Talking about Patterns that span the Data, Product and AI Domains.
Reading the feed…
Raw and unedited https://agiledata.info/p/watch-now-recording-of-aura-anna-ad5?utm_source=youtube <-OO-> Information Product Canvas Workshop “That’s not what I wanted.”“But that’s what you asked for.” Shane runs a one-day workshop on the Information Product Canvas, a repeatable way to gather data requirements in 30 minutes. The approach he actually uses with his stakeholders, not a textbook version that falls apart on contact with messy data and vague stakeholder requirements. Latest dates: Gather data requirements in 30 minutes using a shared language. Simply Magical Data Ways of Working
Raw and unedited https://agiledata.info/p/watch-now-recording-of-aura-chris-0ce?utm_source=youtube <-OO-> Listen to more podcasts on applying Agile Data patterns over at https://podcast.agiledata.io/ Read more on the Agile Data Way of Working over at https://AgileDataGuides.com/ If you just want to talk about making magic happen with agile and data you can connect with Shane @shagility on LinkedIn. Subscribe: Apple Podcast | Spotify | Google Podcast | Amazon Audible | TuneIn | iHeartRadio | PlayerFM | Listen Notes | Podchaser | Deezer | Podcast Addict | <-OO-> Information Product Canvas Worksh
Raw and unedited https://agiledata.info/p/watch-now-recording-of-aura-tim-frazer-0d1?utm_source=youtube <-OO-> Listen to more podcasts on applying Agile Data patterns over at https://podcast.agiledata.io/ Read more on the Agile Data Way of Working over at https://AgileDataGuides.com/ If you just want to talk about making magic happen with agile and data you can connect with Shane @shagility on LinkedIn. Subscribe: Apple Podcast | Spotify | Google Podcast | Amazon Audible | TuneIn | iHeartRadio | PlayerFM | Listen Notes | Podchaser | Deezer | Podcast Addict | <-OO-> Information Product Canvas W
Raw and unedited https://agiledata.info/p/watch-now-recording-of-aura-juha?utm_source=youtube <-OO-> Listen to more podcasts on applying Agile Data patterns over at https://podcast.agiledata.io/ Read more on the Agile Data Way of Working over at https://AgileDataGuides.com/ If you just want to talk about making magic happen with agile and data you can connect with Shane @shagility on LinkedIn. Subscribe: Apple Podcast | Spotify | Google Podcast | Amazon Audible | TuneIn | iHeartRadio | PlayerFM | Listen Notes | Podchaser | Deezer | Podcast Addict | <-OO-> Information Product Canvas Workshop “T
Raw and unedited :: https://agiledata.info/p/watch-now-recording-of-aura-anna <-OO-> Listen to more podcasts on applying Agile Data patterns over at https://podcast.agiledata.io/ Read more on the Agile Data Way of Working over at https://AgileDataGuides.com/ If you just want to talk about making magic happen with agile and data you can connect with Shane @shagility on LinkedIn. Subscribe: Apple Podcast | Spotify | Google Podcast | Amazon Audible | TuneIn | iHeartRadio | PlayerFM | Listen Notes | Podchaser | Deezer | Podcast Addict | <-OO-> Information Product Canvas Workshop “That’s not what I
Raw and unedited :: https://agiledata.info/p/watch-now-recording-of-aura-chris <-OO-> Listen to more podcasts on applying Agile Data patterns over at https://podcast.agiledata.io/ Read more on the Agile Data Way of Working over at https://AgileDataGuides.com/ If you just want to talk about making magic happen with agile and data you can connect with Shane @shagility on LinkedIn. Subscribe: Apple Podcast | Spotify | Google Podcast | Amazon Audible | TuneIn | iHeartRadio | PlayerFM | Listen Notes | Podchaser | Deezer | Podcast Addict | <-OO-> Information Product Canvas Workshop “That’s not what
Raw and unedited :: https://agiledata.info/p/watch-now-recording-of-aura-tim-frazer <-OO-> Listen to more podcasts on applying Agile Data patterns over at https://podcast.agiledata.io/ Read more on the Agile Data Way of Working over at https://AgileDataGuides.com/ If you just want to talk about making magic happen with agile and data you can connect with Shane @shagility on LinkedIn. Subscribe: Apple Podcast | Spotify | Google Podcast | Amazon Audible | TuneIn | iHeartRadio | PlayerFM | Listen Notes | Podchaser | Deezer | Podcast Addict | <-OO-> Information Product Canvas Workshop “That’s not
In this episode of the Agile Data Podcast, where host Shane Gibson sits down with Patrik Lager, a data integration expert with 25 years of experience and a lead developer of the Focal framework. In this episode, the conversation explores the intricate world of Focal data modeling and identity resolution. Patrik explains how the Focal framework operates as a highly abstract, metadata-driven engine that creates an extremely agile, non-destructive architecture. By focusing on understanding the business and using documentation to generate code, Focal ensures that your architecture and documentatio
Join Shane Gibson as he chats with Marco Wobben about the patterns within Fact-based modeling. You can get in touch with Marco via LinkedIn or over at Casetalk.com If you want want to read a summary generated with GenAI, head over to: https://agiledata.substack.com/i/187938526/google-notebooklm-briefing If you want to download the transcript for the podcast, head over to: https://agiledata.substack.com/i/187938526/transcript Listen to more podcasts on applying Agile Data patterns over at https://podcast.agiledata.io/ Read more on the Agile Data Way of Working over at https://AgileDataGuides.co
Join Shane Gibson as he chats with Mayowa Oludoyi about redesigning traditional data systems to better support LLM and AI Agents You can get in touch with Mayowa via LinkedIn If you want want to read a summary generated with GenAI, head over to: https://agiledata.substack.com/i/184771911/google-notebooklm-briefing If you want to download the transcript for the podcast, head over to: https://agiledata.substack.com/i/184771911/transcript Listen to more podcasts on applying Agile Data patterns over at https://podcast.agiledata.io/ Read more on the Agile Data Way of Working over at https://AgileDa
Join Shane Gibson as he chats with Jason Taylor a former quant researcher who turned towards the light (or dark) side of data, to explore the practicalities and pitfalls of building data services using AIYou can get in touch with Jason via LinkedIn If you want want to read a summary generated with GenAI, head over to: https://agiledata.substack.com/i/183787179/google-notebooklm-briefing If you want to download the transcript for the podcast, head over to: https://agiledata.substack.com/i/183787179/transcript Listen to more podcasts on applying Agile Data patterns over at https://podcast.agiled
Join Shane Gibson as he chats with Andy Cutler about the art of data modeling and the potential of AI tools to improve the art.You can get in touch with Andy via LinkedIn or over at https://linktr.ee/andycutlerIf you want want to read a summary generated with GenAI, head over to: https://agiledata.substack.com/i/182448381/google-notebooklm-briefing If you want to download the transcript for the podcast, head over to: https://agiledata.substack.com/i/182448381/transcript Listen to more podcasts on applying Agile Data patterns over at https://podcast.agiledata.io/ Read more on the Agile Data Way
Join Shane Gibson as he chats with Timo Dechau about the pattern of Metric Trees.You can get in touch with Timo via LinkedIn or over at https://timodechau.comIf you want want to read a summary generated with GenAI, head over to: https://agiledata.substack.com/i/179577155/google-notebooklm-briefing If you want to download the transcript for the podcast, head over to: https://agiledata.substack.com/i/179577155/transcript Listen to more podcasts on applying Agile Data patterns over at https://podcast.agiledata.io/ Read more on the Agile Data Way of Working over at https://AgileDataGuides.com/ If
Join Shane Gibson as he chats with Rob Long about patterns that you can use to document and understand your data estate.You can read the article we discuss in the podcast episode here:https://atlonglastanalytics.substack.com/p/data-producer-consumer-diagramsYou can get in touch with Rob via LinkedIn or over at https://atlonglastanalytics.substack.com/ If you want want to read a summary generated with GenAI, head over to: https://agiledata.substack.com/i/176072946/google-notebooklm-briefing If you want to download the transcript for the podcast, head over to: https://agiledata.substack.com/i/17
Join Shane Gibson and Nigel Vining as they describe and discuss the AgileData Engineering Pattern for the Data Match. The Data Match pattern provides an automated, granular comparison capability to efficiently identify and report discrepancies between two datasets, moving from row counts to specific data values. This 'data diff' solution transforms hours of manual data reconciliation into minutes by optimising comparisons for cloud analytics databases like BigQuery, serving as a support feature for on-demand exception handling rather than a continuous trust rule. An AgileData Engineering Patte
Join Shane Gibson as he chats with Nick Zervoudis about patterns that you can use to quickly and easily define the ROI of your data products, before you build them.You can get in touch with Nick via LinkedIn or over at https://blog.valuefromdata.aiIf you want want to read a summary generated with GenAI, head over to: https://agiledata.substack.com/i/172748370/google-notebooklm-briefing If you want to download the transcript for the podcast, head over to: https://agiledata.substack.com/i/172748370/transcript Listen to more podcasts on applying Agile Data patterns over at https://podcast.agileda
Join Shane Gibson as he chats with Johnny Winter about the core patterns that make up Dimensional (Star Schema) Modeling.You can get in touch with Johnny via LinkedIn or over at https://greyskullanalytics.com/If you want want to read a summary generated with GenAI, head over to: https://agiledata.substack.com/i/171239242/google-notebooklm-briefing If you want to download the transcript for the podcast, head over to: https://agiledata.substack.com/i/171239242/transcript Listen to more podcasts on applying Agile Data patterns over at https://podcast.agiledata.io/ Read more on the Agile Data Way
Join Shane Gibson and Nigel Vining as they describe and discuss the AgileData Engineering Pattern for the AgileData Activity Event Tile. The Activity Event Tile pattern tracks a sequence of events (e.g., subscription signups, subscription payments) for a core business concept by storing minimal event data and using a hydration layer to automatically generate pre-calculated metrics as views. This allows business users and analysts to easily understand business performance and event sequencing without complex SQL, providing immediate, consistent insights into activity movements and financial imp
Join Shane Gibson and Nigel Vining as they describe and discuss the AgileData Engineering Pattern for the AgileData Event Tile. The Event Tile Data Modeling pattern captures business processes and transactions within AgileData's three-layered data architecture, modeling "who does what" at a specific point in time. It achieves this by storing only a small number of core business keys in insert-only event tables. These event records are then automatically hydrated into a "consume tile" by joining with all relevant detail attributes that were current at the exact moment the event occurred, ensuri
Join Shane Gibson and Nigel Vining as they describe and discuss the AgileData Engineering Pattern of Automated Load Patterns based on Source Data Profiles. The Automated Load Patterns based on Source Data Profiles pattern automatically profiles incoming data to determine its optimal loading method. It classifies data as either event data (immutable, append-only) or change data (evolving records) by analysing characteristics like unique key volume and column names over time. This automated classification then dictates the load strategy: an efficient partition replace for event data or a cost-ef
Join Shane Gibson and Nigel Vining as they describe and discuss the AgileData Engineering Pattern of Trust Rules to validate data. The Trust Rules pattern provides automated data validation to ensure all incoming data is fit for purpose and trustworthy. It bakes in essential checks such as unique business keys and business effective dates, which run automatically upon data load or table refresh. Users can also define custom validation rules for specific columns. Results are collected, persisted, and surfaced via applications or alerts, with the system optimising validation for cost and speed t
Join Shane Gibson and Nigel Vining as they describe and discuss the AgileData Engineering Pattern of Unioning two or more tables together automatically. The Automated Table Unioning pattern automatically combines two or more tables by intelligently looking up column names and data types to generate safe SQL under the covers. It supports disparate data sources, such as those from multiple publishers in a data clean room, and creates a view or incrementally loads the unified data into a physical table while tracking load watermarks to prevent duplicates. An AgileData Engineering Pattern is a rep
Join Shane Gibson and Nigel Vining as they describe and discuss the AgileData Engineering Pattern of Orchestrating Dynamic Data Flows.The Dynamic Data Flow Orchestration pattern dynamically generates and self-heals data flow manifests (DAGs) at runtime from a central context database, enabling adaptive, cost-effective, and low-latency data processing primarily for micro-batching workloadsAn AgileData Engineering Pattern is a repeatable, proven approach for solving a common data engineering challenge in a simple, consistent, and scalable way, designed to reduce rework, speed up delivery, and em
Join Shane Gibson as he chats with Roelant Vos about a number of Data Engine Thinking patterns and his new book Data Engine Thinking.You can get in touch with Roelant via LinkedIn or over at https://roelantvos.com/blog/Or you can grab a copy of the Data Engine Thinking book on Amazon or at https://dataenginethinking.com/en/If you want want to read a summary generated with GenAI, head over to: https://agiledata.substack.com/i/166295398/google-notebooklm-briefing If you want to download the transcript for the podcast, head over to: https://agiledata.substack.com/i/166295398/transcript Listen to
Join Shane Gibson as he chats with Chris Gambill about a number of Data Engineering patterns.You can get in touch with Chris via LinkedIn or view his YouTube channel https://www.youtube.com/@GambillDataEngineering If you want want to read a summary generated with GenAI, head over to: https://agiledata.substack.com/i/165842333/google-notebooklm-briefing If you want to download the transcript for the podcast, head over to: https://agiledata.substack.com/i/165842333/transcript Listen to more podcasts on applying Agile Data patterns over at https://podcast.agiledata.io/ Read more on the Agile Data
