Explore every episode of the podcast Tech on the Rocks

Dive into the complete episode list for Tech on the Rocks. Each episode is cataloged with detailed descriptions, making it easy to find and explore specific topics. Keep track of all episodes from your favorite podcast and never miss a moment of insightful content.

	Title	Pub. Date	Duration
	Unifying structured and unstructured data for AI: Rethinking ML infrastructure with Nikhil Simha and Varant Zanoyan	30 Aug 2024	01:01:45
Summary In this episode, we dive deep into the future of data infrastructure for AI and ML with Nikhil Simha and Varant Zanoyan, two seasoned engineers from Airbnb and Facebook. Nikhil and Varant share their journey from building real-time data systems and ML infrastructure at tech giants to launching their own venture. The conversation explores the intricacies of designing developer-friendly APIs, the complexities of handling both batch and streaming data, and the delicate balance between customer needs and product vision in a startup environment. Contacts & Links Nikhil Simha Varant Zanoyan Chronon project Chapters 00:00 Introduction and Past Experiences 04:38 The Challenges of Building Data Infrastructure for Machine Learning 08:01 Merging Real-Time Data Processing with Machine Learning 14:08 Backfilling New Features in Data Infrastructure 20:57 Defining Failure in Data Infrastructure 26:45 The Choice Between SQL and Data Frame APIs 34:31 The Vision for Future Improvements 38:17 Introduction to Chrono and Open Source 43:29 The Future of Chrono: New Computation Paradigms 48:38 Balancing Customer Needs and Vision 57:21 Engaging with Customers and the Open Source Community 01:01:26 Potential Use Cases and Future Directions Click here to view the episode transcript.
	Stream processing, LSMs and leaky abstractions with Chris Riccomini	23 Aug 2024	00:53:06
Overview In this episode, we chat with Chris Riccomini about the evolution of stream processing and the challenges in building applications on streaming systems. We also chat about leaky abstractions, good and bad API designs, what Chris loves and hates about Rust and finally about his exciting new project that involves object storage and LSMs. Connect with Chris at: LinkedIn X Blog Materialized View Newsletter - His newsletter The missing README - His book SlateDB - His latest OSS Project Chapters 00:00 Introduction and Background 04:05 The State of Stream Processing Today 08:53 The Limitations of SQL in Streaming Systems 14:00 Prioritizing the Developer Experience in Stream Processing 18:15 Improving the Usability of Streaming Systems 27:54 The Potential of State Machine Programming in Complex Systems 32:41 The Power of Rust: Compiling and Language Bindings 34:06 The Shift from Sidecar to Embedded Libraries Driven by Rust 35:49 Building an LSM on Object Storage: Cost-Effective State Management 39:47 The Unbundling and Composable Nature of Databases 47:30 The Future of Data Systems: More Companies and Focus on Metadata Click here to view the episode transcript.

About Methodology Contact Support me Privacy Policy Legal Notice