What's New In Data – Détails, épisodes et analyse

Redpanda CEO Alex Gallego joins us to talk about Sovereign AI that never leaves your private environment, highly optimized stream processing, and why the future of data is real time. Discover how Alex's journey from building racing motorcycles and tattoo machines as a child led him to revolutionize stream processing and cloud infrastructure. Alex also gets deep into the internals of Redpanda's C++ implementation that ultimately gives it better performance and lower cost than Apache Kafka, while using the same Kafka-compatible API. 

We explore the challenges and groundbreaking innovations in data storage and streaming. From Kafka's distributed logs to the pioneering Redpanda, Alex shares the operational advantages of streaming over traditional batch processing. Learn about the core concepts of stream processing through real-world examples, such as fraud detection and real-time reward systems, and see how Redpanda is simplifying these complex distributed systems to make real-time data processing more accessible and efficient for engineers everywhere.

Finally, we delve into emerging trends that are reshaping the landscape of data infrastructure. Examine how lightweight, embedded databases are revolutionizing edge computing environments and the growing emphasis on data sovereignty and "Bring Your Own Cloud" solutions. Get a glimpse into the future of data ownership and AI, where local inferencing and traceability of AI models are becoming paramount. Join us for this compelling conversation that not only highlights the evolution from Kafka to Redpanda but paints a visionary picture of the future of real-time systems and data architecture.

What's New In Data is a data thought leadership series hosted by John Kutay who leads data and products at Striim. What's New In Data hosts industry practitioners to discuss latest trends, common patterns for real world data patterns, and analytics success stories.

Imagine losing your most important digital keys and leaving your entire kingdom vulnerable to attacks. In this episode, we promise to equip you with the knowledge to prevent such disasters. Join us as we sit down with Brian Vallelunga, the CEO and founder of Doppler, to unravel the critical importance of secrets management in software development. Brian shares his deep expertise on what secrets are—those crucial digital keys that unlock access to sensitive data—and illustrates through a personal story the severe consequences of failing to protect them. Discover how data breaches can wreak havoc, leading to brand reputation damage, customer churn, legal battles, and even personal distress.

But it’s not all doom and gloom. Brian introduces us to Doppler, a game-changing tool that simplifies the tedious process of secrets management, making it an integral part of the modern development workflow. Learn how Doppler empowers developers to secure sensitive data efficiently, eliminating common headaches like managing environment files and manual secret updates. We also delve into practical implementation timelines, showing that effective secrets management is achievable for companies of all sizes with the right tools. Brian provides actionable advice for engineering teams on securing secrets within applications and highlights valuable resources for further learning. Tune in to safeguard your company’s digital assets and fortify your secrets management strategy.

Follow Brian on:

• doppler.com
• X (Twitter) - @vallelungabrian

What's New In Data is a data thought leadership series hosted by John Kutay who leads data and products at Striim. What's New In Data hosts industry practitioners to discuss latest trends, common patterns for real world data patterns, and analytics success stories.

Embark on a journey with Kunal Agarwal, CEO of Unraveled Data, as he unravels the complexities of managing escalating cloud costs with the sharp tools of FinOps and data AI. If you've ever grappled with the challenge of scaling data operations without breaking the bank, this episode is your playbook for turning those daunting costs into a mastered art. Kunal, with his deep expertise in B2B enterprise technology, shares his insights on the inception of Unraveled Data and the crucial role of AI in streamlining cloud data management. It's not just about the tech; it's about the smarts in employing it, and Kunal's tales from the trenches of data observability will guide you through the labyrinth of efficiency and optimization.

Dive into the tech mosaic of today's data platforms, where consistency is king despite the varied landscapes of Databricks, Snowflake, and others. We tackle the nitty-gritty of providing a seamless user experience and the prowess of Unravel's AI-powered insights engine in standardizing performance across systems. The chess game of maximizing ROI from AI investments also takes center stage as we dissect the importance of a cost-conscious culture supported by FinOps. Listen as we dissect the fine balance between innovation and investment, and learn how to wield the double-edged sword of customization versus cost. Kunal's strategic vision paves the way for a future where automation and economic savvy coalesce, propelling data-driven enterprises to new heights.

What's New In Data is a data thought leadership series hosted by John Kutay who leads data and products at Striim. What's New In Data hosts industry practitioners to discuss latest trends, common patterns for real world data patterns, and analytics success stories.

Unlock the secrets to transforming your data engineering strategies with Hubert Dulay, the mastermind behind "Streaming Data Mesh," in a riveting exploration of how the field is evolving beyond monolithic systems. As we converse with this data integration expert, you'll gain unparalleled insights into the decentralization wave sweeping across data management. Hubert unveils the power of domain-centric stewardship, where domain engineers are empowered with SQL to revolutionize analytics. Meanwhile, he advocates for a paradigm shift—one that involves harnessing data right from its origin, ensuring a seamless journey to analytics that aligns perfectly with Data Mesh's core tenets.

Venture into the future with John and Hubert as they dissect the burgeoning appeal of Postgres and its ascension in the database echelon. Discover how the fusion of operational and analytical databases is redefining the industry, with a spotlight on how companies like American Airlines leverage real-time data for critical decisions in aircraft maintenance. As Hubert and John navigate the intricacies of implementing a data mesh without the pitfalls of data duplication or spiraling costs, you'll be equipped with knowledge on crafting effective data management strategies. This is an episode for those who recognize that mastering operational analytics is not just a competitive edge but an essential cornerstone for every forward-thinking enterprise.

What's New In Data is a data thought leadership series hosted by John Kutay who leads data and products at Striim. What's New In Data hosts industry practitioners to discuss latest trends, common patterns for real world data patterns, and analytics success stories.

Embark on a transformative journey with Sawyer Nyquist of the Data Shop, as he reveals how his liberal arts and theology background fuels innovative approaches to data solutions. Our dialogue with Sawyer spans from the intriguing intricacies of Microsoft Fabric to the development of his educational Udemy class, equipping you with the expertise to navigate the often-mystical realm of data. Get ready to unravel the tapestry of service models with his delightful dining analogy and witness his dedication to empowering data aficionados through practical knowledge and application. 

This session also casts a spotlight on the human elements in the age of AI, dissecting the evolving challenges of ensuring security and the nuanced skills data practitioners must refine to thrive alongside technologies like LLMs and GPT. We don't just stop at the technicalities; we traverse the heartwarming narratives within the nonprofit sector, uncovering how data plays a pivotal role in magnifying their societal impact. It's a rich exploration of how nonprofits utilize data to navigate their unique challenges and the gratifying experience of leveraging data to drive meaningful change. Tune in for an episode that promises to elevate your understanding of the data universe and its extraordinary potential in both business and the broader community.

What's New In Data is a data thought leadership series hosted by John Kutay who leads data and products at Striim. What's New In Data hosts industry practitioners to discuss latest trends, common patterns for real world data patterns, and analytics success stories.

Discover the transformative power of Machine Learning Operations (MLOps) as we sit down with Andy McMahon, the head of MLOps at NatWest Group and author of "Machine Learning Engineering with Python." Andy's transition from the world of theoretical physics to the cutting edge of MLOps has positioned him as a leading voice in the field. This episode promises to shed light on the sometimes-blurry lines between MLOps, data engineering, and data science, illustrating the crucial role of operationalizing machine learning models to make a tangible impact on business infrastructure.

Our conversation with Andy McMahon dives into the concept of 'value left on the table' and how MLOps ensures machine learning models are not just innovative concepts but are also deployed to drive real-world solutions. He emphasizes the importance of initiating MLOps practices early, to manage models and data effectively, steering organizations toward successful operational transformation. Moreover, Andy shares his expertise on evaluating the fit of machine learning for various business challenges, guiding our audience through the landscape of informed decision-making in the world of data and AI.

Looking ahead, Andy offers a peek into the future of MLOps and the integration of advanced technologies like large language models into everyday operations. He stresses the fundamental skills necessary to thrive in the evolving AI landscape, such as software engineering and system design. Additionally, we discuss the collaboration between NatWest Group and AWS, highlighting the pioneering machine learning initiatives detailed in a four-part blog series. This episode is a wellspring of insights for anyone with an interest in leveraging machine learning, from the banking industry to broader business applications, making it indispensable listening for forward-thinking professionals and enthusiasts alike.

What's New In Data is a data thought leadership series hosted by John Kutay who leads data and products at Striim. What's New In Data hosts industry practitioners to discuss latest trends, common patterns for real world data patterns, and analytics success stories.

Embark on a captivating voyage into the intricacies of AI with Abi Aryan, the financial wizard turned tech trailblazer, who unveils the transformative power of machine learning in our latest episode. Witness the metamorphosis of data pipelines and video classification as Abi elucidates her groundbreaking research at UCLA and her influential work within the entertainment industry. Her commitment to social impact and democratizing AI is palpable as she offers a glimpse into her mission of miniaturizing large language models to fit into the palm of your hand, ensuring the future of tech is not only responsive but delightfully anticipatory.

As we unravel the complexities of operationalizing Large Language Models, Abi's insights illuminate the shifting landscape of product experiences, where AI is not just a component but the orchestrator. She expertly navigates the technical finesse required to tailor AI for IoT devices, merging the realms of luxury and practicality for the ultimate smart living experience. Tune in to discover how Abi's pioneering work is crafting a future where technology doesn't just blend into our lives; it enhances them with an intuitive touch, anticipating our every need with intelligence and grace.

What's New In Data is a data thought leadership series hosted by John Kutay who leads data and products at Striim. What's New In Data hosts industry practitioners to discuss latest trends, common patterns for real world data patterns, and analytics success stories.

Mehmet Ozan Kabak, Ph.D. joins us to introduce the idea of AI-native application development. Ozan applies his real world experience working on machine learning at Instagram Signals and various other roles in AI & ML.  Embark on a transformative journey into the heart of AI infrastructure with Ozan Kabak, a beacon of knowledge in the realms of AI and machine learning. Our enlightening dialogue traverses the landscape of 'AI native' applications, where Ozan's insights bridge the gap between academic theory and industry practice. Through anecdotes from his Stanford days to tales of data infrastructure dilemmas, Ozan demystifies the often-overlooked development hurdles such as model monitoring and the balance between training and inference. This episode promises to illuminate the intricate dance behind the scenes of deploying AI solutions, sparing not a detail on the developer's labor and the pivotal moments that shape the backbone of AI applications.

Gain an edge as we unpack the strategic foresight necessary for wielding AI in business; a cautious approach underscored by the significance of a robust data framework and the lurking risks of customer-facing AI systems. Ozan's expertise shines as we introduce Apache Arrow, the open-source project championing data format interoperability, heralding a new era of standardization and best practices. Be prepared to peer into the crystal ball of AI's future with us, where efficiency reigns supreme, and the compute landscape is primed for an overhaul. We grapple with the immense potential and existential considerations of large language models, examining how today's marvels could become tomorrow's masters. Tune in for a session packed with insights that will redefine your perspective on AI's current and future roles.

What's New In Data is a data thought leadership series hosted by John Kutay who leads data and products at Striim. What's New In Data hosts industry practitioners to discuss latest trends, common patterns for real world data patterns, and analytics success stories.

Embark on an intellectual odyssey with Chris White, CTO at Prefect, as he recounts his metamorphosis from a mathematician steeped in the abstract world of optimization theory to a data science maestro and software development virtuoso. Discover how Chris's mathematical prowess translates into creative and practical solutions for data workflows, and how this synergy is revolutionizing the tech landscape. Our conversation peels back the layers of data science, revealing the indispensable role of automated workflows in bolstering productivity and bringing clarity to the complexities that data teams navigate daily.

Feel the pulse of innovation as we delve into the essence of Prefect, the workflow management system that addresses the shortcomings of existing tools and aligns with the intuitions of Python developers. Chris lays bare the intricacies of integrating event-driven constructs that enhance processing efficiency, and how Prefect tailors to the needs of both budding engineers and seasoned code wizards. Looking ahead, we glimpse the potential of managed compute offerings and AI integrations that promise to transform mundane workflows into robust workflow applications, setting a new standard for configuration management and collaborative coding.

What's New In Data is a data thought leadership series hosted by John Kutay who leads data and products at Striim. What's New In Data hosts industry practitioners to discuss latest trends, common patterns for real world data patterns, and analytics success stories.

Unlock the secrets of engaging developer communities and the transformative world of real-time data analytics with our guest, Viktor Gamov of StarTree. From crafting code to leading developer relations, Viktor unravels his career evolution, highlighting how fostering connections and sharing knowledge with developers has reshaped the landscape of tech communication. His take on the democratization of technical know-how reveals the profound impact of making what was once consultancy-exclusive, accessible to all. Tune in for a masterclass on the importance of community in the tech industry and how it can break barriers for innovation.

Are you ready to see data come to life? Viktor’s thrilling exposition on Kafka, KSQL, and Apache Pino turns the arcane into the amazing, using a real-time Pac-Man game dashboard to illustrate the revolutionary shift from batch to stream processing. Witness the rebirth of open-source technologies and grasp the concept of 'data in motion' as we discuss the critical importance of streaming platforms in modern data architecture. Viktor's expertise in developer relations shines as he demonstrates the value of making complex tech relatable and relevant to business needs.

The data landscape is ever-evolving, and with the rise of AI, the stakes have never been higher. In an era where milliseconds matter, Viktor peels back the layers of how Apache Pino is driving real-world solutions for industries galore. From restaurant load management to transaction tracking, discover how real-time analytics are informing strategic business decisions. As we journey with our guest back to his roots in data and game development, we're reminded of the cyclical nature of passion and profession—where one's beginnings often foretell the trajectory of their career. Don't miss out on this episode, where we connect the dots between nostalgia and the next wave of data innovation.

What's New In Data is a data thought leadership series hosted by John Kutay who leads data and products at Striim. What's New In Data hosts industry practitioners to discuss latest trends, common patterns for real world data patterns, and analytics success stories.