While Tom has been battling an annual occurrence of “Flymageddon” on his farm, the team have been busily lining up exciting guests for Season 2. We plan to pick up on many of the themes from Season 1 and start pulling those threads!
This episode is no different, and we are pleased to be joined by Winston Chang from Snowflake who is their CTO for Global Public Sector and so has a special interest in dealing with large data problems across government and defence. Winston is himself a West Point graduate, so brings a perspective from both civil and military angles.
We start by asking Winston how we got here, providing a potted history of the movement from Data Warehouses to deal with ‘Big Data’, Data Lakes and Platforms. Of particular note is the move from fixed infrastructure to cloud deployment of data, which fosters improved collaboration and data sharing.
Of course no episode is complete without mention of AI, and Winston goes on to explain how these developments have helped to enable deployment of machine learning and LLMs, which require large amounts of storage and compute resource. Without which the current crop of generative AI applications would not be possible.
While covering many topics in a short session, Winston makes an interesting point about how we should view data like a water ecosystem. We need to learn how to cultivate and curate this resource, and it doesn’t need to always be in a perfect state to gain benefits from it. Like a natural ecosystem, it supports a wide range of sources, users and consumers.
Last but not least, we speak of the challenge to build a common understanding of how we should manage data, as well as build a workforce with the necessary skills and experience to properly exploit it.
Hosts:
Guests:
Links:
Episode Sponsor: