- Cliff Crosland, CEO of Scanner.dev, emphasizes the importance of effective log analysis in today's complex systems, viewing logs as a treasure trove of insights.
- Crosland's expertise in distributed systems, graph creation, and entity resolution provides valuable insights into the implications of Generative AI and LLMs for current and future coders.
- The challenges of using batch systems in security and the shift towards real-time actions are highlighted by Crosland, along with his perspectives on containerization, Kubernetes consolidation, and the microservices paradigm.
- A detailed exploration of Scanner.dev, including its functionality, file formats, and the unique challenges logging brings to system creation, is discussed.
- Scanner.dev's utilization of lambda functions to create a performant yet cost-efficient map/reduce-style distributed system is explained.
Unapologetically Technical’s newest episode is now live!
In this episode of Unapologetically Technical, I interview Cliff Crosland, the co-founder and CEO of Scanner.dev.
Cliff Crosland is a data engineer passionate about helping people wrangle massive log volumes. He sees logs as a treasure trove of insights and believes effective log analysis is critical in today’s complex systems.
We discussed his early experiences with distributed systems, including his work on creating graphs and entity resolution. We also discussed the implications of Generative AI and LLMs for current and future coders.
Cliff highlighted the challenges of using batch systems in security and the need for real-time actions. He shared his views on containerization and Kubernetes consolidation and how this led to the microservices paradigm.
Lastly, we go in-depth into Scanner.dev, covering what it is and how it works. We discuss file formats and the ways that logging brings unique challenges to system creation. We consider how Scanner.dev uses lambda functions to create a map/reduce-style distributed system that is performant yet cost-efficient.
Don’t forget to subscribe to my YouTube channel to get the latest on Unapologetically Technical!
