- Karthik Ramasamy, head of Streaming at Databricks, discusses Spark Structured Streaming in-depth in the latest episode of Unapologetically Technical.
- The episode covers Karthik's experience at the University of Wisconsin-Madison and the impact it had on creating distributed systems thinkers.
- Karthik also shares insights from his time at Twitter, Streamlio, and Splunk.
- Unapologetically Technical delves deep into Spark Structured Streaming, explaining its workings and the steps involved in micro-batch processing.
- Project Lightspeed, Databricks' initiative to enhance Spark Structured Streaming, is discussed, including details on its rollout.
Unapologetically Technical is back with a new episode!
You surely wouldn’t want to miss this episode because we’re going deeply into Spark Structured Streaming with this week’s guest, Karthik Ramasamy, the head of Streaming at Databricks.
In this episode, we talk about his time at the University of Wisconsin-Madison and why it created so many great distributed systems thinkers. We’ll also cover his time at Twitter, Streamlio, and Splunk.
And of course here in Unapologetically Technical, we go deep into Spark Structured Streaming. We’ll explain how it works and what the steps are during micro-batch processing.
And in case you haven’t heard, Project Lightspeed is Databricks’ initiative to improve Spark Structured Streaming, and so we’ll also cover how that is being rolled out.
Don’t forget to subscribe to my Youtube channel to get the latest on Unapologetically Technical!
Frequently Asked Questions (AI FAQ by Summarizes)Who is Karthik Ramasamy and what does he discuss in the latest episode of Unapologetically Technical?
Karthik Ramasamy is the head of Streaming at Databricks. In the latest episode of Unapologetically Technical, he discusses Spark Structured Streaming in-depth.
What experiences does Karthik Ramasamy share in the episode?
Karthik shares insights from his time at the University of Wisconsin-Madison, Twitter, Streamlio, and Splunk, highlighting the impact of these experiences on creating distributed systems thinkers.
What does Unapologetically Technical delve deep into?
Unapologetically Technical delves deep into Spark Structured Streaming, explaining its workings and the steps involved in micro-batch processing.
What is Project Lightspeed and what details are discussed about it?
Project Lightspeed is Databricks' initiative to enhance Spark Structured Streaming. The episode discusses details on its rollout and implementation.
How can one stay updated on the latest from Unapologetically Technical?
Subscribing to the YouTube channel is recommended to stay updated on the latest episodes and content from Unapologetically Technical.
