by Jesse Anderson | Jul 20, 2016 | Blog, Business, Data Engineering |
Kafka 0.10 is out. Here are the changes that developers need to know about. Here is the new URL to the Kafka 0.10 JavaDoc. KafkaConsumer The KafkaConsumer had a minor change to that allows you to specify a maximum number of messages to return. You can set this by... by Jesse Anderson | Jul 13, 2016 | Blog, Business, Data Engineering, Data Engineering is hard |
Apache Beam just had its first release. Now that we’re working towards the second release, 0.2.0-incubating, I’m catching up with the committers and users to ask some of the common questions about Beam. Each committer and user is sharing their own opinion... by Jesse Anderson | Jul 6, 2016 | Blog, Business, Data Engineering, Data Engineering is hard |
I had a conversation with another person in the Big Data field. We were discussing whether the Data Engineers would become a more common job title and migrate out of Silicon Valley. I told him yes. Big Data is downright complicated on many levels. There are too many... by Jesse Anderson | Jun 29, 2016 | Blog, Business, Data Engineering, Data Engineering is hard |
A common question beginners ask about Hadoop are the technical skills needed to get started. This helps level set what skills you need before you embark on a big data journey. For developers and administrators, I divide up the skills as those that required and those... by Jesse Anderson | Jun 22, 2016 | Blog, Business, Data Engineering, Data Engineering is hard |
Everyone’s Big Data journey starts somewhere. We’re often given stories of outright mastery, but I want to tell you how I got started with Big Data. Each of these stories about mastery forget or omit their humble beginnings. This is my story from my humble... by Jesse Anderson | Jun 1, 2016 | Blog, Business, Data Engineering |
For the past few months, I’ve been teaching at companies who are heavy users of Apache Storm. They’re also undertaking massive projects to move off of Storm. During that time, I’d say that something new was coming that might convince them to consider...
