by Jesse Anderson | Aug 17, 2016 | Blog, Business, Data Engineering, Data Engineering is hard |
Today’s blog post comes from a question from a subscriber to my mailing list. The question come from André M.: How good a Big Data strategy can be defined by someone that doesn’t know the technology behind it? (By knowing I don’t mean being able to... by Jesse Anderson | Jul 27, 2016 | Blog, Business, Data Engineering, Data Engineering is hard |
Some of the contenders for Big Data messaging systems are Apache Kafka, Google Cloud Pub/Sub, and Amazon Kinesis (not discussed in this post). While similar in many ways, there are enough subtle differences that a Data Engineer needs to know. These can range from nice... by Jesse Anderson | Jul 13, 2016 | Blog, Business, Data Engineering, Data Engineering is hard |
Apache Beam just had its first release. Now that we’re working towards the second release, 0.2.0-incubating, I’m catching up with the committers and users to ask some of the common questions about Beam. Each committer and user is sharing their own opinion... by Jesse Anderson | Jul 6, 2016 | Blog, Business, Data Engineering, Data Engineering is hard |
I had a conversation with another person in the Big Data field. We were discussing whether the Data Engineers would become a more common job title and migrate out of Silicon Valley. I told him yes. Big Data is downright complicated on many levels. There are too many... by Jesse Anderson | Jun 29, 2016 | Blog, Business, Data Engineering, Data Engineering is hard |
A common question beginners ask about Hadoop are the technical skills needed to get started. This helps level set what skills you need before you embark on a big data journey. For developers and administrators, I divide up the skills as those that required and those... by Jesse Anderson | Jun 22, 2016 | Blog, Business, Data Engineering, Data Engineering is hard |
Everyone’s Big Data journey starts somewhere. We’re often given stories of outright mastery, but I want to tell you how I got started with Big Data. Each of these stories about mastery forget or omit their humble beginnings. This is my story from my humble...
