When educational material is created, it starts with a learning objective. It doesn’t matter it’s a book or a video series. This learning objective defines what the book is supposed to teach you. You’ll usually see this learning objective in the...
I had an interesting question at TDWI Boston that I haven’t been asked before: If you absolutely had to do something with Hadoop and Big Data tomorrow, how would you do it? I’ll answer this from a technical and then a management point of view. Technical I...
Sometimes I’ll train at a company that’s creating a data engineering team. The team often includes a Data Scientist. I’ll always make a note to talk to the Data Scientist about their experience and interactions with the team before I arrived. These...
You don’t have previous Big Data experience, but want to get hired as a Data Engineer. Don’t worry, you can get hired. You’ll need a well executed personal project that gets you noticed and shows your skills. I’ve verified this with hiring...
My friend, Justus Eapen, interviewed me for his podcast Hacker Practice. The interview is broad and covers everything from creativity to Big Data to my Data Engineering Teams book. This interview goes into deep into many of data engineering concepts and theories. Can...
I’m open sourcing one of the modules I wrote for my Real-time Data Engineering class. We use Apache Spark and Apache Kafka to process data. Then, we show the data in real-time on a webpage using this JavaScript module to pull in data from Kafka via the Kafka...
