Some of the most interesting consultations are when I help data science teams that don’t think they need data engineering. I’ve compiled a list of some of the more common reasons why data science teams believe they don’t need data engineering and why...
As a distributed systems person, I’m used to figuring out how to spread a problem out to the most number of computers possible. Spreading out a problem lets me leverage my resources far better and faster. However, we’re failing to apply this optimization...
“What we know is a drop, what we don’t know is an ocean.”• Isaac Newton Data engineering is one of the disciplines where you just know a drop. Some companies are saying it’s easy, and you just need to know a drop. My experience in the field...
Between August 19, 2020, and October 17, 2020, I ran a survey to get more data for my latest book Data Teams. Overall, we had 86 respondents. This survey was designed to get information about how management uses data teams, the value they’re creating, and how...
Data teams require all of their parts to be complete and succeed. When one of the teams of a data team is missing, the other teams will suffer. Often, organizations or team members don’t understand what’s happening when a team is missing. They blame...