Senior Data Engineer - Data Platform

Created on 08-10-2018

Location Berlin

CLOSED VACANCY Apply now

Description

As a Senior Data Engineer, you will play a key role in designing and developing our data infrastructure, architecture and processes. You will also help make the vast amount of our data accessible, reliable and efficient to query.

Team Mission:

The Data Platform team plays a central role in our data-driven strategy, designing and developing our data infrastructure, processes and analytics capabilities. We work on problems such as events pipelines, analytics or large-scale applied machine learning. The team is also responsible for making the vast amount of data accessible, reliable and efficient to query, so our teams can make the best data-driven decisions. We work on a modern Spark stack and our language of choice is Scala.

Responsibilities:

Design, build and refine our data and analytics infrastructure, scaling to terabytes of data
Grow our analytics capabilities with faster, more reliable data pipelines, and better tools
Design and develop a real-time events pipeline and work with data scientists, backend engineers and product managers to find new ways to leverage this data
Develop complex and efficient functions to transform raw data sources into powerful, reliable components of our data lake
Optimize and improve existing features or data processes for performance and stability

Requirements

You have 5+ years of experience as a Data Engineer
You have experience designing, developing and maintaining systems at scale
You have strong experience with Scala, Python or Java
You have strong experience big data technologies (e.g. Spark, Hadoop)
You have experience with building stream-processing systems, using solutions such as Kafka and Spark-Streaming
You write efficient, well-tested code with an keen eye on scalability and maintainability
You possess strong CS fundamentals and are familiar with agile development
You have an analytical mind and bake your decisions with data

Nice to have: