Senior Data Engineer M/F/X

Created on 04-07-2018

Location Berlin

CLOSED VACANCY Apply now

Description

• You will be responsible for building a data platform for running big data workloads at scale, collecting and combining data from various sources and help data consumers to consume data in our data lake.
• You manage the Customer Journey: Full data integration of webtracking-data with master data to understand customer and user behavior
• You are responsible for establishing a Data Catalogue: registering and documenting ingested, stored and processed data
• You improve the Tool-Layer on top of existing Messaging and Ingesting Service (e.g. generic data on/offloading in/from Kafka; Kafka topic admin-tools) • 5+ years of experience as Data Engineer or Backend Developer
• Solid expertise in at least one programming language (preferably Scala or Java)
• Excellent SQL and data management knowledge
• Experience with big data technologies (Spark, Redshift, Hadoop)
• Practical experience with Amazon Web Services

Nice to have:
• Previous experience in the design and implementation of complex data pipelines (Luigi, Airflow, AWS Data Pipeline)
• Knowledge of Python data science stack (Pandas, Scikit-learn, Numpy, Keras, etc)
• Familiarity with machine learning
• Experience with Docker