EDITED logo EDITED

Software Engineer (Data Ingestion)

Created on 15-09-2017
Location London

Description


At EDITED, you'll be part of our Product and Data team, working closely with other software developers and data scientists, retail specialists and designers to create data-driven solutions to our customers' problems. We've got huge scope to innovate and we always welcome fresh perspectives. You'll be able to make a big impact, and learn a huge amount during your time at EDITED.


We bring in the best candidates to meet our existing team and get to know them before making a hiring decision together.




As part of the ingestion dev team, you’ll be responsible for making sure that we have complete visibility over the 15 million data points that come into our system every day. As that number doubles over the next year, you’ll be working in the team that’s making sure that we’re keeping on top of it.


That can mean writing applications to alert about any anomalies in our data in real time, writing tools to make it easier to manage what data is coming in, or investigating new ways to scrape data correctly and efficiently from online sources.


You should be used to working in Python, preferably as a web developer. You should have worked with crawlers before, and understand the challenges and limitations that they have (and how to get round them). If you’ve used Elasticsearch extensively, even better.


Essential
  • 2+ years experience working with Python (2 or 3)
  • Experience working with web crawlers
Desirable
  • Experience with Scrapy
  • Experience with Elasticsearch and Logstash
  • Experience of browser automation (Selenium or other)
  • Familiarity with Machine Learning techniques
  • Knowledge of best practices for web crawling, including cookies

Benefit

Pension Scheme

Pension Sche...

Employee Stock Options

Employee Sto...

Flexible Hours

Flexible Hou...

Childcare Voucher

Childcare Vo...

Annual Company Retreat

Annual Compa...

Loaded drinks fridge (beer + wine on Friday)

Loaded drink...

CLOSED VACANCY Apply now

Video