Responsibilities

• Analyse, assemble, develop, and maintain enormous, complex datasets in accordance with business requirements
• Build the infrastructure required for ETL processes using a variety of data sources
• Build data systems and pipelines, and ensure that coworkers have easy access to and backup of your work
• Prepare raw data for data scientists to manipulate
• Collaborate with internal and external team members such as data architects, data scientists, and data analysts
• Include data management procedures in the current structure of the organisation
• Help streamline data science workflows, adding value to product offering and building out customer lifecycle and retention models

Requirements

• X years of experience as a Data Engineer or in a related field
• Proficiency in programming languages such as Python, Java, C++, SQL and R
• Ability to stay updated with new machine learning methods
• Knowledge of operating systems like Solaris, UNIX, Linux etc.
• Familiarity with the AWS ecosystem specifically RedShift and RDS
• Technical expertise with data structures, data lakes and models