Data Engineer - Senior

Description

Project/Department Description and responsibilities:
Our client employs various teams of IT specialists who, among other things, optimize and maintain all business processes and systems used (both self-written and purchased applications) so that its clients and customers are optimally serviced. As part of this team, OPI is looking for a (preferably Senior) AWS Data Engineer.

The Senior Data Engineer will play a vital role collaborating as part of a Data team to create and enhance data ingestion pipelines and address data challenges. The Senior Data Engineer will work closely with the Architect, systems engineers, software engineers, and data scientists on the following key tasks.

Responsibilities

  • Create and maintain optimal data pipeline and data lake
  • Assemble large, complex data sets that meet functional / non-functional business requirements
  • Perform tests, validate data flows and prepare all ETL processes, incorporating business requirements into all design specifications
  • Design and develop all data mapping techniques for all data models in systems
  • Document technical and system specifications for all ETL processes
  • Analyze and interpret complex data on all target systems, coordinating with internal and external stakeholders to validate requirements
  • Perform root cause analysis, resolve and validate all production data issues.

Skills

Technical profile requirements

  • Preferably +5 years of experience as Data Engineer, minimum +2 years
  • Experience developing flexible data ingest and enrichment pipelines, to easily accommodate new and existing data sources
  • Experience with continuous integration and deployment (CI/CD) pipelines and their enabling tools
  • Experience developing Microservices to fit data cleansing, transformation and enrichment needs
  • Very good knowledge & experience of cloud technologies : Python is mandatory, others are a nice to have (Spark, Hive or other data processing technologies)
  • Experience with AWS cloud services is mandatory
  • Working knowledge of database technologies (SQL) is mandatory
  • Experience with an ETL tool is mandatory
  • Experience with Microservices architecture components
  • Docker and Kubernetes are a nice to have
  • Experience with Jira, Confluence and extensive experience with Agile methodologies are a nice to have


Non-Technical profile requirements
- Strong analytical and problem-solving skills
- Detailed oriented/self-motivated with the ability to learn and deploy new technology quickly
- Must be able to work on multiple simultaneous tasks with limited supervision
- Result oriented & customer centered
- Structured / Organized
- Excellent interpersonal, communication and team collaboration skills
- High accountability and team spirit values

Methodology/Certification requirements

  • Master’s Degree in Computer Science OR equivalent through experience.
  • Any AWS Sysop, Devops or Solution Architect certification is a plus.

Language proficiencies

  • ENG
  • FR and/or NL is a big plus

APPLY FOR A JOB

ID
BRCO22220

You are about to apply for the job "Data Engineer - Senior".