Data Engineer-Advanced

Description

Context

Our client as a Data Driven Company will  leverage data across the group to generate new revenue streams and efficiency levers. To achieve this, a dalalake (Common Data Hub) is being built and GEM is contributing as an early adopter.
Client Data and Market information are historically at the heart of GEM business model and expertise.

GEM Challenges are:

  • Improving our decision process and activity overview and providing new high value services to our clients.
  • Enabling value and opportunity creation

Purpose of the service

The service will be provided within the Short Term Power as a Service (SPaaS) Data team that is responsible for implementing projects in the GEM datahub, adressing with business and IT team various use cases.  
Services will be around:

  • Data collection
  • Data ingestion (structured and non-structured) in datalake
  • Data processing and transformation upon use cases (historization, analytics, datascience, …)
  • Data exposition
  • Performance and cost optimization

Services expected from the Service Provider

The activities presented above correspond to the expectations of GEM-IS. It is up to the Service Provider to complete and specify the content of each if necessary, or even add other activities.
The Service Provider is expected to put forward a profile with the skills requested in line with the requested activities. After analysing the activities, the Service Provider may propose complementary skills.
All of the deliverables shall be drawn up according to the presentation models and standards in force at GEM-IS.
The deliverables shall be handed over during performance of the service including in intermediary versions. They shall be sent in electronic form by the company’s messaging service.

Responsibilities

  • Collecting, understanding, challenging and refining business requirements & opportunities
  • Designing solutions following architecture guidelines 
  • Leading development activities and contributing to developments in a senior / expert role : Development activities consist in building and maintaining efficient, reusable, and reliable code, as per high standard of software quality, design and testing principles while delivering solutions on-time and on-budget
  • Supporting continuous improvement of the services and applications. Identifying bottlenecks and bugs, and defining solutions to these problems
  • Accompanying and supporting junior staff
  • Delivering production ready services to users with the highest level of satisfaction
  • Writing and updating technical documentations in English and making them available to the team and partners.
  • Providing effective and timely communication to all relevant teams

Skills

The consultant(s) put forward for this assignment must have extensive experience in the activities outlined below in addition to excellent analytical skills, accuracy, and good listening and communication skills.

The consultant(s) put forward for this assignment must have extensive experience in the activities outlined below in addition to:

  • Ability to collect information focusing on the Why.
  • Ability to solve problems creatively and effectively
  • Be open to receiving objective criticism and improving upon it.
  • Fluent in English and French.
  • Familiar with the Agile methodology and experienced in SCRUM

Expected technical competencies
Required technical competencies: (in order of priority for the assignment)
Candidate must master at least 2 to 3 of the following:

  • Big data technologies: HDFS/S3, Hive/Athena/Presto, Spark/Glue, Kafka/Kinesis, …    
  • Big data patterns: lambda, partitioning, bucketing, design by query, …   
  • Coding (Python, Scala)
  • AWS

Expected functional competencies
Required functional competencies: (in order of priority for the assignment)

  • Proactive, ability to take initiatives in its own area of responsibilities and solution oriented   
  • Ability to lead developers towards delivery and quality   
  • Ability to multi task   
  • Good practice of software development standards   
  • Good knowledge of Agile methodologies (Scrum, Kaban, ...)    
  • English    

APPLY FOR A JOB

ID
BRRO25363

You are about to apply for the job "Data Engineer-Advanced".