Data Engineer in Advanced Analytics

The Contraste Europe Group builds strong relations with its clients. It offers a range of IT services such as: Advisory, Solutions, Applications and Infrastructure. The Group’s sector focus is with finance, utilities, public institutions and non-commercial organisations. We are operating on three countries located in Belgium, Luxemburg and France.

For one of our major clients in the financial sector, we are looking for a Data Engineer in Advanced Analytics.

Category

Application Services

Function

Consultant (Specialist)
Data Analyst
Database Administrator
Database Architect
Database Developer

Language(s)

Dutch
English
French

Reference

190531/01

Location

Brussels - Belgium

We offer

  • A challenging position in a fast-growing company with an international presence.
  • A stimulating working environment with a really good team spirit maintained by lots of internal events (teambuilding, ...).
  • A dynamic culture focused on personal development.
  • A wide range of training and career development opportunities.

Your profile

  • Experience with understanding and creating data flows, with data architecture, with ETL/ELT development (MS SQL Server SSIS, Datastage, … ) and with processing structured and unstructured data
  • Proven experience with using data stored in RDBMSs and experience or good understanding of NoSQL databases
  • Ability to write performant SQL statements
  • Understanding of the Hadoop ecosystem including Hadoop file formats like Parquet and ORC
  • Very good knowledge of Spark & Scala
  • Ability to write MapReduce & Spark jobs
  • Experience with open source technologies used in Big Data analytics like Pig, Hive, HBase, Kafka,…
  • Ability to analyze data, to identify issues like gaps and inconsistencies and to do root cause analysis
  • Experience in working with customers to identify and clarify requirements
  • Ability to design solutions that are fit for purpose whilst keeping options open for future needs
  • Strong verbal and written communication skills, good customer relationship skills
  • Will be considered as assets:
  • Knowledge of R, Python and Scala
  • Understanding of the Hadoop ecosystem including Hadoop file formats like Parquet and ORC
  • Experience with open source technologies used in Big Data analytics like Spark, Pig, Hive, HBase, Kafka, …
  • Ability to write MapReduce & Spark jobs
  • Knowledge of Cloudera
  • Knowledge of IBM mainframe

 

Your role

The Advanced Analytics team in Group Data Capabilities division is currently looking for a new Data Engineer whose core objectives will be to:

  • Identify the most appropriate data sources to use for a given purpose and understand their structures and contents, if necessary with the help of SMEs
  • Extract structured and unstructured data from the source systems (relational databases, data warehouses, document repositories, file systems, …), prepare such data (cleanse, re-structure, aggregate, …) and load them onto Hadoop.
  • Actively support data scientists in the data exploration and data preparation phases. Where data quality issues are detected, liaise with the data supplier to do root cause analysis
  • Where a use case is meant to become a production application, contribute to the design, build and launch activities
  • Ensure the maintenance and support of production applications (watch duty)
  • Liaise with Corporate Technology teams to address infrastructure issues and to ensure that the components and softwares used of the platform are all consistent
  • Where the skills allow for it, perform advanced data analysis on a selection of business use cases, supported by data scientists