Big Data Engineer

You will support the data analysts together with our big data team.
This includes tasks ranging from maintenance to new developments of the big data platform, but also the elaboration of data extraction and transformation pipelines (ETLs) in Python, Java and/or Scala (Spark). This involves working with technologies such as Kafka and Hadoop. Together with the team, the employee will think along and look for solutions for dealing with large quantities and different types of data (including time series, metadata, storage, queries, ...). Since the employee will also be responsible for keeping the Hadoop cluster operational (solving alerts, installing and configuring services), knowledge of the general operation of Linux, Hadoop and Spark is essential. We work in an industrial environment where security is a top priority. Knowledge of Kerberos and Active Directory is therefore desirable, together with our Linux team, to configure the security and to make the BigData platform work safely. The elaboration of reusable functionalities and their automation are a constant point of attention in our industrial environment.

Technical profile
Thorough knowledge of the programming language Python and Scala or Java
Knowledge of Kerberos and Active Directory
Basic knowledge of Linux (working via ssh, command line)
Knowledge of SQL and Hive
Knowledge of Hadoop, Spark, Jupyter/Zeppelin notebooks

Location Ghent
Duration 12 month +

Start Date ASAP.

Apply below

Parallel Consulting is acting as an Employment Business in relation to this vacancy.