Data Engineer

DATA ENGINEER

A Data Engineer is urgently required for an immediate start with a major financial services client based in Amsterdam.

The Data Engineer will ideally have 65% + of the following skills and experience:

- Linux administration
- Configuration management
- Scripting Languages (Bash, Python)
- DevOps and Continuous integration (Git, Jenkins)
- User access management (LDAP and Active Directory)
- SQL Server
- ETL Tooling (SSIS)
- Big Data (Hive, Yarn, Flume, Sqoop, MapReduce)
- Hadoop (Hortonworks, Cloudera, MapR, Apache)
- Programming (Java, Scala, Python, R)
- Data Science (Analytics, Statistics, Machine Learning)

The Data Engineer will be responsible for activities including:

- Profiling data sources
- Building and testing data pipelines (using ETL tools (SSIS) and/or programming/Scripting languages)
- Communicate with data delivery partners about data delivery structures, frequencies, escalating quality issues.
- Communicate with IT partner in solving issues
- Build views and/or procedures (MS SQL Server 2016) for delivering data sets to the data scientists
- Manage security

This is an urgent requirement and interviews are arranged for next week!