Talend Big Data Engineer

Our global client are looking for a Talend Big Data Engineer.

Overview:

Within the Tech department, the mission of the Big Data Engineer will be to contribute to the evolution of our advanced analytics platform through:

- Implementation of data ingestion pipelines allowing to collect data from heterogeneous systems (relational databases, machine logs, sensor streams, external sources, etc.), either in batch or in Real Time
- Further transformation and quality verification of those data in our Hadoop cluster, making them readily available for subsequent analytics (enterprise data warehouse feed) and data science initiatives
- Deployment, maintenance and extension of the solutions enabling both these data ingestion/transformation flows and the data science initiatives that will exploit them

Main responsibilities/tasks:

- Interacting with functional and business stakeholders to understand the context and scope of their data related initiatives and propose the most appropriate technical solutions
- Deploying data ingestion pipelines aiming at collecting data from multiple sources and under heterogeneous formats (structured, semi-structured or unstructured) in our Hadoop cluster
- Further transforming and quality checking those raw data in order to facilitate their consumption in the scope of both analytics and data science initiatives
- Deploying, configuring and maintaining the solutions supporting these data ingestion and storage flows (eg Cloudera Enterprise, Talend Big Data)
- Deploying, configuring and maintaining the data science solutions allowing to extract insights from ingested data (eg data science workbenches)
- Actively participating in the documentation and (in)formal testing of the deployed solutions

Desired skills:

- Previous relevant experience as big data engineer within various industries
- Knowledge of and technical experience with big data solutions, data ingestion/transformation flows and data warehousing (eg Kimball, Data Vault)
- Practical experience with the following solutions: Cloudera, Enterprise, Talend Big Data
- Previous exposure to data science solutions (eg RStudio, Apache Zeppelin, Cloudera Data Science Workbench) is a plus
- Ability to produce state-of-the-art documentation
- Fluent English