Developer (m/f) BIG Data

„Als Recruitment Consultant im Competence Team für Großkunden, bearbeite ich nahezu täglich neue Anfragen mit interessanten Anforderungen. Besonders Spaß bereitet mir das Ansprechen unterschiedlicher Kandidaten, welche ich passgenau einem Projekt zuordne und erfolgreich vermittle.“

Aufgaben:

- Set up Continuous Integration to be ready for Regression tests and Automatical deployment
- Create Operations manual
- Implementation of generic Job which than can be deployed to our other Talend Environments DE/FR/ES

depending on the chosen architecture
- Testing of solution
- Installation of new Job server on a Windows Server
- Register the Job Server into the existing Divisional Talend Environment
- Handover / Support transition from existing projects to the operational Team
- Integrate a FAM Directory (mounting of directory) into the JobServer
- Prove of concept to access FAM Data by using a Service Account
- Prove of concept for delta data load and parallelization of processes to reduce load time
- Prove of concept to load data into the Palantir Foundary Datalake
- Implement / Establish a Kafka Import/Export
- Implement an import job for BigData into Kafka
- Documentation of the prototype

Skills:

- Very good experience in Development
- Very good experience in Palantir Foundary Datalake
- Deep experience in Apache Kafka
- Very good experience in BigData (possibly HortonWorks)