Developer (m/f) BIG Data

„Als Senior Recruitment Consultant bringe ich durch Active Sourcing und dem Führen von ausführlichen Interviews Projekt und Freiberufler zusammen. Dabei stehen für mich Qualität, schnelle Prozesse und zufriedene Freiberufler an erster Stelle.“

Aufgaben:

- Set up Continuous Integration to be ready for Regression tests and Automatical deployment
- Create Operations manual
- Implementation of generic Job which than can be deployed to our other Talend Environments DE/FR/ES

depending on the chosen architecture
- Testing of solution
- Installation of new Job server on a Windows Server
- Register the Job Server into the existing Divisional Talend Environment
- Handover / Support transition from existing projects to the operational Team
- Integrate a FAM Directory (mounting of directory) into the JobServer
- Prove of concept to access FAM Data by using a Service Account
- Prove of concept for delta data load and parallelization of processes to reduce load time
- Prove of concept to load data into the Palantir Foundary Datalake
- Implement / Establish a Kafka Import/Export
- Implement an import job for BigData into Kafka
- Documentation of the prototype

Skills:

- Very good experience in Development
- Very good experience in Palantir Foundary Datalake
- Deep experience in Apache Kafka
- Very good experience in BigData (possibly HortonWorks)