Devops Engineer (m/f) Data Engineering

Aufgaben:

• Located within the site operations group, the engineer will support a separate data team by bringing their use-cases
and workloads to an Openstack cloud.
• The client relies on dual datacentre and switchover capabilities, so that a general understanding of these challenges is desired and additional engineering might be needed.
• Git/Github, Saltstack and Jenkins are used for automated system integration.
• Sensu is used for monitoring.
• Engineer concentrates on the architectural part of the product development itself including production-ready
stability and performance analysis.
• Data pipelines might have to be designed properly from the beginning to the end.
• Solutions should in general follow the KISS principle, but the client values proactive and innovative colleagues by providing trust and freedom of action.

Skills:

• Experience and proficiency in data automation and management, particularly Hadoop, HDFS and Spark
• Experience with Elasticsearch, Apache Cassandra and Apache Kafka as search and data backends
• Experience configuring and spawning cloud instances (Openstack, AWS, Azure)
• Experience using ansible or saltstack environments for the cloud is a big plus
• Experience in managing and using data with relational databases, e.g. MySQL and Sqoop
• Experience with Cloudera Hadoop Distribution is a big plus
• Experience using git and preferably github are a big plus
• Experience with java applications (Streams, Akka) are a big plus
• Knowledge of Talend software or other data ingestion pipelines is a plus
• BS or MSc in computer science or related field and 3+ years of relevant work experience.