DWH Developer (Spark, Hadoop, Python, Groovy, Ruby)

DWH DEVELOPER (SPARK, HADOOP, PYTHON, GROOVY, RUBY):

We are urgently seeking a DWH Developer (Spark, Hadoop, Python, Groovy, Ruby) for a potentially long-term Front Office and risk project with a well-known financial services institution in Amsterdam.

The DWH Developer (Spark, Hadoop, Python, Groovy, Ruby) will be responsible for the storage, analysis and processing of Real Time data streams in the Back End and getting this data back out again in a proper and accurate manner that will enable the traders to price faster and more accurately.

The DWH Developer (Spark, Hadoop, Python, Groovy, Ruby) will ideally have 65% of the following skills and experience:

- Experience in set-up ETL pipeline and data-model
- Experience programming Scripting languages eg Python, Groovy, Ruby
- Experience managing distributed systems and clusters
- Experience in testing in data pipeline and data-integrity
- Experience in Spark, Hadoop
- Experience in setting up SQL/noSQL databases (+ knowledge about Postgres)
- Experience with Linux systems administration
- Experience designing solution architectures
- (Optional) experience in Airflow
- (Optional) experience in Scala