Data Engineer

Data Engineer

Becoming data driven is a key pillar of the company strategy. They want to make decisions that are fact based: based on data insights.

The challenge is to process the enormous amount of data from multiple different systems and create usable insights. The company is currently improving it's big data/data lake environment. They are setting-up a BI scrum team to deliver KPI dashboards, advanced analytics, explorative insights and predictive models.

Main task of the data modelling expert is to:
- Set-up enterprise/Consumer data model and data transformations within the data lake
- Collaborate with the broader the business: business users, analysts and other stakeholders
- Develop Data Dimensional modelling constructs
- Ensure data design follows the prescribed reference architecture and framework while reflecting appropriate business rules
- Understand the relationships across business information and units of data
- Ensure that data transformations are well documented follow best practices and understood by business users and developers
- Reverse engineer data from various source systems

You will work to set-up and improve the data lake environment. You add and integrate new data sources and you tweak the big data platform so that analysts can do their work in an optimal way. Since they work in scrum cycles you will be involved in engineering as well as testing.

Required experience:
- 5 plus years of Data Modeling experience
- Experience in Data Governance, Stewardship and Data Quality
- Experience with Metadata Management and Metadata Products

* Self-driven on projects with provided requirements
* Hands-on pragmatic attitude

Bonus:
* Experience in data engineering
* Backend Data Work Experience.
- Experience with Hadoop platforms, preferably Hortonworks distribution and tools that comes along with it

* Data warehouse AND/OR Hadoop Hive Experience. Mainly on HIVE and Data Storage such as ORC, AVRO
* ETL and SQL Experience
* Experience in programming data handling tools (eg streamsets)