Dieses Jobangebot ist archiviert und steht nicht mehr zur Verfügung.
Vakante Jobangebote finden Sie unter Projekte.

Consulting Engineer (Senior) 3595051 HDF Integration (m/f/d)

Eingestellt von Hays aus Mannheim, Universitätsstadt

Gesuchte Skills: Python, Sql, Engineer

Projektbeschreibung

REFERENCE NUMBER:

485077/1

MY DUTIES:

- HDF Integration and Data Utility Collection
- Technical consultation for and implementation of Azure Databricks transformations (SQL or Python) of data stored in Azure Data Lake (from several data sources, e.g., IoT and process data) so that is can be accessed efficiently
- Technical consultation for and implementation of “delta transformations”, i.e., transformation of only new data since the last transformation (e.g., daily or hourly)
- Set up Databricks jobs for the above transformations considering dependencies between them (e.g., Job A must be finished before Job B can start)
- Creation of (automated) tests for the above solutions
- Creation of hand-over documents (operational task list, operational handbook, infrastructure sheet) for maintenance team
- Remote training of the maintenance team about implemented transformations (probably 1-3 sessions, depending on the complexity)

MY QUALIFICATIONS:

- Expert level developing skills in SQL and Python
- Very good knowledge of English

MY BENEFITS:

- Exciting project

PROJECT INFORMATION:

The project aims at (1) collecting a huge amount of data from different data sources (IoT data, process data etc.) into an Azure Data Lake Storage on a continuous basis (e.g., hourly or daily) and (2) and joining/transforming (part) of the data and copying it to different folders in the Data Lake (e.g., for third party access).

ABOUT HAYS:

IT specialists hold all the cards: for its customers in industry and the public sector, Hays is looking for motivated employees who like looking at the bigger picture and growing with new challenges. We make sure that you benefit from our many years of experience in IT recruitment and will find you the right role to suit your skills and interests – all completely free of charge to you. Register with us and reap the benefits of job offers that are both interesting and relevant to your skills and experience.

MY CONTACT AT HAYS:

My contact person
Sebastian Greve

Reference number
485077/1

Contact
E-Mail: [email protected]

Projektdetails

  • Einsatzort:

    North Rhine-Westphalia, Deutschland

  • Projektbeginn:

    asap

  • Projektdauer:

    2 MM+

  • Vertragsart:

    Contract

  • Berufserfahrung:

    Keine Angabe

Geforderte Qualifikationen

Hays

  • Straße:

    Willy-Brandt-Platz 1-3

  • Ort:

    68161 Mannheim, Universitätsstadt, Deutschland