Dieses Jobangebot ist archiviert und steht nicht mehr zur Verfügung.
Vakante Jobangebote finden Sie unter Projekte.
Vakante Jobangebote finden Sie unter Projekte.
Big Data Engineer
Eingestellt von Orcan Intelligence
Gesuchte Skills: Engineer, Sql, Client
Projektbeschreibung
GREENFIELD PROJECT
For our prestigious client we are currently looking for a DATA ENGINEER.
This is a greenfield project in which we are looking for a Big Data Engineer to work alongside the Data Scientists and Big Data Architects at the first initial stages of the project.
Identify the most appropriate data sources to use for a given purpose and understand their structures and contents, if necessary with the help of SMEs
Extract structured and unstructured data from the source systems (relational databases, data warehouses, document repositories, file systems, ), prepare such data (cleanse, re-structure, aggregate,) and load them onto Hadoop.
Actively support data scientists in the data exploration and data preparation phases. Where data quality issues are detected, liaise with the data supplier to do root cause analysis
Where a use case is meant to become a production application, contribute to the design, build and launch activities
Ensure the maintenance and support of production applications (watch duty)
Liaise with CT teams to address infrastructure issues and to ensure that the components and software's used of the platform are all consistent
Where the skills allow for it, perform advanced data analysis on a selection of business use cases, supported by data scientists
YOUR PROFILE:
REQUIRED SKILLS
Experience with understanding and creating data flows, with data architecture, with ETL/ELT development (MS SQL Server SSIS) and with processing structured and unstructured data
Ability to write performant SQL statements
Proven experience of the Hadoop ecosystem including Hadoop file formats like Parquet and ORC
Very good knowledge of Spark & Scala
Ability to write MapReduce & Spark jobs
Experience with open source technologies used in Big Data analytics like Pig, Hive, HBase, Kafka,
Ability to analyse data, to identify issues like gaps and inconsistencies and to do root cause analysis
Experience in working with customers to identify and clarify requirements
Strong verbal and written communication skills, good customer relationship skills
ENGLISH SPEAKING PROJECT
If you have the required skills and are interested to apply, please send your CV now for immediate consideration.
For our prestigious client we are currently looking for a DATA ENGINEER.
This is a greenfield project in which we are looking for a Big Data Engineer to work alongside the Data Scientists and Big Data Architects at the first initial stages of the project.
Identify the most appropriate data sources to use for a given purpose and understand their structures and contents, if necessary with the help of SMEs
Extract structured and unstructured data from the source systems (relational databases, data warehouses, document repositories, file systems, ), prepare such data (cleanse, re-structure, aggregate,) and load them onto Hadoop.
Actively support data scientists in the data exploration and data preparation phases. Where data quality issues are detected, liaise with the data supplier to do root cause analysis
Where a use case is meant to become a production application, contribute to the design, build and launch activities
Ensure the maintenance and support of production applications (watch duty)
Liaise with CT teams to address infrastructure issues and to ensure that the components and software's used of the platform are all consistent
Where the skills allow for it, perform advanced data analysis on a selection of business use cases, supported by data scientists
YOUR PROFILE:
REQUIRED SKILLS
Experience with understanding and creating data flows, with data architecture, with ETL/ELT development (MS SQL Server SSIS) and with processing structured and unstructured data
Ability to write performant SQL statements
Proven experience of the Hadoop ecosystem including Hadoop file formats like Parquet and ORC
Very good knowledge of Spark & Scala
Ability to write MapReduce & Spark jobs
Experience with open source technologies used in Big Data analytics like Pig, Hive, HBase, Kafka,
Ability to analyse data, to identify issues like gaps and inconsistencies and to do root cause analysis
Experience in working with customers to identify and clarify requirements
Strong verbal and written communication skills, good customer relationship skills
ENGLISH SPEAKING PROJECT
If you have the required skills and are interested to apply, please send your CV now for immediate consideration.
Projektdetails
Geforderte Qualifikationen
-
Kategorie:
IT Entwicklung, Ingenieurwesen/Technik