Big Data Developer

Requirements:

- Implement data transformation pipeline in BIGDATA (DATA INGESTION, TRANSFORMATION, AND ANALYTICAL PROCESSING)
- DATA SCIENCE including data querying in SQL
- Query, Process and analyze large data sets
- Data reconciliation and processing
- Clarification and investigation pursuance with stakeholders both in the IT and Business organization
- Stakeholder communication
- Ensure application is maintainable and supportable:
- Raise/reject change requests to align the business needs for the application with stable day-to-day operations
- Ensure quality of application (eg code reviews, NFR coverage)
- Ensure application documentation is up-to-date and complete
- Support stakeholders in planning, reviews, assessments, etc.:
- Support IT organization stakeholders, including Provider, Program/Project Managers, IT Architects, IT Service Manager, IT Application Support Teams

SKILLS

- University degree or similar education in information technology or information management.
- 3+ YEARS OF SOFTWARE DEVELOPMENT EXPERIENCE IN DATA AND BIG DATA PROJECTS - PREFERABLY IN DATA TRANSFORMATION AREA
- Ability to write COMPLEX SQL QUERIES (preferable experience in DWH)
- PYTHON
- APACHE SPARK
- SCALA OR R ( OPTIONAL)
- UNIX RED HAT SCRIPTING
- DWH PLATFORMS
- JAVA (only need to have a good background but not heavy experience)
- CONTROL-M, rundeck
- Any other programming language is an asset
- Working experience in Agile teams, preferably SCRUM