Hadoop Developer Architect

Our client is one of the world's leading financial services seeking a veteran DATABASE ARCHITECT/ENGINEER to contribute to the development of a security analytics project. Candidates must have 7-10 years' experience working with Data Warehouses, including 2-3 years in Hadoop for a premium contract opportunity.

PRIMARY RESPONSIBILITIES:

- Understand the Security Analytics business requirements and work with technology teams to recommend best approach to delivering solutions on the Hadoop Platform.
- Work with security, data platform team, engineering and technology to implement Security Analytics platform.
- Ensure the Security Analytics platform conforms to corporate standards.
- Participate in code reviews.
- Define and support process for access to the Security Analytics Platform including balancing the needs of various business groups with security requirements, and Platform capacity.
- Work with Architecture and Development teams to understand usage patterns and work load requirements of new projects in order to ensure the Security Analytics Platform can meet demand.
- Develop administrator processes, document the processes, and then train other client users, as warranted, to take over the processes.
- Maintain all system configuration documentation by collecting, storing, and updating the documentation.

QUALIFICATIONS:

- Minimum of 10 years of technical experience with a focus on open source and large data implementations in the Petabyte range
- Business acumen/solution expertise and technical expertise all required for this role
- Experience developing solutions for Banking, Fraud, Risk or Marketing groups desired
- Solid understanding of all phases of development using multiple methodologies ie Waterfall, Agile
- Proven Linux experience including: Basic Administration, Files and Permissions, Directory Navigation, Job Scheduling, Shell Scripts
- Hadoop Distributed Data Files System experience including:
- Use and set up of Blocks, Namenodes, Datanodes
- File Systems Interfaces, parallel copies, cluster balance and archiving
- Scaling Out including data flow, combiner functions, running distributed jobs
- Hadoop Streaming with Python
- Hadoop Pipes
- Sorting, joins and side data distributions
- MapReduce
- Strong knowledge of Hive including;
- Familiarity with Hive Query Language
- Plug Ins, Interfaces, User Defined Functions, SerDes
- Basic Operators and Functions, Web Interface and Hive Client
- General relational DB knowledge
- Experience with Oozie, Sqoop, Datameer, Flume
- Desired but not required: Python, Hbase, Pig, Cascading, Tableau, SAS, EMC Green Plum
- Industry background in financial services, banking, or card processing a plus

TECHNICAL EXPERIENCE

- Java 5+ years
- ASP.NET 1+ years
- HTML 5+ years
- J2EE 1+ years
- Test Automation 2+ years

6 month contract with possibility for extension or conversion.