Hadoop Systems Engineer

IT - HADOOP SYSTEMS ENGINEER

JOB DESCRIPTION:

RESPONSIBILITIES:

As a Senior Systems Engineer in the Corporate IT organization, you will join the team responsible for the strategy, architecture, design, engineering solution delivery and operations of enterprise computing infrastructure at SaaS provider.  This includes, but is not limited to: Hadoop Infrastructure, systems management, and capacity planning.  The candidate must have a strong background in Hadoop, Linux and Virtualization.  in data management technologies and product development and deployment of Big Data applications using Hadoop.  You will be involved in IT infrastructure projects that will optimize current services as well as deploy and integrate new technologies for the global corporate IT environment. You will interact with various engineering and operational teams. The IT Senior Systems Engineer will contribute to the overall success of the engineering organization by providing recommendations and key insight into the technological path of Corporate IT. 

RESPONSIBILITIES:

- Manage multiple Linux Servers used by a Hadoop cluster
- Installation and administration of a Hadoop cluster
- Collaborate with business users/product owners/developers to contribute to the analysis of functional requirements
- Research and provide alternatives and recommendations based on best practices and application functionality
- Document performance SLAs associated with use cases in the Hadoop cluster
- Provide metrics associated with source system specific use cases in the Hadoop cluster
- Provide ongoing maintenance, support and improvements in Hadoop cluster
- Implement and manage Hadoop monitoring (notification, event, tracking
- Conduct root cause analysis and resolve production problems and data issues.
- Document and manage failure/recovery (loss of name node, loss of data node, replacement of HW or node)
- Impact to functionality/performance in during Re-replication of blocks in event of data corruption or data availability issues 

REQUIRED SKILLS/EXPERIENCE: 

- Bachelor's Degree
- 5+ years of technical systems design/support, including experience in Enterprise environments with over 4000 users
- 3-5 years of  Linux/UNIX experience
- 3-5 years of  Hadoop experience
- Deep understanding of configuration management concepts; experience with configuration management tools such as Puppet, Chef, CFEngine, etc.
- Familiarity with AD and LDAP
- Customer service oriented with strong interpersonal and leadership skills
- Excellent time management and prioritization skills
- Excellent verbal and written communication skills, actively listens and effectively conveys written and spoken information with both technical staff, colleagues and management
- Ability to work well and collaborate with other teams of various skills
- Strong analytical skills coupled with technical creativity 

DESIRED SKILLS/EXPERIENCE: 

- 4+ years of experience in designing, implementing, optimizing, and managing global enterprise level cluster technologies
- Virtualization: designing, implementing, maintaining, troubleshooting
- Significant experience in implementing information life cycle management capabilities
- VMware ESX and related VMware product lines
- Scripting skills in Perl or other Object Oriented Scripting language
- Background in large scale system administration of storage, Linux/Windows and virtualization systems
- Background in Information Security
- One or more industry certifications