Hadoop Admin

Hadoop Admin

Location: Plano, TX
Position Type: Contract, Minimum 1 year
Hourly: BOE!

GTN Technical Staffing is searching for a Hadoop Admin for a minimum one year contract in Plano, TX. The Hadoop Admin will Design, Build out, Define, Deploy, and Support the Platform in a secure production worthy manner. With the "Platform" today being based upon Hortonworks. This position is responsible for the day-to-day operations and maintenance of the Hadoop clusters as a part of the "Platform". It's understood that many other skills are required to maintain and manage a Hadoop cluster this includes: Linux administration, JAVA, SQL, Understanding of the X86 Harsdware platform. To this end, experience in designing, deployment, maintenance and specifically troubleshooting large Hadoop clusters (100's to 1000's of nodes, across multiple clusters with multi-PBs of data/storage) driving for optimal performance and stability along with 7x24 hour uptime. This requires management of the cluster down to failed hard drives, hardware/firmware tuning and upgrades. BIOS configuration and upgrades to insure continuous improvement in uptime and performance levels. High level planning for disk layout, security of data based upon normal POSIX configurations and or new technologies (Ranger etc.). Working with Server Operations, and Network Engineering to insure high performance capability via clean, clear network designs for east west as well as north south based traffic.

TECHNICAL REQUIREMENTS
Deep knowledge and broad experience across the Hadoop ecosystem. Ability to tune and operate HDFS, MapReduce, YARN, Hive, HBase at scale.
Experience monitoring Hadoop & underlying Servers and infrastructure for optimal performance and uptime via Nagios, Ganglia, Hadoop UI/REST API, command line tools etc.
Strong troubleshooting ability resolving Hadoop performance and availability issues. Ability to share knowledge and mentor others.
Ability to provide guidance to developers and end users in the Hadoop environment regarding best practices for optimal job performance, resource usage, etc.
Experience designing and implementing HDFS access controls, directory and file permissions user authorization that facilitates stable, secure access for multiple users in a large multi tenant cluster
In depth experience with Linux Shell, utilities, and Scripting
Ideally experience with Hortonworks 2.X and above