Big Data Engineer

BIG DATA ENGINEER

SKILLS: Ruby, Python, Hadoop and MapReduce

SUMMARY:

The Big Data Developer will help create the next generation product transforming data into actionable results.

RESPONSIBILITIES:

- Prepare technical architecture and implementation design documents for enterprise data and application solutions
- Select technologies to meet business and technical needs
- Work directly with Business Analysts to deliver insights to customer
- Use advanced statistical, machine learning, graph computing and data mining techniques to analyze complex human/machine behavioral data as well as third-party data and develop sophisticated algorithms to deliver repeatable solutions to assist worker performance and drive business value.

QUALIFICATIONS:

- BS Degree in Computer Science
- Ruby and Python
- RDBMS (PostgreSQL 9+) experience
- Hadoop and NoSQL experience
- Fluency with using MapReduce
- Well versed in Installing, Configuring & Managing distributions of Hadoop (CDH3, CDH4, Cloudera manager 4.7.2, MapR, Hortonworks, HBase, Oozie, Solr, Sqoop, Pig, Hive, Flume, Hcatalog, Zookeeper ...etc) on Linux operating systems
- Experience working with large datasets in a distributed computing environment
- Experience in applying multivariate statistics, machine learning (supervisedfamiliarity with data modelling approaches such as ERD and concepts behind relational, normalized and star schema database architectures
- Strong foundation in computer science, with strong competencies in data structures, algorithms, and software design
- Experience with search technologies like Solr and Lucene
- Experience in working on Petabyte scale Big Data stores is a big plus
- Knowledge of cloud computing infrastructure (eg Amazon Web Services EC2, Elastic MapReduce) and considerations for scalable, distributed systems is a plus
- Excellent verbal and written communication skills

BENEFITS:

Our IT consultants enjoy a wide array of benefits including: medical, dental, 401K, life insurance, Employee Assistance Program and more.