Hadoop Administration hadoop linux and admin hadoop admin
Experience
6 to 11 Years
Industry
IT - Software Services
Functional Area
IT
Job Description
Experience : Min 6-12 Yrs From Big Data Perspective: - He should have worked on Big Data : Support / Installation & configuration for atleast 3 years and NOT on Development - Hadoop Stack are HDFS, Sqoop, Pig, Hive, Hbase, MapReduce, Oozie, ZooKeeper , YARN - Knowledge of Hadoop Clusters - Some experience in Unix / Linux From Support Perspective: - He should have worked on Support Project for at least 4 - 5 yrs - Need to understand ITIL process or work on ITSM Tools : BMC Ready, iClarity .. Detailed JD : The Big Data Solution Tech Lead's primary role will be to lead a technical team in expanding the capabilities of our consumer data platform to deliver cutting edge analytics solutions. He/she will lead all technical aspects of the Big Data platform, from operation support with a constant focus on building scalable and secure solutions. In addition, the Tech Lead will be responsible for data applications and analytics solutions, including applications that acquire data as well as data driven applications. This role must be extremely passionate about Big Data platforms and analytics solutions with a strong desire to learn and evolve customer support around solution based on the rapidly changing analytics landscape. Everyone on the team is an active member and this role is expected to lead by example. Primary Responsibilities: * Provide Hadoop Administration support which includes infrastructure setup, software installation Cloudera and open source configuration, upgrading/patching, monitoring, trouble shooting, maintenance, and working with development team to install components (Hive, Pig, etc.) and manage YARN jobs. * Strong understanding of Cassandra and SOLR searches. * Good exposure to hyper scale architecture. * Understanding of SNACK (Spark, Nesos, Akka, Cassandra, Kafka) technologies and work with Solution architects in designing a solution. * Gathers and assesses customer needs, both business and technical * Identifies site-specific parameters and constraints that impact the customer support. * Identifies likely problem areas that require attention Additional Responsibilities : *Generates and Technical Support Problem solving plan with SLA's. *Assists with Support requests for expertise from customers Knowledge, Skills and Abilities *Strong Linux system administrator skills. *Excellent knowledge of Hadoop architecture and administration and support. *Proficient in YARN, Map-Reduce, Zookeeper, HBASE, HDFS, Pig, Hive, Sqoop, Flume. *Expert understanding of ETL principles and how to apply them within Hadoop. *Experienced with linux system monitoring and analysis. *Strong understanding of MySQL DB and postgresDB. Complexity : Work on issues of diverse scope where analysis of situation/ ticket or data requires evaluation of a variety of factors, including an understanding of current architecture. Interaction : Frequently interacts with subordinate supervisors, customers, and/or functional peer group managers, normally involving matters around Technical Support functions Supervision : Manages, perhaps through subordinate supervisors, the coordination of the activities of a Support Team around big data solutions.