Profile
Professional work experience in analysis, design and development in Big Data process using Hadoop concepts and framework.
Experience in Hadoop version 1 and version 2(2.7)
Experience in working in HortonWorks distribution.
In-depth understanding of HDFS Architecture and hands on experience with Hadoop ecosystem - Pig, Hive, MapReduce, Sqoop, Flume, Oozie and Core Java Programming.
Knowledge of writing complex Regular Expressions to ingest, parse, validate and cleanse structured, semi-structured and unstructured datasets for data processing.
Analyzing/Transforming data with Pig and Hive.
Experience in using Piggybank and other inbuilt functions of Pig for complex data processing.
Having experience in writing UDF as per the data requirement.
Creating Sqoop jobs for importing and exporting data from HDFS to Relational Database systems and vice-versa.
Experience with Oozie Workflow Engine in running jobs with actions that run Hadoop Map/Reduce jobs.
Consulting on Big Data projects like Proof Of Concepts, implementation etc.
Comfortable with UNIX command line.
Good Communication and client interaction skills.
Experience in Data Visualisation using Tableau.