Experience

• 

  Cognizant

  May 2014 - Jul 2018

  Roles & Responsibilities:• Storing the landing raw data in External Hive Table• Cleansing, aggregation of columns and proper structuring of the raw data using PIG and storing the processed data in staging External Hive table• Performing joins on the staging data using Hive Scripts• Designed both Managed and External tables in Hive to optimise performance. • Implementing performance tuning techniques for hadoop and hive.• Solved performance issues in Hive scripts with appropriate Joins, Group and aggregation. • Creating UDFs as and when required.• Creating and scheduling scripts for transformation and loading into table using oozie.• Populate Application Layer data for further processing and analysis.• Involved in near Real Time processing of tuning events using Storm & Kafka and batch processing of supportive & related data as well as upstream and downstream data processing using Hadoop Ecosystem. • Involved in automating jobs using shell scripting and scheduling using UC4. • Well versed in creating of Kafka topics and feeding data in the Kafka producers and collecting data from Kafka consumers Show less As Part of Big Data CoE team,worked with multiple clients.• Involved in development of cross platform validation tool which is an automation solution Big data related testing.• Integrating Hadoop with components like Pig, Hive, Sqoop, HBase,Oozie & creating POC to the clients.• Exploring NoSQL Stores (HBase, MongoDB and Cassandra), their pros and cons, and use cases.• Worked on PoC’s related to CRUD operations in Hbase, MongoDB.• Define Non-Functional Testing approaches in Hadoop• Define Performance enhancement approaches in Hadoop.• Connecting Tableau with Hive for Visualisation of data.• Explored Hue,Cloudera Manager, Ambari• Explored Spark,RDD,SparkSQL Show less

  • Associate

    May 2017 - Jul 2018

  • Programmer Analyst

    May 2015 - May 2017

  • Programmer Analyst Trainee

    May 2014 - May 2015
• 

  Infosys

  Jul 2018 - Aug 2021

  Build and orchestrated bigdata applications using technologies like Hadoop, Python, PySpark, Hive, Hbase,Mongodb, Nifi , Unix

  • Technology Lead

    Jan 2021 - Aug 2021

  • Technology Analyst

    Jul 2018 - Jan 2021
• 

  Springml, inc.

  Aug 2021 - Nov 2023

  Lead data engineer

  Designed and developed outreach campaign application and pipeline for client part of Health care domain

• 

  Thoughtworks

  Nov 2023 - now

  Senior consultant data engineer

  Data Products, Data Mesh, BigData, Cloud