Shubham Deshmukh

Experience

• 

  Betamonks Technology Factory Pvt. Ltd.

  Mar 2017 - Aug 2018

  Executive Software Development

  1. Testing and bench-marking new nodes.2. Being involved with support guys in the P2 issues.3. Standard system admin work like creating new users in hadoop, handling permissions, performing upgrades.4. Day-to-day cluster issues like finding out which job taking more time and finding out reasons. If job taking more time than usual.5. Installed/configured/maintained apache hadoop clusters for application development and hadoop tools like hive, flume, hdfs, zookeeper, oozie.6. Managed 25 nodes CDH6.2.1 using cloudera manager and linux RedHat 7.6.7. Analyzed the data by performing hive queries.8. Configured various property files like core-site.xml, hdfs-site.xml, mapred-site.xml, hadoop-env.xml based upon the job requirement.9. Driven HDP POC’s with various lines of Business successfully.10. Configuring yarn tuning.11. Implemented Kerberos Security Authentication protocol for existing cluster using Active Directory.12. Ensured data integrity using ‘fsck’ and another Hadoop system admin tools for block corruption.13. uccessfully migrated namenode from one node to another using cloudera manager.14. Managed log files, Backups and Capacity.15. Responsible for finding and troubleshooting hadoop Errors.16. Working with data delivery teams to setup new Hadoop users. This job includes setting up linux users, setting up kerberos principals and testing HDFS, hive.Tools Used: Cloudera Manager, Solix, Putty, Jenkins, Kubernetes, servicenow. Show less

• 

  Wipro

  Oct 2019 - May 2022

  Senior Software Engineer (Big Data Hadoop Admin)

  1. Manage and analysed solix log files.2. File system management and monitoring.3. Develop and document best practices.4. Creating and configuring hive db and proving support to it.5. Configuring Source and Target for moving data from source to the destination.6. Working on KB Population and Bulk Migration.7. Manage user and provide the access.8. Worked on tomcat upgrade activity.9. Moving data from RDBMS to HDFS.10. Working on Structure Query Language.11. Checking and validating Reports.12. Managing and provide the access to user in AD.13. Implemented Kerberos Security Authentication protocol for existing cluster using Active Directory.14. Ensured data integrity using ‘fsck’ and another Hadoop system admin tools for block corruption.15. Working in implementing Hadoop with the AWS EC2 system using a few instances in gathering and analyzing data log files.16. Configured various property files like core-site.xml, hdfs-site.xml, mapred-site.xml, hadoopenv.xml based upon the job requirement.17. Providing support and maintenance to autosys scheduler.18. Configure and document scripts for autosys jobs.19. Working with data delivery teams to setup new Hadoop users. This job includes setting up linux users, setting up kerberos principals and testing HDFS, hive.20. Monitor Solix connectivity and performance. Show less

• 

  Cloudera

  May 2022 - Jun 2024

  Senior Customer Operations Engineer

  1. Perform 3rd level administrator support for Nifi & Kafka infrastructure.2. Ensure support availability during agreed business hours.3. Ensure 24/7 support availability during the rotational service guard period.4. Responsible for maintaining the availability, performance and security of Nifi & Kafka infrastructure.5. Develop and maintain the automation for Nifi & Kafka infrastructure.6. Pro-active service improvement.7. Responsible for issue reporting and suggesting solutions to frequently occurring issues.8. Ensure knowledge sharing and documentations.9. Integrate with the team, supporting middleware technologies as needed.10. Participating in ad-hoc projects allocated by the Management and completing them within agreed timeframes.11. Compliance with internal regulations, procedures, law and managers orders, including labor regulations, regulations on remuneration and other internal regulations in the company, including company’s intellectual property protection.12. Behaviors and attitudes consistent with the values.13. Professional skills development by participation in training and constant self-education. Show less