Mirza Junaid Baig

Experience

• 

  Confidential

  Sept 2020 - now

  Big Data Engineer

  • Deployed Cloudera Enterprise across public, private, and hybrid cloud environments.• Streamlined data pipelines from S3 to HDFS and vice versa for secure data movement.• Optimized Hadoop cluster performance through proactive troubleshooting and tuning.• Implement Kerberos for secure authentication and access control.• Experienced in AWS Cloud services like EC2, EMR, S3, and managing IAM roles.• Successfully commissioned and decommissioned Hadoop cluster nodes.• Performed Proof of Concept for Confluent Kafka.• Configured LDAP, Sentry, Extended ACLs, and Posix Permissions for robust authorization.• Skilled in backup and disaster recovery with BDR/S3 backup, snapshots, and schedules.• Strong understanding of various Big Data technologies: Yarn, Hive, Flume, Sqoop, Sentry, Kafka, Spark, Impala, Streamsets, Hue, Kerberos • MIT Kerberos, KMS, Zookeeper.Passionate about learning and staying ahead of the curve in the ever-evolving Big Data landscape. Eager to contribute to a dynamic team and deliver innovative solutions. Show less