Mahaboob Sheik

Experience

• 

  Modak

  Apr 2021 - now

  Data Engineer

  • Managed and directed a team of 10 individuals to optimize product delivery timelines, resulting in a 20% increase in on-time project completions.• Designed Scalable big data pipelines using Hadoop, Spark, Scala and other distributed computing technologies to process 50+ Terabytes Monthly.• Improved query performance by 20% through analysis and optimization, enhancing data efficiency. • Developed GLAPI certified CI/CD pipelines for automated deployment using SonarQube, SEC API on Azure DevOps, leading to 30% faster deployment. • Orchestrated seamless data ingestion and storage across multiple sources into Azure Data Lake Storage (ADLS Gen 2) amplifying data accessibility by 30%.• Optimized GCP resources and implemented Storage Lifecycle Management, cutting GCP expenditures by over 10% annually, enhancing cost-efficiency.• Developed efficient data pipelines using Scala and Spark, cutting run time by 20%.• Performed root cause analysis on ETL process failures and introduced over 10 changes that decreased recurrence by 38%.• Created and deployed a fully automated CI/CD pipeline for StreamSets, slashing deployment time by 50% and facilitating the smooth migration of 40+ pipelines from Dev to QA with minimal downtime. Show less