Minhaz Malek

Experience

• 

  Rysun Labs

  Jan 2019 - Sept 2022

  • Developed and deployed Java Spring boot APIs on Kubernetes using Azure DevOps, orchestrated CI/CD pipelines for streamlined updates, conducted performance testing, actively participated in code review sessions, and monitored code efficiency in the production environment to ensure optimal performance.• Designed, built, and maintained over 30 scalable data pipelines, automating data extract, transform, and load processes which resulted in a 40% reduction in manual data handling tasks.• Developed and maintained Python and Spark scripts for data manipulation and analysis, working extensively with large datasets to extract insights and improve data-driven decision-making processes.• Led a team of three junior engineers, providing technical assistance and comprehensive support to ensure high-quality project outcomes and effective problem resolution. Show less • Ingested 130 million rows of data from an Azure SQL database to a NoSQL Accumulo database using Spark, achieving a data transfer completion time of just 30 minutes.• Actively participated in the governance of data architecture, including tasks such as database performance tuning, implementing data security measures, and monitoring overall system uptime.• Demonstrated SQL expertise by optimizing schemas and indexes to improve performance by 50%, identifying duplicates through advanced queries, and creating custom stored procedures for business needs Show less • Collaborated with senior data engineers and data scientists, gaining insights into big data technologies and applications while actively participating in team discussions.• Implemented deduplication logic using both supervised and unsupervised machine learning techniques to perform fuzzy matching on customer data, effectively identifying and resolving duplicates within the dataset.• Designed and developed comprehensive data reports and visualizations that enabled stakeholders to grasp complex insights quickly Show less

  • Big Data Developer II

    May 2022 - Sept 2022

  • Big Data Developer I

    Jul 2019 - Jun 2022

  • Big Data Developer Intern

    Jan 2019 - Jun 2019