Experience

• 

  Tata consultancy services

  Mar 2016 - Sept 2021

  It analyst

  1. Streamlined ETL processes in Azure Data Factory, resulting in a 30% reduction in data processing time.2. Integrated data from diverse sources such as Azure Blob Storage, Azure SQL Database, and on-premises databases into Azure Data Factory.3. Implemented robust data validation processes, resulting in an 80% reduction in data errors and achieving a data accuracy rate of 90%.4. Conducted data analysis from diverse legacy sources and devised an ETL process to migrate data from mainframe DB2 to SQL Server, incorporating necessary transformations. This initiative yielded annual cost savings of $50,000.5. Collaborated closely with stakeholders to gather requirements and ensured projects met their needs and expectations resulting in a 100% satisfaction rate among stakeholders. Show less

• 

  Mathco

  May 2022 - now

  Data and machine learning engineer

  1. Designed and implemented a Medallion architecture using Azure services for a large-scale CPG client by effectively decoupling Data Engineering, Machine Learning and Business use cases.2. Utilized Azure Databricks, Spark, SQL, Airflow, and Python to optimize and automate end-to-end pipelines, while implementing an MLOps framework and leveraging features such as Delta tables and Unity Catalog. This resulted in a significant 60% reduction in costs.3. Applied advanced Spark optimization techniques, leading to a significant reduction in runtime by 70%.4. Led a team of 3 people to develop and execute strategic changes in the data pipelines, incorporating new business needs for the client, resulting in a substantial increase in incremental sales by $1.2 million.5. Developed a comprehensive model monitoring framework, increasing model performance by 25% and created a Lakeview dashboard in Databricks to visualize key metrics, enhancing data-driven decision-making processes.6. Collaborated with cross-functional teams, including marketing and sales, to develop data-driven strategies that aligned with business objectives resulting in a 15% increase in overall revenue. Show less