Experience

• 

  Zs

  Sept 2022 - now

  Business technology solutions associate

  1. Worked on end-to-end development of data products, capturing key metrics for stakeholders for their business decisions based on medallion architecture. This involved requirements gathering, data discovery, creation of business documents (Data Dictionary, Data Model & STTM), development of scripts & data pipelines, conducting unit tests & documenting them, migration to higher environments (QA and Production) and reconciling the final outputs with requirements.2. Designed and Implemented Enterprise Grade data products by integrating diverse data sources using Azure services such as Databricks, Data Lake Storage, Data Factory and SQL Database. 3. Developed Backend data pipelines using Azure Data Factory that are fully parameterized to dynamically pass values during runtime, ensuring both the security of sensitive information and enhanced pipeline reusability.4. Worked on the adoption of GIT for the streamlined creation of data products, resulting in about a 40% reduction in release time and significantly less rework.5. Created data ingestion and transformation notebooks using Databricks for generating the reporting tables using PySpark and SparkSQL.6. Implemented validation processes on final data outputs using Databricks, ensuring they align with business requirements and standards before loading to the publish layer.7. Worked on optimizing 35+ SQL queries by selecting the required columns and removing the unnecessary joins. This reduced the execution time by 30%.8. Acted as POC for any data related issues and enhancements by clients. Also, handled multiple ad hoc requests from clients. 9. Implemented audit flows within data pipelines for populating audit tables with pipeline details using Azure Data Factory (ADF), Azure SQL Database and Databricks. This provided valuable insights into the performance of all the ADF pipelines.10. Recognized as top project performer from clients and internal management for delivering exceptional results. Show less