Sahil Khelkar

Experience

• 

  HCLTech

  Feb 2022 - Jun 2022

  Analyst
• 

  Atos

  Sept 2022 - now

  Associate Consultant

  October 2022 to Present 2024Developed and implemented data pipelines on Azure using services like Azure Data Factory and Azure Databricks.Designed and maintained ETL➤ 2.6 years of experience in Azure Data Engineering using Azure Data Factory and Azure Data Bricks. ➤ Extract, Transform, and Load data from different source systems to Azure Data storage services using Azure Data Factory, Data Bricks, Pyspark, and Spark SQL.➤ Created various pipelines in ADF using the dataset, linked services, and activities.Skills:Azure Cloud: Azure Data Factory, Azure Data Bricks, Azure SQL, Azure Data Lake, Azure Key Vault.Programming: Python, SQL, and PysparkIn Project : :Optimized ADF Pipelines: Developed and implemented highly optimized Azure Data Factory (ADF) pipelines, resulting in a 20% reduction in execution time.- Data Transformation: Transformed Parquet files into Delta files, achieving a 30% reduction in storage requirements and a 50% reduction in processing time.- Logic Apps: Implemented efficient Logic Apps, reducing manual notification efforts and enabling real-time updates on job status.- Spark Applications: Engineered Spark applications within Databricks notebooks using PySpark and Spark SQL for data extraction, transformation, and aggregation, enabling efficient data analysis.- Incremental Load: Strategically employed Incremental Load methodology in ADF to seamlessly integrate new data files/records.- Centralized Logging: Implemented centralized logging within the pipeline, optimizing efficiency and enhancing monitoring capabilities.- Data Security: Created an Azure Key Vault to securely store connection strings and certificates, integrating it into ADF for linked services to ensure robust data security.Support and Agile Practices: Offered comprehensive support during the hypercare and support phases. Participated in daily stand-ups, story grooming, iteration planning, and retrospective meetings as part of an agile team. Show less