ANKIT RAJ

Experience

• 

  Cognizant

  Sept 2021 - now

  • Worked on an application to load SCD Type 2 data from Azure Blob Storage daily.• Transformed and loaded data to successive layers through Databricks jobs using Azure Data Factory• Orchestrated the process using Azure Data Factory• Loaded the data into Azure Synapse Analytics• Developed notebooks for creating intermediate snapshot Delta tables for analytical purposes• Worked on enhancements like DDL changes in tables. Implemented changes in multiple layers. Changed column values using utilities• Created pipelines and deployed changes (Databricks and DDL changes) into Git in Azure DevOps• Developed a utility based on pattern matching• Accepted multiple arguments like source dataframe, schema name, table name, matching columns• Returned a single target dataframe with an extra derived column based on pattern matching Show less • Design, development and implementation of performant ETL pipelines using python API (PySpark) of Apache Spark on Databricks• Integration of data storage solutions in spark – especially with AWS S3 object storage. • Performance tuning of PySpark scripts.• Build the infrastructure required for optimal extraction, transformation, and loading (ETL) of data from a wide variety of data sources like SAP Hana, MySQL and other data sources.• Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics. • Building Reusable Data ingestion and Data transformation frameworks using PySpark. Show less

  • Programming Analyst

    Sept 2022 - now

  • Programmer Analyst Trainee

    Sept 2021 - Oct 2022