SIDHARTHAN AP

Experience

• 

  Infosys

  Jan 2021 - Jun 2023

  • Analyze, design and build Modern data solutions using Azure PaaS service to support visualization of data. Understand current Production state of application and determine the impact of new implementation on existing business processes.• Extract Transform and Load data from Sources Systems to Azure Data Storage services using a combination of Azure Data Factory, Spark SQL and Azure Data Lake Analytics . Data Ingestion to one or more Azure Services - (Azure Data Lake, Azure Storage, Azure SQL, Azure DW) and processing the data in In Azure Databricks.• Developed Spark applications using Pyspark and Spark-SQL for data extraction, transformation and aggregation from multiple file formats for analyzing & transforming the data to uncover insights into the customer usage patterns.• To meet specific business requirements wrote UDF’s in Scala and Pyspark.• Hands-on experience on developing SQL Scripts for automation purpose. Show less

  • Senior System Engineer

    Jan 2023 - Jun 2023

  • System Engineer

    Jan 2021 - Dec 2022
• 

  EY

  Jun 2023 - now

  Analyst