Avneesh Singh

Experience

• 

  Volkswagen India

  May 2021 - Feb 2022

  SDE-1(Data)
• 

  Phenom

  Feb 2022 - Jul 2023

  Data Engineer

  >>Designed and implemented robust data pipelines for clickstream and third-party data, enabling near-to real-time insights and informed decision-making.>>Driving the functions of importing/collecting, cleaning, converting, transforming, and analyzing the data to gather insights and make conclusions using Snowflake. Keeping track of trends, patterns, and correlations in case of complex data sets>>Building an ETL platform to show insight-based HR analytics and working on consuming live events data as a Big Data Engineer in the Analytics Team>>Developed Amazon-based WBRs and adoption benchmarks-based business intelligence dashboards for different product areas, to track the health status of the clients of Phenom Show less

• 

  InCred Financial Services

  Jul 2023 - now

  Data Engineer

  >>Efficiently sourced data from third-party LeadSquared CRM implemented hourly data pipelines with stringent data quality checks, managed metadata tables to ensure data integrity, and made data available for detailed analysis through fact and dimension tables in Metabase, enhancing decision- making capabilities.>>Leveraged AWS DMS to create efficient data pipelines and Delta tables in Databricks. These improved data accessibility, empowering other teams to make quicker, data-driven decisions, and positively impacting business agility>>Engineered a resilient data pipeline for ingesting loan lending data and third-party data seamlessly using Pyspark, SQL, Python, and Lambda functions, efficiently directing the consolidated data flow into Delta Tables. Show less