Shivani Sharma

Experience

• 

  Doordarshan Sahyadri

  Apr 2019 - May 2019

  Industrial Internship
• 

  Suven Consultants and Technology Pvt.Ltd.

  Jul 2020 - Aug 2020

  Web Development Coding Internship
• 

  Brillio

  Oct 2021 - Jul 2023

  ‣ Involved in planning, gathering, and analyzing requirements‣ Implemented and optimized a scalable ETL process for migrating Ascend streaming data to Snowflake production using Pyspark in Databricks across Bronze, Silver, and Gold notebooks resulting in a 40% increase in processing efficiency.‣ Streamlined the migration process by eliminating manual intervention through automating triggers and scheduling workflows to run at specific times, ensuring timely delivery of updated data.‣ Developed and documented complex PySpark logic, streamlining data processing by 30% for a drive wealth client.‣ Converted Ascend CAT report workflow into SQL code using DBT‣ Conducted thorough QA analysis on newly implemented SQL logic to ensure efficient performance‣ Setting up regular meeting cadence with stakeholders with specific agenda shared well in advance and sprint calls as per agile methodology Show less • Developed and executed a comprehensive data migration plan for an eBay client, resulting in the successful transfer of data from Oracle to SSMS within the allotted timeframe and budget.• Implemented ETL pipeline using Azure Data Factory, increasing the efficiency of the data migration process by 50% • Designed data models in lucid as per client requirements• Designed database schema (DDL), views, stored procedures, functions, packages, and triggers from Oracle to SSMS• Documented the logic of various procedures on the wiki so that the API team can capture the necessary use cases.• Worked and resolved various ad-hoc queries coming from API and UI team• Attended daily calls with on-site POC for requirement reviews and clarifications• Received recognition from eBay client for exceptional execution and timely delivery of project Show less

  • Senior Data Engineer

    Apr 2023 - Jul 2023

  • Data Engineer

    Jan 2022 - Mar 2023

  • Analytics Practitioner

    Oct 2021 - Dec 2021
• 

  Carleton University

  Oct 2023 - Mar 2024

  RFID Library Student Assistant
• 

  Transport Canada - Transports Canada

  Apr 2024 - now

  Data Engineer Intern