Experience

• 

  Cosmos data.

  Jun 2017 - May 2020

  Sql/etl developer

  • Contributed to design complex T-SQL code such as Stored Procedures, functions, triggers, Indexes and views for the application. Optimized queries by analyzing different query options and indexing strategies.• Executed T-SQL Scripts to validate the data after the loading process. Modified and tested T-SQL stored procedures.• Designed, developed, and tested the SSIS Packages to populate data from multiple source systems using Data Modeling principles such as star schema and snowflake schema.• Formulated various SSIS packages for data movements and transformations and provided deployment files to DBA.• Participated in the development of Data Mapping, Performance Tuning and Identifying Bottlenecks of sources, mappings, targets, and sessions.• Designed SSRS and Power BI reports for in depth business analyses and delivered on-demand reports in multiple rendering formats.• Applied several DAX functions for various fact calculations for efficient data visualization in Power BI.• Utilized Power BI gateway to keep dashboards and reports up to-date with on premise data sources. Show less

• 

  Epam systems

  Jun 2020 - Dec 2022

  Azure data engineer

  • Involved in Technical decisions for Business requirement, Interaction with Users, Development Team.• Developed the T-SQL stored procedures/functions/views, CTEs, indexed views, stage tables to process the data and populate them in the appropriate destination tables. • Designed and developed various SSIS packages (ETL) to extract and transform data and involved/Scheduled in Scheduling SSIS Packages.• Supported, maintained and troubleshooted existing SSIS Packages which are used Data Warehouse loading. • Highly experienced in SQL Server Integration Services Components such as Control flow (Data Flow, Execute SQL, Expression, File System, Script and For Loop Container, Foreach Loop Container, Sequence Container). • Implemented SSIS Packages Performance tuning and supported, developed ETL solutions for integrating data from multiple sources like Flat Files (delimited, fixed width), Excel, SQL Server, SharePoint Lists into OLAP Database.• Implemented Data Cleansing, Incremental Data Loading, Logging, Event Handling and Error Handling. • Performed SSIS Development and support, developed ETL solutions for integrating data from multiple sources like Flat Files (delimited, fixed width), Excel, SQL Server, into the data warehouse.• Built efficient SSIS packages for processing Fact and Dimension tables with complex transforms and type 1/ type 2 changes. • Build ETL and ETL pipelines to gather data from FTP Servers, API and SQL Server to store data in Azure Data Lake;• Migrated on-prem development into Microsoft Azure using Azure SQL PAAS (Platform as a service), ADF, Azure Database Migration Assistant;• Built and automated processes using Azure PowerShell;• Extensive experience in working with Azure Blob Storage and Azure Data Lake Storage Gen2;• Implemented Incremental loads using Change Data Capture and Watermark Tables using Azure Data Factory v2.• Developed parametrized Azure Data Factory (ADF) pipelines, linked servers, datasets and data flow activities Show less

• 

  Flight centre travel group

  Jan 2023 - Apr 2024

  Azure data engineer

  • Developed cloud-based data processing pipelines using Azure, handling tasks from content reception to data transformation and target delivery;• Collaborated with infrastructure and Azure DevOps teams to ensure optimal performance of databases, storage, and compute resources;• Identified and proposed solutions to barriers affecting data processing performance and capabilities;• Led the design and implementation of scalable ETL solutions using ADF and Dataflows to process terabytes of data daily;• Developed over 10 of data pipelines, integrating data from various sources including Blob Storage, Cosmos DB, and SQL Databases;• Optimized existing ETL processes using Dataflows, resulting in a 75 % reduction in runtime and a 30 % cost saving on Azure resources;• Collaborated with the data science team to prepare data for analytics, ensuring consistent and reliable data sources;• Managed data wrangling and transformation tasks in Azure Dataflows, including data cleaning, normalization, and aggregation;• Assisted the technical documentation team in preparing necessary materials;• Engaged in Agile team activities including standups, planning sessions, and retrospectives;• Upheld security standards and ensured secure database coding in line with best practices;• Provided troubleshooting support, identified root causes of issues, and conducted training sessions for staff members on problem resolutions;• Performed other related duties as assigned periodically. Show less