Niramay Roy

Experience

• 

  Datametica Birds

  Sept 2021 - Jun 2024

  ● Successfully led the migration effort from Oracle to Google Cloud Platform (GCP) utilizing Informatica ETL tool, ensuring seamless and secure data transfer.● Utilized Informatica's advanced features, including data masking, data validation, and error handling, to guarantee the accuracy and integrity of migrated data during the transfer process.● Conducted thorough testing and validation of data integrity post-migration, performing reconciliation checks to verify that data in GCP accurately mirrored the source data in Oracle.● Designed and developed a robust framework using Django, enabling seamless integration and management of various components within the project.● Spearheaded the implementation of a custom rule engine, leveraging Django's extensible architecture, to automate the analysis of source and target files.● Engineered automated processes to extract, process, and compare data between source and target files, significantly reducing manual intervention and increasing efficiency.● Provided technical guidance and training to team members on using the Django framework and the implemented rule engine, ensuring a smooth transition and empowering them to make enhancements as needed. Show less ● Collaborated on ETL (Extract, Transform, Load) tasks, ensuring data integrity and validating pipeline stability.● Translated DataStage's Master Sequences and Parallel jobs for the implementation of data loading and transformation into Big Query. Scheduled processes using Cloud Composer (Dag).● Engineered intricate mappings, maplets, and workflows to address business requirements, emphasizing reusability to optimize efficiency and minimize duplication.● spearheaded the development and deployment of end-to-end ETL pipelines, orchestrating the transformation, migration, and loading of data from Netezza to Big Query, sourced from diverse business units.● Designed and executed sophisticated data mappings, orchestrating data movement from multiple origins into a unified target table within the data warehouse. Employed methodologies such as lookups, transformations, merge operations, CDC (change data capture), joins, and funneling in DataStage environments.● Expertly applied Slowly Changing Dimension (SCD) techniques within insurance applications.● Leveraged UC4 and Airflow Dags extensively for scheduling and monitoring. Show less

  • Engineer 1

    Apr 2023 - Jun 2024

  • Associate Software Engineer

    Sept 2021 - Apr 2023
• 

  Onix

  Apr 2024 - now

  Member of Technical Staff