Niramay Roy

Niramay Roy

Followers of Niramay Roy463 followers
location of Niramay RoyMaharashtra, India

Connect with Niramay Roy to Send Message

Connect

Connect with Niramay Roy to Send Message

Connect
  • Timeline

  • About me

    Data Engineer

  • Education

    • Dr.D.Y Patil College of Engineering pune

      2016 - 2020
      Bachelor's degree Computer Engineering Higher second class

      Activities and Societies: National service scheme (NSS), Project Head of SWACHHABHIYAN in NSS.As a member of NSS, organise BLOOD DONATION CAMP.

  • Experience

    • Datametica Birds

      Sept 2021 - Jun 2024

      ● Successfully led the migration effort from Oracle to Google Cloud Platform (GCP) utilizing Informatica ETL tool, ensuring seamless and secure data transfer.● Utilized Informatica's advanced features, including data masking, data validation, and error handling, to guarantee the accuracy and integrity of migrated data during the transfer process.● Conducted thorough testing and validation of data integrity post-migration, performing reconciliation checks to verify that data in GCP accurately mirrored the source data in Oracle.● Designed and developed a robust framework using Django, enabling seamless integration and management of various components within the project.● Spearheaded the implementation of a custom rule engine, leveraging Django's extensible architecture, to automate the analysis of source and target files.● Engineered automated processes to extract, process, and compare data between source and target files, significantly reducing manual intervention and increasing efficiency.● Provided technical guidance and training to team members on using the Django framework and the implemented rule engine, ensuring a smooth transition and empowering them to make enhancements as needed. Show less ● Collaborated on ETL (Extract, Transform, Load) tasks, ensuring data integrity and validating pipeline stability.● Translated DataStage's Master Sequences and Parallel jobs for the implementation of data loading and transformation into Big Query. Scheduled processes using Cloud Composer (Dag).● Engineered intricate mappings, maplets, and workflows to address business requirements, emphasizing reusability to optimize efficiency and minimize duplication.● spearheaded the development and deployment of end-to-end ETL pipelines, orchestrating the transformation, migration, and loading of data from Netezza to Big Query, sourced from diverse business units.● Designed and executed sophisticated data mappings, orchestrating data movement from multiple origins into a unified target table within the data warehouse. Employed methodologies such as lookups, transformations, merge operations, CDC (change data capture), joins, and funneling in DataStage environments.● Expertly applied Slowly Changing Dimension (SCD) techniques within insurance applications.● Leveraged UC4 and Airflow Dags extensively for scheduling and monitoring. Show less

      • Engineer 1

        Apr 2023 - Jun 2024
      • Associate Software Engineer

        Sept 2021 - Apr 2023
    • Onix

      Apr 2024 - now
      Member of Technical Staff
  • Licenses & Certifications