Subhra Kundu

Experience

• 

  Tata Metaliks Ltd

  Jun 2018 - Jul 2018

  Graduate Engineering Trainee

  Compute a chart to depict the trends of chemical composition(determined by an optical spectrometer ) of the coal procured from different mines .

• 

  Indian Oil Corporation Limited

  Dec 2019 - Jan 2020

  Industrial Trainee

  Worked in the Hydrogen Generation Unit (HGU) - studied appropriate flow parameters for production of approximately 99.99% pure Hydrogen

• 

  Reliance Industries Limited

  Jul 2020 - Jun 2021

  Summer Intern

  Estimation of COP (Coefficient of Performance) for a refrigeration compressor

• 

  Polestar Solutions & Services

  Jun 2021 - Dec 2024

   Performed concurrent and incremental data ingestion from multiple APIsources through asyncio/threadpoolexecutor into Azure Blob Storagethrough Async Durable Functions reducing load time by around 80% Developed efficient masked datasets for Gen AI models Determined the size of the spark cluster and the number of executor & coresrequired according to the velocity and volume of data being ingested. Integrated data into medallion architecture in Delta Lake through optimizeddatabricks notebooks and created logic app flows to monitor pipelinefailures Created several orchestration pipelines to schedule, monitor and track theentire data lifecycle in ADF. Successfully migrated from all purpose clusters to job clusters to runproduction ready workflows and optimize costs. Developed multiple Logical Data models and Excel Simulation working filesto show-case several KPIs and metrics which helped the business to reduceits delinquent tenants and keep an effective track of its vacant inventory Integrated Azure Key Vault into ADF and ADB using system assignedManaged Identities for data security. Developed Business logic transformations using Pyspark and SQL. Developed complex DAX logic to support BI analytics Optimized the data ingestion process to provide analytics using around ~ 1Lakh XML POS files in near real time Provided an entire architecture to monitor and send alerts for incorrectlygenerated POS files to ensure data consistency through logic apps Show less

  • Senior Analyst

    Jul 2022 - Dec 2024

  • Analyst

    Jun 2021 - Jun 2022
• 

  MongoDB

  Jan 2025 - now

  Data Architect