Siddharth Mishra

Experience

• 

  Indian Rare Earth Limited

  Apr 2018 - Apr 2018

  Vocational trainee
• 

  National Aluminium Company Limited - NALCO

  May 2018 - May 2018

  Vocational trainee
• 

  Tata Consultancy Services

  Mar 2021 - now

  Data Engineer :Financial Model Deployment:- Utilized Spark-SQL to accelerate the generation of CVS scores and profitability processes by 60-70%.- Implemented Spark architecture for efficient calculation of profit components such as net interest income, costs, and fees.- Leveraged Scala scripts to trigger Spark events, optimizing parallel execution for faster results.- Stored outcomes in a tabular format in Hive for streamlined data organization.CI-CD Nudge Deployment:- Developed a comprehensive validation, parsing, and database operation framework in Python 3, resulting in an 85%-90% reduction in the time required for deploying nudges. This innovation enabled independent and significantly faster nudge deployment, streamlining processes for enhanced efficiency and optimization.- Designed the framework in a highly modular manner, allowing effortless incorporation of new validation checks, logic, or events with minimal adjustments. This flexibility ensured adaptability to evolving project requirements and simplified the integration of new functionalities, contributing to a scalable and future-proof solution.- Implemented rigorous validation processes to scrutinize input files, ensuring data integrity and adherence to predefined standards. (There were 23 validation checkpoints.)- Developed parsing algorithms to extract and filter metadata from input files and created metadata files containing parsed information, facilitating structured data storage and retrieval.- Implemented seamless integration with MySQL database, enabling automated insertion of extracted metadata for easy accessibility and analysis.- Automated the generation of zipped artifacts, comprising original input files and parsed metadata, enhancing data portability and organization.- Orchestrated the entire process using Jenkins for seamless automation. Show less

  • System Engineer

    Oct 2022 - now

  • Assistant System Engineer

    Mar 2022 - Sept 2022

  • Assistant System Engineer- Trainee

    Mar 2021 - Feb 2022