Talk to sales Try for Free
Madhurjya Das

Madhurjya Das

Software Engineer

Followers of Madhurjya Das530 followers
location of Madhurjya DasBengaluru, Karnataka, India

Connect with Madhurjya Das to Send Message

Connect

Connect with Madhurjya Das to Send Message

Connect

  • Timeline

  • About me

    Engineering @ Red Hat | Architecting robust, scalable Big Data and Machine Learning Systems

  • Education

    • KIIT - Kalinga Institute of Industrial Technology

      2016 - 2020
      Bachelor of Technology - BTech Computer Science & Engineering

    • Army Public School (APS)

      2014 - 2016
      Senior Secondary Science

  • Experience

    • Lavelle Networks

      Aug 2019 - May 2020
      Software Engineer

      Created an Automation Framework in both GoLang and Python, leveraging the REST-API of the SD-WAN controller (whether accessed through a web app or mobile app). This framework facilitates the configuration and testing of essential settings and inputs for Routers and Switches. It enables the QA team to perform System Integration Testing in an automated manner on the controller, allowing them to provide a predefined set of values as inputs without requiring real-time access to the controller.

    • Deloitte India

      Mar 2021 - Jul 2022
      Software Engineer

      * Spearheaded the migration of a Retail Stores Billing Application Analytics platform from GCP to AWS.* Significantly optimized ETL and ML workflows, reducing execution time from 40-30 minutes to 7-8 minutes with the implementation of near-real-time ETL streaming pipelines using AWS tech-stack (Lambda, Firehose, SQS, AWS Step Functions).* Played a pivotal role in developing and automating the complete Analytics Infrastructure, employing Infrastructure as Code (IAC) scripts with tools such as AWS Cloud Development Kit (AWS-CDK), TypeScript, and Python.* Contributed to the successful deployment of the monolith and ML pipelines on AWS, integrating CI/CD practices and version control to meet client requirements. Show less

    • Boston Consulting Group (BCG)

      Jul 2022 - May 2024
      Data Engineer

      * Engineered a dynamic pricing engine, leveraging market competitiveness insights to generate SKU-level regular prices.* Transformed manual workflow logic into a scalable workflow system using Big Data framework (Spark) reducing 3x execution outcome time also ensuring production readiness and scalability wrapping with robust orchestration using Airflow.* Led POC and seamless data transformation and forecast machine learning pipeline development of NPD pricing market share dataset, influencing pricing strategy decisions.* Developed IAC engine for scalable big data platform using Terraform and Python, establishing a robust foundation for future scalability.* Engineered complex configurations for deploying and setting up a Spark distributed cluster engine under Synapse Analytics hood, ensuring proper spark cpu & memory management to process high intensity data pipelines and machine learning models.* Implemented CI/CD for streamlined and automated deployment with AzureDevOps along with MLflow for underlying orchestration, empowering teams to focus on impactful tasks such as data-API ingestion codebase, Data pipelines, and Machine Learning model development. Show less

    • Red Hat

      Jun 2024 - now
      Senior Data Engineer

  • Licenses & Certifications

    • Amazon Web Services Cloud Practitioner

      Amazon Web Services (AWS)
      Feb 2022

    • EC-Council Certified Ethical Hacker

      EC-Council
      Jun 2019

  • Honors & Awards

    • Awarded to Madhurjya Das
      Red Hat - Go above and beyond Red Hat Apr 2025 Madhurjya Das was awarded the "Go Above and Beyond" recognition for his exceptional problem-solving abilities. He designed and implemented an automated Data Quality (DQ) framework at the staging layer, leveraging quantitative statistical modeling techniques such as data distribution checks, time series validation, correlation analysis, and anomaly detection. The framework proactively identifies and validates data issues, capturing 85% of faulty data before it propagates downstream and reducing… Show more Madhurjya Das was awarded the "Go Above and Beyond" recognition for his exceptional problem-solving abilities. He designed and implemented an automated Data Quality (DQ) framework at the staging layer, leveraging quantitative statistical modeling techniques such as data distribution checks, time series validation, correlation analysis, and anomaly detection. The framework proactively identifies and validates data issues, capturing 85% of faulty data before it propagates downstream and reducing manual intervention by 55%. Show less
    • Awarded to Madhurjya Das
      Deloitte - Dot of Fame Deloitte India Mar 2022 Madhurjya Das was awarded with the Dot of Fame recognition for Outstanding Contribution and Demonstrating the following values as :-Change & Innovation, Collaboration, Courage towards Client's extensive requirements for Developing and Deploying efficient and reliable ETL Infra over Cloud platform like AWS.