Prashant Singh

Experience

• 

  Voith Group

  Jan 2016 - Jan 2023

  Deputy Manager

  Deputy Manager at Voith with over 7 years’ of total IT experience with strong technical skill in Data Engineering and cloud computing . During my time at Voith:- Provided data engineering expertise to multiple clients across various industries.Played a key role in migrating on-premises data infrastructure to cloud-based solutionsDesigned and optimized data architectures to handle complex data workflows and ensure scalability.

• 

  Adidas

  Jan 2023 - now

  • Developed creative solutions to build a streaming pipeline to read over 300 attributes from Kafka topics with no set schema registry.• Ingested over 1,000 Kafka messages/second in Delta Tables and enabled 150+ derived KPIs and attributes for any order placed within 2 minutes, thus offering critical insights during high value campaigns like Black Friday and 11/11.• Created Delta Live Tables with over 50 business appropriate data quality checks, enabling easy pipeline maintenance.• Built highly optimized Spark Streaming pipelines enabling near-Realtime updates to eCom Orders and Shipments for all markets.• Built a quick and intuitive solution to switch between near-Realtime, hourly and daily data availability to save over 90% in compute cost during non-critical time periods over the year.• Designed highly optimized pipelines using optimal join strategies, logical partitioning, and Z-Ordering to deliver Invoice data on an hourly basis, thus helping the team save over $1,000/month.• Optimized existing pipelines reducing runtime by over 80% and storage required by over 50%, thus saving the team over $10,000/month and over 200 operational hours/week.• Designed and developed incremental reprocessing pipelines ensuring minimal downstream impact to existing processes.• Inculcated best engineering practices within the team and provided trainings on Git concepts such as merge strategies, squashing commits, and cherry picking.• Conducted trainings in India and Singapore offices to help onboard market teams onto the new datasets Show less

  • Databricks Certified Data Engineer at Adidas

    Jan 2023 - now

  • Data Engineer

    Jan 2023 - now

  • Data Engineer

    Jan 2023 - now