Jayadeep Tummala

Experience

• 

  Tata Consultancy Services

  Nov 2021 - Mar 2023

  • Worked in Banking domain with client American Express.• Maintained high-performing data pipeline in both real time and batch jobs in production.• Performed source system analysis, data profiling and design mapping logic between source system and destination.• Worked in ingesting the data into the tables by ensuring the data quality as a top priority and following data dependencies in production.• Written queries in Hive and ingested the data into tables using Putty.• Created and maintained knowledge data bases with Cornerstone.• Ensured business logic for rules for the variables is working as per design.• Focused on permanent resolution and RCA in case of production failures with help of audit logs and coordination with stakeholders.• Responsible for 100% of data quality across product verticals and related business areas. Show less

  • Big Data Engineer

    Mar 2022 - Mar 2023

  • Software Engineer Intern

    Nov 2021 - Feb 2022
• 

  Tata Consultancy Services

  Apr 2024 - now

  Data Engineer

  • Working in an Insurance domain with client Nationwide• Designing and implementing scalable data pipelines in Databricks, SQL Data Warehouse, and Delta Lake for optimized data storage and processing.• Developing and optimizing ETL workflows in Databricks, leveraging Py Spark and Delta Lake to process and analyze large-scale datasets efficiently.• Implemented Delta Lake for efficient data storage, enabling real-time analytics and enhanced data governance.• Optimized SQL queries and Spark jobs, reducing processing time by 40%.• Automated data workflows, reducing manual efforts by 60%. Show less