Shubham Raj

Experience

• 

  Tata Consultancy Services

  Nov 2020 - Sept 2024

  System Engineer

  Lloyd's Banking GroupData Engineer - Aug 2022 - presentEmbarked on developing patterns using dbt tool with BigQuery to optimize and streamline the ETL workflow, enhancing efficiencyand accuracy in data processing.Worked on design, creation, testing, and maintenance of comprehensive data management systems, ensuring seamlessfunctionality across the board.Collaborated closely with stakeholders and solution architects to engineer highly scalable and resilient systems, optimizing dataprocessing workflows.Executed end-to-end ETL processes, guaranteeing efficient data flow and integrity within the ecosystem.Implemented agile methodologies, fostering iterative development cycles and enhancing collaboration between cross-functionalteams.Orchestrated Change and Incident management protocols, swiftly resolving issues to minimize operational disruptions.Streamlined data import/export operations into HDFS and Hive, ensuring smooth data management within the environment.Leveraged expertise in big data technologies and frameworks to extract actionable insights from vast datasets.Implemented DevOps practices to automate deployment processes, ensuring scalability and reliability of big data solutions.Automated report generation and precise visualization using Excel and Tableau, reducing processing time from one hour to just 5-10 minutes.Datastage Developer - Nov 2020 - July 2022Engineered ETL pipelines integrating diverse data sources, ensuring seamless flow and integrity, using DataStage, UNIX, and SQL.Led end-to-end project lifecycle, navigating challenges like Covid, while ensuring rigorous testing, implementation, and stakeholder coordination.Developed efficient Unix scripts for data preprocessing and orchestrated transfers using Connect Direct, streamlining data handling.Mentored team for testing excellence, managed incidents, change requests, and problem records using ServiceNow, meeting SLAsand KPIs. Show less

• 

  Deloitte

  Nov 2024 - now

  Data Analyst