Vishwas Simha Samudrala

Experience

• 

  Chronos Infinity

  May 2017 - Jul 2017

  Intern
• 

  National Remote Sensing Centre

  May 2018 - Oct 2018

  Student Intern
• 

  Vdesiconnect

  Feb 2019 - Jan 2020

  Junior Big Data Developer

  • Assisted in the design and development of big data solutions using technologies like Hadoop, Spark, and Hive, contributing to the efficient processing of large-scale datasets.• Created and optimized HBase tables from Apache Hive, streamlining data retrieval and storage for faster and more reliable access to key business metrics.• Automated infrastructure provisioning using Terraform, improving development and testing environments by enabling seamless resource setup in AWS.• Migrated ETL jobs to Python scripts for enhanced data transformations, joins, and aggregations, improving processing efficiency and data handling capabilities in the Hadoop ecosystem.• Ingested large datasets from RDBMS into the Hadoop ecosystem using Sqoop, ensuring smooth data integration and enabling advanced analytics on the HDFS platform. Show less

• 

  Teesside University

  Jan 2021 - May 2021

  Research Intern

  • Led the development of a student induction app as part of a research group, integrating AI and ML features such as face detection and event recommendations to enhance user engagement.• Analyzed qualitative feedback data using Text Analysis Azure API and created data visualizations in PowerBI, providing actionable insights and improving the student onboarding experience.• Developed a cross-platform web application with a focus on user experience and data-driven recommendations, applying innovative Machine Learning techniques to improve service delivery. Show less

• 

  Centrica

  Jan 2022 - Aug 2022

  Data Engineer

  • Implemented Spark in AWS EMR for processing large-scale datasets, optimizing performance across the Data Lake and enabling advanced data analytics.• Developed ETL pipelines using HiveQL, and Spark, facilitating seamless data extraction, transformation, and loading from diverse data sources into Hadoop and AWS environments.• Automated infrastructure provisioning using Terraform, enhancing the consistency and reliability of the cloud environment by streamlining AWS resource management.• Designed and deployed AWS Lambda functions to automate the extraction and transformation of real-time data from Kinesis Firehose to S3, ensuring efficient data flow and storage.• Migrated and optimized ETL jobs for Amazon Redshift, reducing operational overhead and improving query performance for business intelligence reporting using tools like Tableau. Show less

• 

  Lloyds Banking Group

  Sept 2022 - Sept 2024

  Cloud Data Engineer

  • Designed and optimized data pipelines using Spark and Scala, significantly improving the performance of both batch and streaming applications, reducing processing times by 25%.• Enhanced data accessibility by integrating Google Cloud services like BigQuery and Cloud Spanner, implementing efficient partitioning and clustering strategies that supported high-throughput transactional workloads.• Led the automation of infrastructure provisioning using Terraform, streamlining cloud resource management and reducing manual intervention across GCP environments.• Improved data quality and visualization by enriching complex JSON data structures, enabling better insights through enhanced dashboards for the visualization team.• Played a key role in the CI/CD pipeline implementation with Jenkins and Spinnaker, ensuring smooth, reliable deployment processes and timely identification of bottlenecks. Show less