Vikram T

Experience

• 

  Quadratix

  Jun 2019 - Jul 2021

  Data Engineer

  • Used Hadoop, AWS Glue, and Lambda to improve ETL operations, enhancing data quality and reliability by 15%.• Developed and maintained strong ETL pipelines on AWS Glue, orchestrating data ingestion into Amazon Redshift and usingHadoop for distributed processing to ensure optimal performance.• Spearheaded ETL processes with AWS Redshift Spectrum and Hadoop, cutting down processing time for large datasets by 30%.• Led schema design and optimization for Redshift clusters, significantly improving query performance by 40% through carefulindexing and distribution key selection.• Improved SQL queries and data transformation with Hadoop, achieving a 25% reduction in latency and a noticeable boost in queryresponsiveness.• Enhanced user experience and insight generation by implementing DynamoDB indexing and performance profiling for AmazonRDS, with Hadoop backing distributed processing.• Proactively monitored data pipelines with AWS CloudWatch and AWS X-Ray, quickly resolving issues and improving dataoperations efficiency by 20%, thanks to Hadoop’s integration. Show less

• 

  Hallmark Cards

  Jun 2022 - now

  Data Engineer

  • Streamlined data extraction and analysis using Python and Azure SQL, cutting down processing time by 40% —that’s about 1 terabyte of data processed in half the usual time.• Built and improved ETL pipelines with Azure Data Factory, PySpark, and Airflow, which reduced resource consumption by 30% and handled enterprise-level datasets of up to 10 million records per hour.• Designed a Power BI dashboard for monitoring Data Lake and Data Platform, leading to a 30% drop in platform failures and resource use.• Strengthened code security in Azure DevOps, Bash, Python, and GitHub by integrating Azure Security Center and Advisor, which reduced code vulnerabilities by 20% and improved CI/CD processes.• Cut incident response times by 15% with Azure Monitor and Notification Hubs, ensuring vigilant monitoring of data pipelines.•system reliability by 40% and reduced incident frequency by 20% through optimized data loading and processing with Azure Synapse Analytics.• Applied Agile methodologies (Scrum) to streamline project delivery, shortening project timelines by 30% and boosting customer satisfaction by 40%. Show less