Vishal Pal

Experience

• 

  LTIMindtree

  Jun 2022 - now

  Senior Data Engineer

  - Optimized BigQuery cost and performance by leveraging partitioning and clustering. - Used Python with Airflow DAGs to create data migration pipelines. - Assured data quality and optimized data collection processes.- Good understanding of Apache Beam and Dataflow to implement data pipelines.- Optimized Data Fusion pipelines to improve data throughput.- Implemented data quality checks in pipelines which reduces errors and enhances reliability.- Built Data Pipelines for diverse sources and destinations (RDBMS, API, Files and EDW).- Collaborated effeciently with cross-functional teams for seamless data transfer to google cloud maintaining strong inter-team communication.- Completed Data transfer projects ahead of schedule, ensuring minimal downtime and maximum data availability.- Demonstrated expertise in improving cloud-based data delivery, data processing processes and overall efficiency. Show less