PRAVIN NICHIT

Experience

• 

  Tata Consultancy Services

  Dec 2021 - now

  Data Engineer

  - Designed and implemented robust data pipelines using Python and GCP services, including Cloud Data flow and Pub/Sub, to support batch and real-time data processing, handling over 10 TB of data daily.- Developed and integrated diverse data sources into the GCP Data Lake, leveraging BigQuery for large-scale data analysis and extracting actionable insights to drive strategic business decisions.- Optimized BigQuery performance through advanced techniques including partitioning, clustering, and query optimization,resulting in a 25% cost reduction and a 40% improvement in query speed.- Orchestrated workflows with Apache Airflow (Cloud Composer) for scheduling and monitoring DAGs and data pipelines,ensuring timely and reliable data processing.- Implemented serverless, event-driven processing with Google Cloud Functions, enhancing scalability and operational efficiency.- Managed Extract, Load, Transform (ELT) processes using Qlik Replicate, ensuring seamless data integration and data accuracy across platforms.- Proficient in data modeling and warehousing concepts, applying ELT best practices to ensure data reliability.- Collaborated cross-functionally with stakeholders and data scientists to deliver effective data solutions aligned with business objectives.- Utilized GitLab for version control and GitLab CI for continuous integration and deployment, ensuring efficient code management.- Documented Agile workflows and project details using JIRA and Confluence, facilitating effective team collaboration and project management. Show less