Avinash Shetti

Experience

• 

  Accenture

  Aug 2022 - now

  Data Scientist

  • Collaborated with business and technical teams to grasp data requirements, contributing to the creation of technical documentation, including architecture diagrams and implementation roadmaps• Created scalable, reliable data ingestion and processing solutions utilizing various GCP, AWS services, and open-source tools (Python, PySpark, SQL)• Implemented ETL processes to extract the data from various sources (Google Analytics, Adobe Analytics) and transforming into structured format suitable for analysis• Designed and optimized data models in BigQuery for ingesting and storing transformed data, prioritizing query performance• Implemented robust data quality checks and monitoring processes, ensuring the integrity of critical datasets• Developed and maintained Airflow workflows to support data pipelines, emphasizing reliability, efficiency, and scalability• Monitored the performance of Airflow workflows, providing recommendations for optimization and improvements• Offered technical support for Airflow-related issues, demonstrating adept troubleshooting and problem resolution skills• Wrote comprehensive code documentation to enhance team understanding and collaboration• Regularly reported project status through concise daily/weekly email summaries, ensuring transparent communication on project tasks• Led data validation, UAT, and regression testing for new data asset creation for Google Analytics (GA4), ensuring data integrity and reliability• Utilized Power BI to create diverse dashboards by incorporating data from GCP BigQuery, PostgreSQL for data insights• Designed a log-based alerts mechanism on GCP, incorporating Cloud Logging and Monitoring, to proactively identify and address potential errors in all pipelines Show less