Pawan Rai

Experience

• 

  Elegance Solutions, Panipat

  Apr 2021 - Jul 2021

  Junior Web Developer
• 

  R.D Investment Consultants

  Jul 2021 - Aug 2021

  Social Media Marketing Manager
• 

  SprigHub

  Aug 2021 - now

  - Leveraged expertise in DevOps and Python ETL development to create efficient ETL workflows.- Proficient in Python programming and experienced with ETL tools such as Apache Airflow(MWAA), Glue, Athena, BigQuery, Pyspark.- Designed and implemented data pipelines, data transformation, and data validation.- Worked with a wide range of cloud infrastructure, containerization, automation, and monitoring tools, including Docker, AWS, and Terraform. - Played a key role in optimizing DevOps, infrastructure, and security processes.- Utilized Amazon Relational Database Service (RDS) and a variety of other tools.- Collaborated on code review, PySpark, Apache Spark, and Apache Airflow projects.- Managed AWS services, including MWAA, EC2, S3, and IAM.- Demonstrated strong problem-solving skills and automation abilities. - Gained hands-on experience with Amazon RDS.- Assisted in data architecture, modelling, and ETL processes.- Create Webhooks for pipeline notifications and system alerts to MS teams and Mail.- Automation with Selenium.- Python Automations Scripts for Keeping track of Airflow Scheduler health checks and Restarts.

  • Data Engineer

    Feb 2023 - now

  • DevOps Engineer

    Dec 2021 - Feb 2023

  • Data Science Intern

    Aug 2021 - Jan 2022