Experience

• 

  Circles.life

  Jul 2023 - now

  Data engineer intern

  Designed and implemented scalable ETL pipelines for data integration across Oracle, MySQL, Snowflake, and MongoDB.Extracted files from S3 buckets and seamlessly loaded them into target tables, enabling efficient cloud-based workflows.Ensured data quality by validating freshness and correctness.Automated Hive bucketing processes and optimized query performance.Managed real-time and batch data ingestion pipelines using Apache Kafka and Airflow, ensuring reliable data workflows.Proficiently utilized PySpark for distributed data processing and transformations.Collaborated with stakeholders to deliver data solutions aligned with evolving business needs.Worked with SFTP servers for secure file transfers, maintaining data integrity. Show less