Sivaram Sundar

Sivaram Sundar

Followers of Sivaram Sundar1000 followers
location of Sivaram SundarIndia

Connect with Sivaram Sundar to Send Message

Connect

Connect with Sivaram Sundar to Send Message

Connect
  • Timeline

  • About me

    Data Engineer @Apple Ads via UnifyTech | Spark | Scala | SQL | Big Data | PySpark | AWS | Airflow | Kafka | REST API's

  • Education

    • Amrita Vishwa Vidyapeetham, Coimbatore

      2017 - 2021
      Bachelor of Technology - BTech Electrical, Electronics and Communications Engineering
    • Padma Seshadri Bala Bhavan Sr. Sec. School

      2002 - 2017
      Maths, Science, Computer Science
  • Experience

    • Cognizant

      Aug 2021 - Oct 2022
      • Programmer Analyst

        Aug 2022 - Oct 2022
      • Programmer Analyst Trainee

        Aug 2021 - Aug 2022
    • Unify Technologies

      Oct 2022 - now
      Software Development Engineer ( Data Engineer )

      ⬛ Client: Apple Inc⬛ Working as a Data Engineer in Apple Advertisements Platform Engineering Team➡️ Developed scalable and optimized data pipelines which deals with a data size of 3 TB+/day using Spark scheduled with Apache Airflow➡️ Built robust and reliable data pipelines on AWS using Apache Spark and transformed data based on various data quality check rules➡️ Developed Automation frameworks using Spark to automate Data Quality Checks in various data pipelines, created a DQC pipeline out of the DQC Automation framework using Jenkins CI/CD pipeline➡️ Extended the development of a Data Generation framework using Java, Docker, Kubernetes and shell scripts that push data to Kafka and AWS S3 in Avro format➡️ Developed Data quality Automation frameworks using Spark and Hive to automate the entire data validation process for data flowing through various data pipelines, hence eliminating all the manual data validation effort which resulted in huge time & cost saving ➡️ Worked on converting MapReduce Jobs scheduled on Oozie to Spark-Scala Jobs scheduled on Airflow ➡️ Optimized the data pipelines dealing with 3 TB+/day data by reducing the runtime by 30% ➡️ Worked on solving Complex Data Transformation Usecases and Data Cleaning using UDF's➡️ Was part of the complete software development life cycle, which includes development, testing and debugging➡️ Worked with cross functional teams and product teams for requirement gathering and analysis Show less

  • Licenses & Certifications

    • Career Edge

      TCS iON LifeLong Learning
      May 2020
    • Technology Infusion Grand Challenge Hackathon

      La Trobe University
      Jun 2020
    • HEAD

      Anokha (Amrita University Techfest)
      Feb 2020
    • Responsive Web Design: HTML5 + CSS3

      Udemy
      May 2021
    • Relational Database Design

      Udemy
      May 2021
    • JavaScript Basics for Beginners

      Udemy
      May 2021
    • Internet of Things - Workshop

      Lema Labs
      Dec 2018
    • MySQL

      Udemy
      May 2021
    • Volunteering

      National Service Scheme
      Feb 2018
    • Java Database Connection: JDBC and MySQL

      Udemy
      Jun 2021
    • Core Java

      Udemy
      Jun 2021
  • Honors & Awards

    • Awarded to Sivaram Sundar
      Head Lumiere, Anokha Feb 2020 Was given the post of HEAD for organizing, planning and managing an event in Anokha (College's national tech fest)
  • Volunteer Experience

    • Social Worker

      Issued by National Service Scheme
      National Service SchemeAssociated with Sivaram Sundar