Pratik Zaware

Experience

• 

  Persistent Systems

  Jun 2022 - Aug 2022

  Summer Intern
• 

  PubMatic

  Jan 2023 - now

  1. Working in Big Data and Analytics, which processes around 18 petabytes of new data daily.2. Working on data pipeline which processes end to end data, right from ingestion level, followed by aggregation and till report generation.3. Working on backend services consisting of MiddleWare (responsible for authentication, validation and routing), Data Api (for realtime reporting, responsible for fetching data from Snowflake) and PTP(for ondemand reporting, responsible for fetching data from HDFS using SparkSQL)Key Projects:-1. Supply Path Curation:- - New feature which provides ability to buyer so that they can have daily paid impression goal for each publisher they are working with. This helped buyers to spend their money intelligently. - This feature uses both real-time data(2 min level) and yesterday's data. Based on real-time data, adserver takes data driven decisions. - Implemented this feature right from ingestion layer till providing processed data to AdServer via rest endpoint which helps them for taking data driven decisions at realtime.2. Observium:- - One stop solution for observability, monitoring and stability of analytics platform. - Observium collects all the important data and display it on grafana dashboard in a collective manner. - Helpful in analyzing trends, spikes and failures in the platform. Helps to deal with situations like p1 and p2. - Wrote python script which collects job level details and spark level metrics which are really very important. - Developed single Grafana dashboard which displays all the details like job details, total storage, query cost, processing cost etc based on drop down selection of product. Worked on getting api(MiddleWare, Data Api) stats on Observium. Show less

  • Software Engineer Big Data and Analytics

    Jul 2023 - now

  • Software Engineer Intern, Big Data and Analytics

    Jan 2023 - Jun 2023