Deepika S

Deepika S

System Engineer

Followers of Deepika S361 followers
location of Deepika SBengaluru, Karnataka, India

Connect with Deepika S to Send Message

Connect

Connect with Deepika S to Send Message

Connect
  • Timeline

  • About me

    Data Engineer | Building Scalable Data Solutions & Pipelines | Transforming Data into Insights | Azure Cloud, Databricks, PySpark, and Data Analysis

  • Education

    • Dr. Ambedkar Institute Of Technology

      2013 - 2017
      Bachelor of Engineering (B.E.) Telecommunications Engineering
  • Experience

    • Tata Consultancy Services

      Sept 2017 - Nov 2021
      System Engineer

      Big Data Developer / Data Analyst Project: Adobe -Worked as a Data Analyst for Social Media Campaigns making sure we have standard naming convention for campaigns/ads across all marketing channels so that the business can track the spend and make decisions accordingly on investments and target audience.-This was achieved through Requirement gathering, Data Analysis and cleaning using Hive and also automating e-mail reports for future data validation so that the strategists can refer and correct the incorrect naming.- Worked as Hive developer for e-mail marketing campaigns for EMEA and Worldwide on Commercial and Operational emails wrt Adobe Creative Cloud and Document Cloud by analyzing the requirements, writing code in HQL for different selections and suppression criteria and sharing data with e-mail team to batch and blast the e-mails.-Also, worked in enhancement of Media team’s dashboards for tracking impressions from Demand Side Platform (DSP) and Flash Talking (FT) and also checking the creative/placement naming convention. Project: Dicks Sporting Goods -Configured monitoring alerts using AppDynamics for various transactions in website and Integrated alerts from monitoring tools like AppDynamics to a communication tool like Microsoft Teams.- Taken care of Data load (overnight site refresh) in Prod environment and admin activities - different phases of deployment like server restarts, traffic shift while coordinating with multiple teams whenever code changes are to be made in Prod environment.-Worked on critical emergency business requests on production site and sent out numerous Business Communication, Incident creations, escalations to proper personnel during critical issues Show less

    • Cognizant

      Nov 2021 - Sept 2023
      Big Data Developer and Analyst

      Project: American Express- Migration of Late Stage Collection business reports from Teradata (TD) to BigData using Hive/Pyspark and Unix Shell Scripting which helped cut down the overall cost by 10-15%- Performance tuning of the migrated code which reduced the processing time from 18-20 hrs per report in TD to 0.75-1.5hrs per report in BigData-Code optimisation by automating redundancy business calculations for multiple reports there by reducing the no of hits on underlying tables, decreasing SQL server storage by ~2TB and also leading to decommissioning of the dedicated server for our processes.- Data analysis for each report to achieve 95-100% match rate wrt TD by coordinating with business folks.-Also worked on sqooping the data from BigData to SQL server to build business reports, deployed multiple codes in production using GIT, XLRs Show less

    • Fractal

      Sept 2023 - now
      Data Engineer

      Project : AB-InBev -> Post-launch Performance of New Innovations - Designed and built datasets to capture buying patterns at store levels, enabling country-wise analysis for data-driven decisions on new product innovations (brand, size, packaging) to maximize profitability.- Built automated data pipelines to ingest, clean, and transform raw data into KPI-specific tables following the medallion architecture.- Designed transformations to derive key metrics (NR, GTO, MACO, etc.) for detailed insights at product, customer, and market levels, serving as a foundation for various data science models.- Automated Delta table refreshes based on business needs, creating a unique repository of insights critical for assessing the success of new innovations and enabling data-driven decisions on whether to scale, adjust, or discontinue an innovation. Project : AB-InBev -> Building generic DE framework- Designed a generic framework in Azure Databricks to support multiple domains and capabilities in logistics, enabling seamless connectivity to various data sources.- Refactored existing code using PySpark/Python to align with Databricks’ medallion architecture and implemented reusable data validation modules with business-specific rule checks.- Built an orchestration flow in Azure Data Factory with a robust logging backbone and automated data extraction plugins for future scalability across domains.- Configured Logic Apps to generate automated alerts and deliver run summaries via email. Show less

  • Licenses & Certifications

    • BSNL Certification in WIRELESS COMMUNICATIONS

      BSNL Telecom Factory