Sateesh Teppala

Experience

• 

  IBM

  Jan 2022 - now

  Data Engineer

  Working in the Cognitive Marketing Data Platform (CMDP). CMDP serves as the source for all levels of marketing data: the individual, the company, and the linkage between them. It is the single global source for data that will improve data-driven marketing processes. Database The strategists/analytics team uses CMDP for segmentation and targeting and a deep dive on campaign performance for reporting root cause analysis for marketing activities.✅ Transitioned from legacy DataStage jobs to Apache Spark, using a proprietary ETL-Framework built with Spark 3.0.1 and Scala 2.12, resulting in a 60% improvement in data processing scalability and performance.✅ Architected real-time cloud monitoring dashboards using Python and DB2 for comprehensive job performance analysis.✅ Implemented CI/CD pipeline and orchestrated Spark job deployments on Kubernetes using spark-operator.✅ Developed a resilient data engine using Trino, Hive Metastore, PostgreSQL, and Cloud Object Storage, creating Hive tables with Parquet files for uninterrupted data accessibility.✅ Administered and scaled Kubernetes clusters, monitoring resource utilization and optimizing performance through custom Grafana and Prometheus dashboards.✅ Engineered an optimized Data Retention application to manage available data effectively, ensuring compliance with industry standards.✅ Developed a tool to standardize columns from various data sources, streamlining data integration processes.✅ Led migration from a legacy Java RESTful API to Python FastAPI framework, resulting in a 75% increase in data delivery speed to Cognos dashboards.✅ Worked with big data technologies including Apache Spark, PySpark, Trino, and ETL/ELT processes.✅ Utilized cloud technologies such as IBM Cloud and Cloud Object Storage for data engineering tasks.✅ Worked with databases like IBM Db2, Postgres, and utilized data visualization tools like Apache Superset. Show less