Kalyan Chatterjee

Experience

• 

  Flaktgroup India Pvt ltd

  Aug 2020 - Feb 2022

  Graduate Engineer Trainee- Analytics
• 

  NeenOpal Inc.

  Sept 2022 - May 2024

  Data Engineer

  Snowflake Warehouse Management, ETL Implementation, and Automated BI Reporting : Implemented an ELT pipeline for a solar company, centralizing data from Oracle, Horizon, Salesforce, Five9, and SharePoint into Snowflake. Created data models, applied SCD 4, and developed over 10 Tableau dashboards. Ensured data quality and optimized ETL processes for better performance through SQL query optimization and materialized views.Single Source of Truth Implementation and Automated Visualization Pipeline: Consolidated data from Google Analytics, HubSpot, Recurly, and AWS S3 into AWS Redshift using Fivetran. Developed SQL queries for Tableau visualizations, automated data processes, and set up Lambda functions and SNS for monitoring and alerts, enhancing data accuracy and Redshift performance.AWS S3 Email Alert System: Developed a Python-based AWS S3 monitoring system for a retail company, using Boto3 to track uploads and AWS SNS and Lambda for email alerts. This system enhanced file management efficiency and team communication by monitoring uploads and sending alerts for missed uploads or anomalies. Show less

• 

  EXL

  May 2024 - now

  Data Engineer

  Python-Based ETL Setup and Automation for a Product based Startup: Automated Python-based ETL pipelines to extract, transform, and load data from APIs into an RDS MySQL database. Used Requests for data extraction, Pandas for transformation, and SQLAlchemy for database connection. Scheduled the ETL pipeline with Cron, including error handling and logging, to support efficient, data-driven decision-making.