Preetam B A

Experience

• 

  JSW Steel

  Dec 2019 - Jan 2020

  Intern

  1. Developed a Web Application using Java Servlets and Oracle Database for Safety and Training Department to manage all the records related to Safety Training.2. Significantly reduced the efforts of maintaining, searching and updating the details of training by taking it into a database based solution.

• 

  LTI - Larsen & Toubro Infotech

  Jun 2021 - Sept 2023

  1.Developed APIs using Azure Function App with a response time overhead of less than 10%.2. Integrated a tensorflow based Machine Learning model into the API improving its efficiency by around 20%.3. Designed ETL workflows using Azure Data Factory and Databricks, ensuring data quality andperformance.4. Developed ADF Transformations using Script Activity for Snowflake based Flows.5. Built Pyspark Databricks Notebooks for HDFS and Big Data Environments.6. Worked on creation of CI/CD pipelines using Azure Devops and Unit Tests; coordinated UAT tests. Show less

  • Data Engineer

    Sept 2021 - Sept 2023

  • Graduate Engineer Trainee - Level 2

    Jun 2021 - Sept 2021
• 

  Next Pathway Inc.

  Sept 2023 - now

  Data Engineer/Junior Shift Engineer

  1. Worked on Creation of DBT models, macros, hooks on top of Snowflake Data Warehouse.2. Created Airflow DAGs for orchestrating DBT models with required hierarchy.3. Complete Unit Testing and resolution of SIT based defects were done.4. Built ETL transformations and workflows in Azure Databricks Notebooks leveraging Spark technology.5. Worked with the design team in Configuring clusters and optimized memory management.6. Handled issues such as Bad Records, Data Skew etc. and used broadcast joins wherever required.7. Developed end to end ADF pipelines leveraging dataflows and Script Activity.8. Handled various SCD and CDC logics and ensured the data integrity.9. Leveraged LLMs and Python libraries for quick automation. Show less