Nikunj Patel

Experience

• 

  Nineleaps

  Jan 2019 - Jan 2022

  I am currently working as a Python, PySpark based Data Engineer that is responsible for:- Authoring and maintaining Apache Airflow-based ETL workflow, - Writing Python scripts to fetch the required data from various sources using the APIs or client SDKs, - Transforming the fetched data into the required schema using python utilities or HiveQL, - Loading the transformed data into the HDFS based data warehouse. Additional responsibilities include: Utilizing HIVEQL and PrestoQL to verify and analyze the data once available in the warehouse. Show less Initially, I worked as a DotNet backend Developer to create ASP.Net WebAPI project along with MSSql as the database technology. Used Swagger as the API Documentation tool and had hands-on practice on working with some AWS and Azure services.At a later stage, I worked as a Python developer to create and maintain an ETL workflow that involves fetching the required data using the APIs or client SDKs, transforming the fetched data into the required schema, and loading it into the HDFS file system. Also responsible to query the stored data using HIVEQL or PrestoQL. Show less

  • Software Development Engineer I

    Oct 2020 - Jan 2022

  • Member Of Technical Staff

    Jul 2019 - Oct 2020

  • Software Intern

    Jan 2019 - Jun 2019
• 

  GoTo

  Feb 2022 - now

  • Senior Software Engineer | Data Engineer

    Apr 2024 - now

  • Software Developer | Data Engineer

    Feb 2022 - Apr 2024