Tushar Atkare

Experience

• 

  Bridgenext

  Jun 2021 - now

  Data Engineer | Spark, Databricks, Python, SQL, Airflow, Hive, DBTAs a Data Engineer, I specialize in designing, implementing, and optimizing data pipelines and infrastructure to enable efficient data processing and analytics. Leveraging technologies such as Spark and Databricks, I orchestrate the ingestion, transformation, and analysis of large-scale datasets.Key Responsibilities:Develop and maintain robust data pipelines using Apache Spark for distributed data processing.Utilize Databricks for scalable data engineering and collaborative analytics in the cloud environment.Employ Python and SQL for data manipulation, querying, and transformation tasks.Implement workflow automation and scheduling using Airflow to ensure timely and reliable data processing.Manage data warehousing solutions, including Hive, for structured storage and querying of data.Utilize DBT (Data Build Tool) for data modeling, versioning, and documentation to ensure data integrity and consistency.Achievements:Designed and implemented optimized data pipelines, reducing processing time by 60-70%.Implemented automated data quality checks using Airflow, resulting in improved data accuracy and reliability.Streamlined data modeling processes using DBT, enhancing collaboration and maintainability of data transformations. Show less Data Engineer | Spark, Databricks, Python, SQL, Airflow, Hive, DBTAs a Data Engineer, I specialize in designing, implementing, and optimizing data pipelines and infrastructure to enable efficient data processing and analytics. Leveraging technologies such as Spark and Databricks, I orchestrate the ingestion, transformation, and analysis of large-scale datasets.Key Responsibilities:Proficient in Spark, PySpark, Python, and SQL.I Designs and implements scalable data pipelines for processing and analyzing large-scale datasets.Utilizes Spark's distributed computing capabilities to handle diverse data sources effectively.Orchestrates complex data workflows using Airflow, Python and SQL.Ensures data quality, integrity, and optimal performance throughout the pipeline.Optimize resilient pipelines for seamless data ingestion, transformation, and storage. Show less

  • Software Development Engineer

    Apr 2024 - now

  • Associate Software Development Engineer

    Dec 2021 - Apr 2024

  • Trainee software development engineer

    Jun 2021 - Nov 2021