Prathamesh Kulkarni

Experience

• 

  Tata Consultancy Services

  Sept 2020 - Sept 2024

  Bigdata Engineer

  Develop and Maintain Data Infrastructure: Design, build, and maintain scalable data pipelines and infrastructure utilizing Hadoop, Hive, PySpark, SQL, and Python. Ensure the reliability, efficiency, and security of data systems.Optimize ETL Processes: Streamline Extract, Transform, Load (ETL) processes to enhance data quality, improve efficiency, and minimize processing time. Implement best practices for data governance and quality assurance.Collaboration and Problem-solving: Collaborate cross-functionally with stakeholders to understand business requirements and translate them into technical solutions. Address complex data-related problems and provide innovative solutions.Continuous Improvement and Innovation: Stay abreast of emerging technologies and industry trends in data engineering. Implement new methodologies, tools, and best practices to enhance data engineering capabilities and drive innovation.Tool Proficiency and Workflow Enhancement: Proficient in Putty, Teamcity, Zeppelin, XL Release, Intellij, Git, Abinitio, Jira, and Confluence to optimize workflow efficiency and collaboration in development environments. Show less

• 

  HCLTech

  Sept 2024 - now

  Lead Engineer

  Big Data & Cloud Solutions | GCP ExpertiseDesign and Develop Data Infrastructure: Lead the design, development, and maintenance of scalable data solutions utilizing Big Data tools like Hadoop, Spark, Kafka, and Google Cloud Platform (GCP) services. Ensure high-performance data pipelines, storage, and processing systems.ETL Optimization: Oversee and optimize Extract, Transform, Load (ETL) processes to improve efficiency, reduce latency, and ensure high data quality. Implement data governance and compliance best practices.Collaboration and Leadership: Collaborate with cross-functional teams to understand complex business requirements and translate them into scalable technical solutions. Lead technical teams, mentor engineers, and ensure delivery of high-quality data products.Continuous Innovation: Stay updated on emerging trends and technologies in data engineering and cloud computing. Lead efforts to adopt best practices, introduce automation, and drive innovative solutions that align with business goals.Tool Proficiency and Workflow: Proficient in tools like GCP BigQuery, Dataflow, Apache Airflow, Terraform, and other workflow management tools. Leverage CI/CD pipelines to optimize development efficiency and ensure seamless collaboration. Show less