Sharan Patil

Experience

• 

  Brillio

  Nov 2021 - now

  Roles and Responsibilities:• Implement, and maintain data pipelines and data processing systems, ETL Infrastructure on AWS using technologies like Apache Spark, AWS Glue, AWS Lambda, AWS Step Functions and AWS S3 and strong Python and Pandas hands on experience.• Collaborate with data Architect and analysts/BI Developer to understand their data requirements and design data models that meet their needs.• Work with DevOps engineers to ensure that data pipelines are reliable, scalable, and secure.• Monitor and troubleshoot data pipelines to ensure that data is flowing correctly and on time.• Document technical designs, standard operating procedures, and best practices for data engineering on AWS.• Keep up to date with emerging technologies and best practices in data engineering and recommend new tools and technologies as appropriate. Show less

  • Senior Data Engineer

    Apr 2024 - now

  • Data Engineer

    Nov 2021 - Apr 2024