Amiya Maharatha

Experience

• 

  Tech Mahindra

  Jan 2006 - Jun 2011

  ETL Lead/sr.Developer/Developer

  Client: Multinational UK-based telecommunications company.Worked as a ETL (Informatica Power center) Consultant, Oracle Warehouse developer, Database (Oracle, UNIX) developer.

• 

  NIIT Technologies

  Jul 2011 - May 2013

  ETL Lead

  Client: Multinational Australian-based airline companyWorked as a ETL(Informatica Power center) Consultant.

• 

  Tech Mahindra

  May 2013 - Jan 2017

  Technical Architect

  Client: Multinational US-based Oil & Gas and US -based Financial Company Worked as a Technical Architech/Big Data Engineer and ETL (Informatica Power center) consultant in multiple assignments.

• 

  IBM

  Jan 2017 - Apr 2019

  Lead Data Engineer/Sr Consultant

  Client: Multinational US-based Pharma company and Oil & Gas company

• 

  Deloitte Consulting

  Apr 2019 - Jul 2021

  Technical Architect/Senior Consultant

  Client: Multinational US-based Oil & Gas company and Swiss -based multinational Pharma company.

• 

  Accenture

  Jul 2021 - Sept 2022

  Lead Data Engineer/Associative Manager
• 

  Florida Insurance representing Florida Blue (Blue Cross/Blue Shield)

  Sept 2022 - now

  Lead Data Engineer/Architect

  • Gathered requirements from business stakeholders.• Designed logical and physical data models using Erwin tool.• Lead the design and implementation of scalable data architectures using Azure Databricks Delta Lake and Databricks Unity Catalog • Implemented a metadata-driven ingestion framework for migrating on-premises data to the cloud using Azure Data Factory• Utilized Databricks Autoloader for incremental data ingestion in both batch and real-time processing scenarios.• Developed pipelines using Python, PySpark, and SQL within Azure Databricks (ADB).• Architected and executed performance tuning and optimization strategies for Databricks Spark clusters and pipelines, leveraging advanced techniques.• Monitored Databricks clusters and jobs to identify bottlenecks, optimize resource utilization, and troubleshoot issues• Led the implementation of a Data Governance solution using Unit catalog.• Reviewed the code and suggested better approaches to implement as per best practices.• Helped DevOps team implement YAML files for code migration.• Closely collaborated with infrastructure, DevOps, and business teams• Provide technical expertise and guidance on best practices for data management and analytics Show less