Narayana Murthy Gopisetti

Experience

• 

  Futurense Technologies

  Nov 2021 - Dec 2022

  Data Engineer
• 

  Celebal Technologies

  Dec 2022 - May 2024

  Associate Consultant

  utilizing Databricks and Data Factory for ETL operations, handling data from diverse sources including Qlik files, SAP, Bizom, and SQL Servers.- Implemented Medallion architecture in Databricks, ensuring structured data processing from raw to gold layers, enhancing data reliability and accuracy.- Configured a monthly refreshed GST report using Power BI, providing stakeholders with insightful analytics.- Managed JSON data efficiently, employing techniques such as explode related queries to handle nested structures effectively.- Addressed data skewness using advanced techniques like salting, ensuring balanced data distribution and optimized query performance.- Employed broadcast joins to optimize performance and improve query execution efficiency.- Utilized the qualify method for efficient window function subqueries in SQL queries.- Applied repartitioning and coalescing techniques to optimize memory usage and mitigate out-of-memory issues.- Implemented Z-ordering and optimize commands to tackle the challenge of small files, optimizing data storage and query execution efficiency.- Overall, focused on delivering reliable, efficient, and scalable data solutions tailored to meet client needs. Show less

• 

  Tredence Inc.

  May 2024 - now

  Senior Software Engineer