Harini Gella

Experience

• 

  Tata Consultancy Services

  Jan 2020 - Aug 2022

  Assistant Software Engineer

  • Optimized financial data ingestion and transformation processes using Apache Spark on Azure Databricks.• Migrated a data warehouse to Azure Synapse Analytics, improving query performance by 70%. • Created and managed Azure Data Factory pipelines for automated ETL processes, using visual ETL and Zero ETL methodologies.• Monitored and troubleshooted data workflows with Azure Monitor and Azure Log Analytics, ensuring real-time performance tracking and error resolution.• Utilized Azure Data Lake Storage for efficient and cost-effective data management, reducing storage expenses by 30%.• Developed serverless solutions using Azure Functions and Logic Apps, automating data processing and integration tasks.• Created Power BI dashboards to analyze financial data, enabling dynamic reporting and decision-making using DAX and Power Query.• Automated deployment processes with Azure DevOps, enhancing CI/CD workflows for ETL jobs, data models, and other data tasks. Show less

• 

  Excelon Solutions

  Aug 2023 - Apr 2024

  Junior Software Engineer

  • Worked on designing and maintaining data pipelines for processing large-scale health-related datasets (up to 10TB) in the Azure environment.• Developed ETL pipelines using Azure Data Factory and Apache PySpark, streamlining the processing of sensitive health data while ensuring compliance with data privacy regulations like HIPAA.• Managed Azure Synapse Analytics to facilitate faster data querying and reporting, improving the performance of health data analytics by 50%. • Integrated into AWS S3 for backup of critical health data while syncing data lakes between AWS and Azure, enhancing data security.• Implemented cross-cloud synchronization between AWS and Azure Synapse Analytics, improving data accessibility across platforms. Show less

• 

  Nubes Opus

  May 2024 - now

  Software Engineer

  • Managed and optimized financial data by building pipelines and workflows on AWS and Azure platforms.• Developed and deployed serverless data processing solutions using AWS Lambda Functions.• Designed, developed, and maintained scalable and resilient data storage and processing systems using Amazon Redshift and Azure SQL Database.• Created and managed AWS Glue jobs for data extraction, transformation, and loading (ETL) tasks, utilizing both visual ETL and Zero ETL for data in DynamoDB to streamline data processing.• Utilized AWS CloudWatch for monitoring and logging of data pipelines and system performance.• Implemented CI/CD pipelines for financial data and workflows using Git.• Analyzed and processed large datasets, ensuring data quality and improving data-driven decision-making processes for clients.• Utilized Visual Studio Code (VS Code) as the primary IDE for development and debugging.• Collaborated with cross-functional teams to automate deployment processes for data models, ETL jobs, and other data-related tasks using Git for version control. Show less