Harika M

Experience

• 

  EDS Group

  Apr 2013 - Aug 2014

  Big Data Engineer

  Developed Hive queries to process the data and generate the data cubes for visualizing Implemented schema extraction for Parquet and Avro file Formats in Hive. Developing Scripts and Batch Job to schedule a bundle (group of coordinators) which consists of various Hadoop Programs using Oozie.Developed MapReduce programs to clean and aggregate the data Worked on optimizing Hive queries, joins to handle different data sets.

• 

  GE HealthCare

  Mar 2015 - Nov 2016

  Data Engineer

  Handled importing data from different data sources into HDFS using Sqoop and performing transformations using Hive, Map Reduce and then loading data into HDFS. Involved in data processing like collecting, aggregating, moving from various sources using Apache Flume and Kafka. Created Pig Latin scripts to sort, group, join and filter the enterprise wise data.

• 

  Tempus

  Nov 2016 - Aug 2019

  Senior Data Engineer

  As a Data Engineer, My work is more about harnessing real-time data processing tools like Kinesis and Lambda, I enhanced system responsiveness. This allowed for dynamic analytics, empowering the organization to make informed decisions based on the latest available data.I involved in demonstrating expertise in optimizing data architectures , I focused on fine-tuning and scaling infrastructures. This ensured optimal performance and scalability, utilizing key services such as S3 and DynamoDB, contributing to a robust and efficient data environment. Show less

• 

  Axon

  Aug 2019 - Jun 2022

  Senior Data Engineer

  As a Data Engineer my role is to Build and optimize ETL processes to ingest and process diverse datasets from various sources. I ensure data quality and integrity throughout the ETL pipeline. Involved in utilizing cloud-based technologies to implement scalable and flexible data solutions and leverage cloud services for data storage, processing, and analysis. Implemented and managed data warehouses to support efficient querying and reporting, apart from that I was also involved in optimizing data structures for performance and cost-effectiveness. Show less

• 

  Bank of America

  Sept 2022 - now

  Sr Data Engineer

  Created Pipelines using Linked Services to Extract, Transform and load data from different sources ,write-back tool and backwards.Developed complex data pipelines to create a consolidated & connected data lake environment. Developed Data Bricks Python notebooks to Join, filter, pre-aggregate, and process the files stored in data lake.