Neha Agarwal

Experience

• 

  ATOS SYNTEL PRIVATE LTD

  Jul 2006 - Apr 2008

  Programming Analyst
• 

  Cognizant Technology Solutions

  May 2008 - Aug 2009

  Programmer Analyst
• 

  Sopra Steria

  Nov 2009 - Jan 2012

  Software Programmer
• 

  Tata Consultancy Services

  Feb 2012 - Oct 2023

  Worked as Data Engineer for client Lloyds Bank Group, being responsible for developing and maintaining the data pipelines from ingestion until Consumption phase/state to make data available for respective consumers, data quality assessment. . Below were few of the responsibilities/tasks which I performed:• Designed and implemented scalable and efficient data pipelines for end to end data solutions using GCP and AWS services such as Cloud Storage, BigQuery, DataProc, DataFlow, Cloud Function, Cloud Composer-Airflow, AWS Glue, Lambda, Step function, Redshift, S3, Dynamodb etc. • Performed analytical works to support in the strategic planning to create the data models/products to ensure data consistency, cost optimization and computing performance.• Utilized analytical techniques to assess data quality, analyze results and produced comprehensive reports and fact-based documentation by using Power BI, SQL, Python.• Ensured data security, privacy and to be complianed as per regulatory regimes such as GDPR.• Lead multiple initiatives with different stakeholders to evaluate business needs and objectives.• Collaborated with cross-functional teams to ensure data accuracy and completeness.• Created MetaData,STTMs (Source to Target Mapping) for data transformation from Source to Target systems which used to be source for development phase. Show less • Scrapped the data, Data quality assessment, Data analysis, pattern and trend identification, Visualization of data insights before finalizing the architecture of workflow(data pipeline) for desired data.• Developed R Shiny dashboard with interactive charts and tables to showcase the areas in scope of data quality improvement in R. • Integrated the data from various sources to provide a unified view of the project's data landscape.• Replicated on premises real time streamed data to Cloud platform via Confluent Replicator.• Worked upon multiple usecases for developing batch and real time/near real time streaming data pipelines. • Lead multiple initiatives and collaborated with stakeholders, cross-functional teams to evaluate business needs,objectives and ensure data accuracy & completeness. Show less

  • Senior Data Engineer

    Dec 2021 - Oct 2023

  • Data Engineer/Scientist

    Jan 2016 - Nov 2021

  • Technical Specialist/Transition Manager

    Feb 2012 - Dec 2015
• 

  Thoughtworks

  Jun 2024 - now

  Senior Data Engineer

  Currently working on training the model for Object detection and instance segmentation on custom dataset. Using Annotation tools- CVAT, Makesense, Roboflow; Frameworks Yolov8 , Detectron2 and their models .Hypertuning the parameters for best accuracy in detecting and segmenting the classes.