Arkil Thakkar

Experience

• 

  State Farm

  Oct 2017 - Sept 2018

  Software Developer

  Worked at Customer and Marketing Department of StateFarm- Developed JSON API spec compliant REST web service using Spring Boot, Katharsis, and PostgreSQL.- Build a Hadoop ingestion flow component which reads deserialized data from Kafka topic into Flume serializer and stores data into HBase and indexed through Solr.- Implemented a Spark batch solution which queries the Hive database having 260 million records to generate reports which are visualized in QlikView.- Applied feature extraction, feature scaling and feature transformation on customer data and used machine learning classification technique to predict whether a customer will buy a policy using Spark MLlib. - Used Cloudera Manager’s API to build an application which will send alerts using time series queries when components like Kafka, Flume channels crosses the threshold.- Applied Agile Test Practices SCRUM, Scripted Test Cases for Test Driven Development TDD and developed test cases for story card based on Acceptance Test Driven Development Show less

• 

  Infosys Consultant at Apple

  Sept 2018 - Jul 2019

  Big Data Engineer

  Worked at the GBI department of Apple for iTunes Charts.- Analyzed Terabytes of Data using Hive to gain insights of top Trending iTunes Music, Video and optimized performance using partitioning, bucketing and map-side joins. - Migrated semantic Hive workflow of Apple iTunes Charts to Apache Spark (Scala) using Data Frame API for low latency with optimization of 30%, and scheduled jobs in Autosys. - Maintained metadata-driven data pipelines of iTunes Charts from heterogeneous sources from loading data from source-to-file-to-core-to-semantic EDW/Teradata/Spark layer Show less

• 

  San Jose State University

  Sept 2019 - Dec 2019

  Research Assistant

  - Applied Object Detection YOLOv3 algorithm on WayMo dataset by extracting images from TFRecord dataset - Calculated Mean Average Precision (mAP) using custom Tensorflow Op

• 

  IBM

  Feb 2020 - May 2020

  Sr. Back End Developer Intern

  Worked at DB2 Extenders team in IBM Data and AI team- Performance comparison of Geo-Spatial data on Netezza and IBM DB2- Performance tuning of DB2 spatial queries using explains, statistics, filters, bounding boxes, geohash cover- Developed Jupyter Notebook demo of DB2 Spatial Analytics spatial queries for customers https://developer.ibm.com/recipes/tutorials/ibm-db2-spatial-analytics-bank/

• 

  Amazon

  Jun 2020 - Aug 2020

  Software Engineer Intern

  Worked in the Feature Market Algorithm team under Consumer Engagement Organization.- Developed a secured internal portal to facilitate Data scientists to create and launch a different type of experiment.- Created frontend using React.Js and backend API's in Java-Coral and deployed in the cloud Tools and Technologies: Cloudformation, Cloudfront, Route 53, IAM, API Gateway, AWS Lambda, Cognito, Dynamo DB

• 

  IBM

  Sept 2020 - Dec 2020

  Sr Back End Developer Intern

  Worked at DB2 Extenders team in IBM Data and AI team- Enabled GeoJson and KML data format support for IBM DB2 Spatial- Worked on IBM DB2 Spatial defects

• 

  Amazon

  Jan 2021 - now

  Worked in the Offers-X team under Core Shopping.- Worked on building offline simulation tool for A/B experiment- Lead and enabled CI/CD to 10+ pipelines - Work on LongTermUnits for Evaluation Worked in the Offers-X team under Core Shopping.- Worked on adding Evaluation results and Visualization of A/B Experiments in secured internal website.- Developed a workflow that launches end to end A/B experiment without using external service - Worked on creating services which facilitates running experiments on cluster level

  • Software Development Engineer 2

    Nov 2022 - now

  • Software Development Engineer

    Jan 2021 - Nov 2022