Shrey Niraula

Experience

• 

  Kalki I.o.t. Solutions Pvt. Ltd.

  Jun 2020 - Jan 2021

  Web Developer

  Remotely worked as a part time, mostly as a frontend developer in React and also ensured backend support and database management.

• 

  GrowByData

  May 2021 - Jul 2024

  Data Engineer

  Working as a data engineer in data acquisition, ETL pipelining, and big data solutions, such as data warehouses and data lakes.• Data Acquisition – Implemented optimized Python and an OOP framework with concurrency for API‑based business data extraction from diverse sources (GoogleAds, GA, BingAds, Pinterest, Facebook, Shopify, Amazon Organic Ranking/Rating, etc), ensuring secure authentication and authorization via OAuth2 and MCC – Pipelined and bridged the ETL and Data Acquisition managing EC2 Cluster instantiation to EMR triggering – TechStacks: Python, OOP, Concurrency, AWS Components ‑ EMR, S3, EC2, IaC, Crontab• ETL – Pipelined Star Schema Modeling in the data warehouse (Amazon Redshift) and Lakehouse architecture composed of S3 as a parquet file storage, Glue+DataCatelog as metadata storage, and Dremio as a query engine – Migrated Talend‑based ETL jobs to Apache Spark‑based ETLjobs using Scala/PySpark python and SparkSQL – Crawled metadata from S3 storage using AWS Crawler and stored in AWS Glue Catalog – TechStacks: Apache Spark (Scala and Python), AWS components ‑ S3, Glue, Redshift, EMR, Crawler, Iceberg• BI Report Backend – Utilized Flask RESTful API framework for complex OLAP query in data warehouse and lake house supporting MySQL, Dremio, Presto, Aurora, and Redshift in Factory-based design principles – Optimized report loading by cache logic implementation with Redis – Constructed scalable architecture for automating the dynamic demo report generation from existing hard‑coded logic – TechStacks: Python, OLAP querying with SQL, Dremio Query Engine, Redis Show less

• 

  NASA-IMPACT

  Aug 2024 - now

  Graduate Student Research Assistant