Dhruvkumar Patel

Experience

• 

  Freelancer.com

  Dec 2020 - Jun 2022

  Python Developer

  Profile - https://www.freelancer.com/u/warlikedhruv- Designed and developed Django web application for live data fetching from crypto platforms with websockets and caching in Redis server.- Payment gateway integration in an ongoing project on Django and react framework.- Python scripts for daily scrapping and streaming tweets with database on MongoDb with integration on a private cloud with process daemon. - Telegram bot for marketing on python with proxies. - Deploying Django application to EC2 instance with nginx for reverse proxy.- HTML pages scraper on python and store the results to google docs.- Developed Django chat application with websockets with chabot fine tuned on OpenAi GPT-3.- Developing and Deploying REST apis for Deep neural network models with Heroku.- Research paper implementation for Fake news detecting on Natural language processing with genetic algorithms on Tensorflow.- Time-series analysis for geo-thermal sensors with Tensorflow and python. Show less

• 

  Freelance

  Jan 2022 - Jul 2022

  Data Engineer

  • Built Dataflows for data orchestration and migrations to GCP bigdata with airflow.• Optimized ongoing workflows resulting into 20% less execution time.• Organized bigdata workflows on loading for multiple clients as per Business requirements.• Performed White box testing to leverage workflows by detecting bugs and analyzing severity.

• 

  XLab Research

  Jan 2022 - Jul 2022

  Full Stack Developer(Project Lead)

  Provided Solutions for the Application architectures to ensure efficient costs and scalable options.• Lead team of 10 developers with Agile and Waterfall model to ensure efficient development of product. • Developed CI pipelines and scripts for Infrastructure, resulting in 40% cost reduction in cloud billings. • Build Web application with SEO optimization resulted in 20 new users for the initial product.

• 

  Badal.io

  Aug 2022 - now

  Senior Full Stack Engineer

  • Worked on GCP Platform for Data migrations workload modernization with ~40 tenants onboarding. • Designed and Developed pipelines with ETL and ELT from DBT and Apache Beam.• Collaborated in migrating HDFS data to GCP Bigquery• Build and responsible for deploying patterns on onboarding DBT and Airflow workloads for tenants. • Optimized and improved Data Lineage Solution for the platform with passive lineage approach.• Worked on resolving security for applications running on Docker and resolving CVE vulnerabilities.• Designed , Developed CI/CD pipelines for Data Validations, Data Quality check patterns for tenants.• Worked with Java, Debezium on SQL and IBM DB2 for CDC patterns and deployed with Dataflow.• Implemented Centralized Monitoring from scratch with Dashboards, alert scoping ~100 projects.• Worked with team to deploy SAS application in GCP cloud with IAC. Show less