Pablo Avalos

Experience

• 

  ROD

  Nov 2023 - Feb 2024

  Data Analyst (Academic)

  ● Designed and implemented an Extract, Transform, Load (ETL) process for scraping public rental data using Scrapy on Python.● Normalized data and saved it in a PostgreSQL database.● Automated the process using a Google Cloud Virtual Machine (VM).

• 

  Freelance (Self employed)

  Mar 2024 - now

  Data Engineer & Web Scraping Specialist

  ‣ Led the design and implementation the design and implementation of crawlers, spiders, and bots for large-scale scraping across various environments, such as real estate, passenger transport websites, contact information, products, and other sites.‣ Used tools like Scrapy, Selenium, and other libraries to simulate human navigation efficiently, applying rotating proxies and advanced techniques to overcome JS challenges.‣ Developed and optimized and optimized data pipelines to ensure the proper cleaning and storage of information in a data warehouse, following the structure defined by clients.‣ Worked with SQL databases such as PostgreSQL, BigQuery and MySQL.‣ Additionally, I implemented my solutions in both Linux and Windows environments, using virtual machines. Show less