Henrique Prates

Henrique Prates

Trainee - Advanced Analytics

Followers of Henrique Prates2000 followers
location of Henrique PratesSão Caetano do Sul, San Pablo, Brasil

Connect with Henrique Prates to Send Message

Connect

Connect with Henrique Prates to Send Message

Connect
  • Timeline

  • About me

    Senior Data Engineer | Databricks | Big data | ETL | Azure | Spark | PySpark | Python | SQL

  • Education

    • FATEC São Caetano

      2015 - 2018
      Análise e Desenvolvimento de Sistemas
  • Experience

    • EY

      Dec 2017 - Oct 2018
      Trainee - Advanced Analytics

      Ernst & Young is one of the largest professional services firms globally, providing consulting, auditing, tax, and related services. EY helps businesses tackle complex challenges and drive growth.

    • Santander Tecnologia

      Oct 2018 - Apr 2019
      Big Data Engineer Consultant

      Banco Santander Brasil is a financial institution of Spanish origin and one of the largest banks in the country, offering a wide range of financial products and services for individuals and businesses.----------Worked on a migration project from SAS to a Big Data environment. Developed ETL routines in the Cloudera Big Data platform using Spark, YARN, Hive, and Impala with Hadoop HDFS. Additionally, used Python and Shell script for supplementary routine creation.

    • Semantix

      Apr 2019 - Nov 2019
      Senior Big Data Engineer

      Semantix is a Latin American leader in Big Data, Analytics, and Artificial Intelligence solutions, offering services that transform data into strategic insights for various industries.----------Led the Health Data Engineering team, coordinating task distribution, backlog organization, and KPI delivery alongside clients. Ensured project alignment with client expectations and reported team performance to area coordinators.Designed and implemented ETL routines in Cloudera Big Data, leveraging tools such as StreamSets, Spark (Scala), Hive, Impala, PowerBI, and Hadoop HDFS. Used Python and Shell script for additional processing needs. Show less

    • Via Varejo SA

      Nov 2019 - Dec 2022
      Senior Azure Big Data Engineer

      Via Varejo is one of Brazil's largest retail companies, managing renowned brands such as Casas Bahia and Pontofrio. It operates in the electronics, appliances, and furniture sectors, with a strong presence in both physical and online retail.----------Main activities:-Contributed to the DataLab squad, the core engineering team providing data and infrastructure for other data squads.-Implemented the Data Lake and established adjacent resources to integrate on-premises and mobile Big Data environments.-Enhanced processes and resource management to reduce costs and improve performance as the platform adoption grew.-Developed and executed an action plan to implement data governance and security improvements, enabling ROI measurement for business and marketing initiatives.Technical highlights:-Designed and implemented end-to-end ETL solutions in batch and real-time (EventHub, Databricks [Scala/PySpark], Data Factory, Storage Accounts, Synapse).-Integrated external and mobile data sources via Azure Functions and CosmosDB.-Established monitoring pipelines and alert systems using LogicApps and Action Groups.-Configured virtual networks (VNet, SNet, Peering, Private EndPoint) to enhance resource security.-Managed credential security with Azure Key Vault and Databricks Secret Scope. Show less

    • HVAR

      Dec 2022 - Jan 2024

      DPaschoal is a leading Brazilian company in the automotive sector, specializing in tire sales and automotive services, with an extensive network of stores and service centers across the country.----------Main activities:-Designed and implemented a Data Lake and adjacent resources for integrating data from various sources (SAP BW, SAP ECC) and distributing it to destinations (Pentaho, PowerBI, Analysis Services, Synapse).-Built scalable processes to accommodate increased data volume and diverse consumer needs.Technical highlights:-Delivered end-to-end ETL processes using Data Factory, Databricks (PySpark), and ADLS Gen2.-Implemented monitoring systems and email alerts using LogicApps and Action Groups.-Configured secure network environments with Azure Virtual Network, Subnets, Peering, and Private EndPoint.-Ensured credential security with Azure Key Vault and Databricks Secret Scope. Show less GTM Caldic is a global company formed from the merger of Caldic and GTM, ranking among the top three global distributors of specialty chemicals and ingredients. It has a strong presence in Latin America and focuses on delivering value-added solutions across various end markets.----------Main activities:-Served as Technical Leader for the Azure Data Engineering team.-Designed and implemented a Data Lake for data exchange between sources (SAP, SalesForce, Dynamics AX) and various systems.-Focused on cost reduction and performance improvement through process refinement and optimized resource management.Technical highlights:-Delivered end-to-end ETL solutions using Data Factory, Databricks (Scala/PySpark), ADLS Gen2, SQL -Database, and Synapse.-Established monitoring and alert systems with LogicApps and Action Groups.-Configured secure network environments with Azure VNet, SNet, Peering, and Private EndPoint. Show less

      • Technical Leader – DPASCHOAL

        Jun 2023 - Jan 2024
      • Technical Leader – GTM CALDIC

        Dec 2022 - Jun 2023
    • Usabit | Consultoria + Tecnologia

      Jan 2024 - now
      Senior Data Engineer – MAG SEGUROS

      MAG Seguros is a Brazilian insurance company specializing in life insurance and private pension plans. With over 185 years of market presence, it provides financial solutions for family protection and planning.----------Main activities:-Member of the Data Strategy squad, providing infrastructure and data support to the Marketing squad.-Designed and implemented a data ingestion process between SalesForce, SF Marketing Cloud, and the Azure data environment.Technical highlights:-Developed batch ETL solutions using Data Factory and Azure SQL Database.-Implemented monitoring and alert systems with LogicApps and Action Groups.-Ensured credential security with Azure Key Vault. Show less

  • Licenses & Certifications

    • DP-200 Implementing an Azure Data Solution

      Microsoft
      Feb 2020
      View certificate certificate
    • Engenharia de Dados com Hadoop e Spark

      Data Science Academy
      Mar 2019
    • EY Robotic process automation - Bronze

      EY
      Jun 2018
      View certificate certificate
    • Professional Cloud

      Cloud Treinamentos
      May 2019
    • Databricks Certified Data Engineer Associate

      Databricks
      Jan 2025
      View certificate certificate
    • DP-201 Designing an Azure Data Solution

      Microsoft
      Feb 2020
      View certificate certificate
    • Microsoft Certified: Azure Data Engineer Associate

      Microsoft
      Feb 2020
      View certificate certificate
    • Databricks Lakehouse Fundamentals

      Databricks
      Nov 2024
      View certificate certificate