Arbaaz Sayyed

Experience

• 

  Datametica Solutions Private Limited

  Oct 2020 - Sept 2022

  1. Worked in Oracle (Onprem) to GCP (BQ) migration project , using dataflow (Apache beam) as ingestion framework. 2. Created Dataflow pipeline for Ingesting .PSV files into BigQuery. Working on Google Cloud Composer & writing Airflow Dag' s in python for creating workflows. Wrote complex SQL and Stored Proc in BQ for handling different types of transformations as per the Business logics.2. 1. Worked on developing applications using Python that uses Computer Vision libraries like Pytesseract - OCR (Optical Character Recognition), openCV for fetching the crucial data from the digital documents like pdf & Images.2. Wrote custom python scripts to store that data into MySQL server which was then used by business according to their use cases.

  • Engineer - I

    Sept 2021 - Sept 2022

  • Associate Engineer

    Oct 2020 - Sept 2021
• 

  TELUS International

  Sept 2022 - now

  Data Engineer

  1. Developed varoius ETL pipeline for migrating the data from Oracle to Google Bigquery.2. Developed python code for migrating the oracle data from Linux server to GCS, wrote custom Dags in composer to move the data from GCS to BQ & monitored it using Airflow.3. Developed bulk data loading pipelines from GCS to Bigquery tables using Composer & Apache Airflow ( Orchestration tool for monitoring and creating workflows).4. Wrote custom dags using Python operator to pull the history data for multiple tables in Oracle to insert it in Bigquery, to match the source count.5. Wrote custom dag for fetching real time data using cloud pub/sub and inserting in Bigquery after applying Show less