Karishma Shah

Karishma Shah

Senior Data Engineer

Followers of Karishma Shah3000 followers
location of Karishma ShahToronto, Ontario, Canada

Connect with Karishma Shah to Send Message

Connect

Connect with Karishma Shah to Send Message

Connect
  • Timeline

  • About me

    Data Enthusiast | Databricks Certified Data Engineer | Azure Cloud | Python | SQL | Tableau | Teradata | ETL | Unix

  • Education

    • K.J Somaiya college of Engineering

      2011 - 2015
      Engineer’s Degree Information Technology Passed with Distinction

      Activities and Societies: - Learned various technical skills like Java, C++, SQL, Unix

    • Loyalist College

      2021 - 2023
      Postgraduate Degree Artificial Intelligence and Data Science

      Activities and Societies: - - Learned Python Programming | Machine Learning | Statistics Modelling | Data Visualisation | Data warehousing and Analytics | Data mining and Analysis | Data Storytelling Techniques | AI Principles | Deep Learning | NLP | Cloud along with Docker, Kubernetes- I'm certified Microsoft AZ-900 Basic Fundamental

  • Experience

    • Teradata

      Aug 2015 - Sept 2021
      Senior Data Engineer

      • Have in-depth knowledge of Teradata architecture, RDBMS and design experience by working on multi- terabyte systems for airline clients• Extensively worked on primary technology/tools of Teradata which includes Fastload, Multiload, FastExport, BTEQ, SQL Assistant, Teradata Administrator, Teradata Manager, Teradata Studio, Teradata Viewpoint, Visual Explain, Index Wizard, and Database remote console utilities.• Understood complex business requirements and transformation for ETL and Reporting with continuous interaction with Clients and BA by finding the optimum solution to develop them in Data Modelling, ETL & Reporting related activities• Developing, Testing, and Deploying changes with AGILE methodology as per the client requirement• Developed complex SQL queries by performing various testing like unit testing, integration testing andsetting up the environment for User Acceptance testing.• Developed various stored procedures and macros to automate the process in database and various tasks using UNIX shell scripting & Python for several routine activities which increased the productivity• Ingested files with different formats like JSON, XML, etc to database using Teradata tools and utilities• As part of the SEI CMM Level 5 process, created various documents viz. Estimation sheets, Requirement Analysis, Design Documentation, Mapping Document, Test Cases, MOM, Review log, Timesheet, and Peer Review Checklists for ETL, Scripting, and Reporting.• Provided performance tuning recommendation on many proactive and Ad hoc performance issues to clients for performance improvement and to make sure query response times are within Service level agreements (SLA)• Good hands-on experience with Tableau desktop for creating and modifying dashboard reports as per business requirements.• Ramped up new resources and mentoring OJTs for the project to onboard them quickly• Travelled Germany (onsite) to complete a project for an airline client in 2019 Show less

    • TD

      Jan 2023 - Apr 2023
      DevOps/Cloud Engineer

      • Worked on DevOps tools and technologies like Terraform, Salt-stack, Docker, Jenkins, GitHub, Bitbucket, Unix, Azure including CI/CD pipelines with Jenkins and Bitbucket.• Developed salt-stack scripts with Jinja coding for the automation of the infrastructure upgrade process which reduced the time spent during upgrade process• Performed infrastructure upgrade for various development areas like Sandbox, Dev, QA, PAT & PROD using Jenkins and Nexus by delivering latest Terraform CLI version to the client• Documented env provisioning tasks to support the promotion of technical code through the environments.• Lead and performed the upgrade process of various tools like Terraform, Docker, Postgres, Replicated• Communicated effectively with the developers, testers and operations by providing technical guidanceand support during the deployment with excellent communication skills.• Awarded “Co-Op of the month” in the team for bringing success and completing high qualitydeliverables under stringent deadline. Show less

    • TD

      Jun 2023 - Oct 2024
      Data Engineer I

      - Developed and managed Azure Databricks data pipelines for TD Bank, achieving real-time financial data analytics and a 20% performance boost in data warehouse operations.- Automated multi-source data integration with Azure Data Factory, cutting data latency by 40%, and implemented DataDog for performance monitoring, improving system reliability.- Developed Tableau dashboard to perform analysis and present data to client and stakeholders- Enhanced large-scale data processing within Hadoop using PySpark and Python automation, resulting in a 50% efficiency increase and significant reductions in manual workload and error rates. Show less

    • Accenture

      Oct 2024 - now
      Lead Data Consultant
  • Licenses & Certifications

    • Azure Basic Fundamentals

      Microsoft
      Nov 2020
    • AWS Business Professional Accreditation

      Amazon Web Services
    • Teradata 14 Professional Certification

      Teradata
      Dec 2015
    • Standard English/Western Certification

      World Education Services
      View certificate certificate
    • Academy Accreditation - Databricks Lakehouse Fundamentals

      Databricks
      Aug 2023
      View certificate certificate
    • AWS Technical Professional Accreditation

      Amazon Web Services
    • Teradata Sql Certification

      Teradata
      Jun 2016
    • Databricks Certified Data Engineer Associate

      Databricks
      Nov 2023
      View certificate certificate
    • Consulting Skills - Essentials Level

      Teradata
      Jun 2020
      View certificate certificate
  • Honors & Awards

    • Awarded to Karishma Shah
      GDC Employee of the Quarter Award for Q2-2020 Teradata Aug 2020
    • Awarded to Karishma Shah
      GDC Employee of the Quarter Award for Q3 2016 Teradata Dec 2016