Qasim Ali

Experience

• 

  Rockville Technologies

  Oct 2012 - Jan 2014

  Java Developer

  Web portal for Support Team for different services status. SMS applications development.Web applications/Interfaces using JSP Servlets.SMPP Connectivity with different Telco’s SMSC’s.SMS Bulk/Broadcast development with veritable data and content.

• 

  Elixir Technologies

  Jan 2014 - Dec 2017

  Software Engineer

  Successfully delivered Tango+ 3.5 in a team, which is a SAAS product fororganizations to manage their complex document management processes.- Created Several Liferay Portlets and integrated them with existing code base to create a collaboration platform for users. Implemented many RESTful webservices.- Held training sessions for users and developers to understand the usage and extendibility of Liferay-Successfully delivered my tasks and helped my team successfully achieve all the sprint goals.- Worked as an active scrum master for the project of Enterprise workflow solution for UHS (United Healthcare Services) where we implemented a complete workflow process for the client’s Letter Intake Request process- I solely created Data visualization for Tango+ data driven workflow which issued by customer to test pre-production settings for application setup. Show less

• 

  Teradata

  Dec 2017 - Jun 2020

  Professional Services Consultant (Application Development | Data Engineering)

  - Designed and developed AWS-based data pipelines to efficiently process and make data available for downstream consumption.- Utilized NiFi for preprocessing and ingesting raw data into the raw zone, ensuring seamless data flow and ingestion.- Implemented integration using AWS EventBridge, enabling automatic triggering of the raw processing pipeline once data became available.- Ensured quick availability of processed data, allowing operations, analysts, and technical teams to make timely decisions based on the data.- Collaborated with cross-functional teams to understand data requirements and optimize pipeline design for efficient data processing.Successfully delivered reliable and timely data availability, enabling stakeholders to observe and make informed decisions.- Led the design and implementation of a cloud-native application for a Health Insurance company, utilizing AWS Lambda, API Gateway, SNS, and SQS.- Developed real-time dashboards using React and D3.js to visualize trends based on data from Teradata Vantage and App-Center.- Implemented efficient data processing pipelines using AWS Lambda functions for seamless data transformation and processing.- Secured and managed APIs using API Gateway, ensuring scalable integration with backend services.- Leveraged SNS and SQS for event-driven communication and asynchronous data processing.- Delivered a cloud-native application enabling real-time insights and interactive visualizations for informed decision-making. Show less

• 

  Elixir Technologies

  Jun 2020 - Mar 2021

  Senior Software Engineer (AWS & Big Data)
• 

  Systems Limited

  Mar 2021 - now

  - Conducted business unit reviews and audits to assess the adoption of modern data strategies, governance, and technology stacks.- Led architecture reviews and enhancements focused on metadata centralization and automation, improving data management efficiency.- Designed and implemented Change Data Capture (CDC) solutions using Bryteflow to enable seamless data integration.- Developed strategies and implementation plans for real-time analytics, driving actionable insights and timely decision-making across the organization. Show less - Led the migration of existing ecosystems, onboarding them into Data Governance, Data Quality, and Data Observability frameworks.- Centralized Spark 3.x implementation by consolidating 178 versions of various transformations into a single, extendable framework to support future use cases.- Spearheaded the migration from on-prem Spark 2.x to EMR 6.3 and from Python 2 to Python 3, modernizing the tech stack and improving performance.- Collaborated with the platform team to implement Infrastructure as Code using Terraform, CloudFormation, the Serverless Application Model, and the Serverless Framework.- Integrated Jenkins with serverless and Terraform plugins, centralizing deployed pipelines and elevating the overall infrastructure, frameworks, and assets. Show less - Design and Built a comprehensive data governance framework from scratch to manage and enforce standards across the Data Ecosystem.- Design and Developed a centralized metadata repository for managing data contracts, frequency, delivery SLAs, security and encryption requirements, and environment compliance, based on data agreements with various partners.- Designed and implemented a framework to analyze execution quality, data lineage, and push results into a centralized store, providing live visibility into data flows across tunnels.- Led the design and implementation of a microservices-based data quality framework using Collibra DQ and Great Expectations, integrating it into the governance model enforced across all business units.Established a multi-tenant centralized visibility platform for data owners and stakeholders to discover data, check quality and accuracy, and analyze data delivery trends.- Spearheaded the migration from on-prem Airflow to MWAA and from Spark 2.x to Spark 3.x, modernizing the infrastructure and tech stack, improving operational efficiency, and streamlining data onboarding and decommissioning processes. Show less - Joined the team to address critical data quality challenges for a leading pharmaceutical client.Analyzed and optimized an existing data pipeline framework, reducing bottlenecks and minimizing downstream intervention.- Segregated processes and integrated real-time notifications, enabling efficient pipeline operations and timely data delivery.- Implemented real-time logging and recovery mechanisms to enhance reliability and reduce operational delays.- Developed and enforced a governance model to standardize pipelines and metadata strategies, improving overall data quality. Show less

  • Senior Managing Consultant

    Jan 2024 - now

  • Managing Consultant

    Jan 2023 - Dec 2023

  • Principal Consultant

    Jan 2022 - Dec 2022

  • Senior Consultant

    Mar 2021 - Dec 2021