MANJEET .

Experience

• 

  Impressico Business Solutions

  Oct 2022 - now

  Impressico's exceptional team has successfully delivered a cutting-edge data intelligence platform for our esteemed client. This platform boasts a state-of-the-art data pipeline built with the latest in advanced technology, offering an unrivaled level of transparency into organizational performance. It proudly serves as the ultimate single source of truth for our client's organization.Featured Technology Stack:1. Orchestration: Apache Airflow2. Data Transformation: Python3. Data Storage: PostgreSQL4. ORM Framework: Django5. Data Integration: Fivetran6. Unit Testing: PytestAccomplishments: • Architected and executed Apache Airflow DAGs to streamline and automate data ingestion workflows. • Crafted Python scripts to orchestrate complex data aggregation and transformation processes. • Scheduled aggregation and transformation tasks efficiently via Airflow DAGs. • Implemented robust authentication and authorization mechanisms to ensure secure data access. • Develop and execute rigorous unit and integration tests for Python scripts to ensure code quality. • Conducted comprehensive data quality checks, establishing real-time alert systems with minus queries and other validation checks. • Utilized Airflow DAGs to automate the monitoring and enforcement of data quality standards. • Successfully executed end-to-end testing to guarantee the seamless operation of the entire data pipeline.#DataEngineering #ApacheAirflow #Python #DataIntegration #DataQuality #LinkedInProfile #TechStack Show less

  • Associate Data Engineer

    Nov 2023 - now

  • Trainee engineer

    Oct 2022 - Oct 2023