Aleksei Kochnev

Experience

• 

  KRAFT

  Dec 2015 - Jul 2016

  Developer

  Developed corporate eLearning courses on the Articulate Storyline 3 platform using JavaScript. More than 10 courses have been successfully implemented in various international companies for corporate learning.Modernized and supported the company's official website as a web developer in collaboration with a designer. Website conversion increased by 10%.

• 

  EC-Leasing

  Sept 2017 - May 2022

  Developed fully automated data collectors from various external open data sources, such as social networks, company websites and government information registries, using APIs and website scraping.Developed database and data mart architectures for storing, structuring, combining and processing data to produce real-time analytical reports. The delay in processing a request to the final data marts does not exceed 2 seconds.Prepared and cleaned a dataset containing more than 1,000,000 Internet pages to train neural network models that classify text and identify key entities. Show less

  • Senior Data Analyst

    Feb 2021 - May 2022

  • Data Analyst

    Sept 2017 - Feb 2021
• 

  Karuna

  May 2022 - now

  Led a team of three engineers: onboarding in the company, mentoring colleagues in solving problems, project planning, task distribution, improving value delivery processes.Led the development of operators for the Airflow plugin to simplify interactions with Clickhouse. In particular, a mechanism has been developed for automatically creating temporary tables in Clickhouse to transfer data between Airflow tasks. This allowed us to speed up the process of developing aggregations and data marts.Led the development of the ClickHouse test environment with weekly data synchronization from the production cluster. Allowed us to solve several problems: safe testing on data during development, identifying errors associated with updating versions of DWH/libraries involved in the ETL process. Show less Led data quality initiative. Developed many automated data tests to monitor incoming raw data for anomalies and check the correctness of aggregation calculations. This approach helped to find and eliminate anomalies and errors in data before they affected the metrics in analytical reports.Mentored colleagues on technical skills related to our infrastructure and technology stack: Python, SQL, ClickHouse, Airflow, Kafka, Git/Gitlab.Led an initiative to document processes and services to simplify information retrieval and onboarding of new employees. Show less Completed a fully transfer from Vertica to Clickhouse as the main data warehouse (data, ETL and ELT pipelines for data collection and aggregation).Built an aggregation of marketing data, which accelerated the calculation of analytical reports and minimized the number of errors that arose when accessing raw data.Developed a fully automated process for transferring data from Google Analytics BigQuery to ClickHouse via Airflow. 50 million rows and 40 columns per day.Created many fully automated pipelines for receiving data into the warehouse from external sources mainly using Airflow (ETL, batches) and internal sources mainly using Apache Kafka (ELT, streaming). Transferred terabytes of data using these pipelines. Show less

  • Team Lead Data Engineers

    Oct 2023 - now

  • Senior Data Engineer

    Aug 2023 - Oct 2023

  • Data Engineer

    May 2022 - Aug 2023