Karan Manchanda

Experience

• 

  HCLTech

  Feb 2015 - Jun 2018

  Software Engineer

  The Accounting Subledger system is the core banking solution in Deutsche bank to account for transactions, valuations, settlements, adjustments coming from various upstream (GMI Sun guard, Bloomberg, CB Imagine, Imagine GED, BRDS) for which the postings are generated to be accounted for while calculating the balances. The data from different upstream sources are imported to HDFS (Staging area) using flume and SQOOP. To generate the posting, the data needs to go through complex business logic written in Pig and Hive. After performing the business logic, the processed data is stored at the Data store layer from where we generate the reports using hive for the end user. Show less

• 

  Genpact Headstrong Capital Markets

  Jun 2018 - Feb 2019

  Consultant

  The Legg Mason Enterprise Data Warehouse is data warehouse used by client to generate different types of reports for analysis their investment and risk. We are using AWS services and infrastructure to migrate the data from multiple sources like Salesforce, Wiser, Lipper, Informatica, Adobe and TAOS. To ingest the data into S3(staging) from different sources we using SQOOP and flume as an ingestion tool. Before implementing our business logic on the data, we used to perform some quality checks. After completion of quality checks, we implement our business logic using Spark Scala framework and dump the final data into the data warehouse layer in S3. Show less

• 

  Nokia

  Mar 2019 - now

  Data Engineer