Chiranjit Ghosh

Experience

• 

  Tata Consultancy Services

  Jan 2014 - Oct 2021

  Professionally seasoned Big Data Engineer with a knack for crafting and executing robust Data Lake solutions. Demonstrated proficiency in extracting and processing a wide array of data sources to yield actionable KPIs for insightful reporting and advanced statistical analysis. Specialized in PySpark and Spark SQL (Python), complemented by a solid command of SCALA Spark across Databricks and Cloudera platforms. Extensively skilled in harnessing AWS suite, encompassing EMR, S3, EC2, SQS, Kinesis, and Redshift, for seamless cloud-centric solutions. Deep-rooted experience in Cloudera's Hadoop ecosystem, deftly utilizing tools such as Sqoop, HDFS, YARN, alongside analytical platforms like Hive and Impala. Track record of success in navigating multi-cloud environments, encompassing AWS, Azure, and GCP. Intrinsically motivated to lead dynamic teams in tackling intricate Spark-driven Machine Learning and AI endeavors. Poised to transition towards the dynamic realms of Data Analytics and Data Science, leveraging a rich background to generate meaningful insights and foster innovative solutions. Show less As an accomplished Big Data Engineer, I specialize in crafting and executing robust Data Lake solutions. My proficiency lies in extracting and processing diverse data sources to derive meaningful Key Performance Indicators (KPIs) for comprehensive reporting and advanced statistical analysis. I excel in PySpark and Spark SQL (Python), and I also possess a strong command of SCALA Spark on both Databricks and Cloudera platforms.In addition, I am well-versed in harnessing the power of AWS services, including EMR, S3, EC2, SQS, Kinesis, and Redshift, to deliver seamless cloud-based solutions. My extensive experience within the Cloudera Hadoop ecosystem encompasses the skillful use of tools like Sqoop, HDFS, and YARN, alongside proficient utilization of data analysis platforms like Hive and Impala. Show less

  • Senior Data Engineer

    Apr 2021 - Oct 2021

  • Senior Data Engineer

    Mar 2020 - Mar 2021

  • Data Engineer

    Jan 2014 - Feb 2020
• 

  PwC Acceleration Centers

  Oct 2021 - now

  Senior Data Engineer

  Experienced Big Data Engineer adept at designing and implementing robust Data Lake solutions. Proficient in extracting and processing diverse data sources to derive meaningful KPIs for reporting and advanced statistical analysis. Expertise lies in PySpark and Spark SQL (Python), with additional proficiency in SCALA Spark on both Databricks and Cloudera platforms. Well-versed in leveraging AWS services including EMR, S3, EC2, SQS, Kinesis, and Redshift for seamless cloud-based solutions. Extensive experience within the Cloudera Hadoop ecosystem, utilizing tools like Sqoop, HDFS, YARN, as well as data analysis platforms like Hive and Impala. Proven track record in multi-cloud environments, spanning AWS, Azure, and GCP. Passionate about leading dynamic teams in tackling challenging Spark-driven Machine Learning and AI projects. Aspire to transition towards the Data Analytics and Data Science domain, leveraging my extensive background to drive impactful insights and innovations. Show less