jujarayk

This project involves companywide initiative focused on providing consistent, easy-to-understand, and easy-to-use experiences that empower our customers to view and control their personal data, which builds customer trust and strengthens the relationship between our customers and Microsoft. Responsibilities: • Developing the PySpark code to enhance the performance of the NGP. • Convert previously built logics in C# to PySpark code. • Troubleshooting and fixing issues related to spark code, Spark Optimization. • Consume data from Azure Data Explorer and develop Power BI dashboards. • Developed multiple dashboards like asset compliance ,agent health etc for NGP Microsoft. • Optimization of report. Impact: Optimized report are currently in use with Microsoft, where clients use these reports to track their agents.

Description: This project involves Integrated data and digital cloud ready platform. Atum verse BSP Regulatory reporting platform is a part of the Atum verse central bank reporting suite. It is the most compressive regulatory reporting platform that is built to provide automated, on-time, and error-free submission. Responsibilities: • Designing and implementing the ETL process for extracting data from RDBMS source using Sqoop. • Developing the spark code to perform L2 transformations on the data and populate it in the mart tables in Hive. • Design of Hive tables for Neutral Staging. • Troubleshooting and fixing issues related to spark code, Spark Optimization, Hive Optimization. • Developed multiple dashboards for Atum-Verse and maintaining Power BI dashboards. Project: Query validator. Technology/Language/Tool used: Python, Postgre SQL, PyCharm Description: Developed script to validate multiple queries and log the invalid queries to text file. Impact: Query validator is currently used in the organization to validate SQL queries. Project: Atum-Verse Data streaming. Technology/Language/Tool used: Apache Nifi, Apache Spark, Postgre SQL, Power BI Description: This project was a POC I was responsible for understanding the Business problem, collect the data and filter out the irrelevant data and apply the transformations, continuous integration of streaming data to mart (Database). Developed dashboard using composite models.