Data Mining Solution for a FinTech Company 

IT innovation has had a tremendous impact on the world of financial operations. Financial Technology or FinTech has become a separate field of IT that works to improve and automate the use and delivery of financial services. The field has become so large that a new FinTech software is released every other day making it very difficult for products to gain a stable position on the market.  

Thus, having a long experience in this industry and a very promising idea for data mining, a large English FinTech company decided not to risk providing a hasty solution built using some off-the-shelf technologies. Instead, it engaged Agiliway experts to develop a complex, stable and scalable BI solution that would be flexible enough to cater to the needs of various users and thus, ensure sustainable growth for the company. Join our discussion of the case to find out details of the developed solution.     

Background  

The FinTech company had a long background of cooperation with large banks. In particular, the company helped financial institutions monitor how various departments and employees use documents and statistics in the decision-making process. Such services have great value for banks allowing them to assess the effectiveness of the staff and to make informed decisions in what sources of information to invest.    

Considering the demand for the services, the FinTech company wanted to develop a stable, reliable and scalable BI solution that would present the information on the flow and usage of data in the convenient for data mining way. It was planned to further market the solution as a SaaS.  

Project Challenges  

The major demands to the solution were  

• Effective mining of huge amount of data. a BI solution had to provide visualization of huge amounts of data on information usage stored in MS SQL database.   
• Flexibility and scalability. The available data visualization technologies such as Tableau did not allow to implement the specific logic of the project. Thus, it was necessary to develop a complex solution that could be customized to the diverse needs of end users.     
• Elaborate security management.  The work of banks and other financial institutions has always been associated with elevated demands to confidentiality and security. It was necessary to make sure the bank will be able to control who does data mining and monitor what data users access.  
• Dynamic work with the data. Users had to be able to aggregate, mine, group or regroup the data on the fly using interactive reports and charts.   

Provided Solution  

Agiliway has a strong experience in BI and big data and successfully employs various JavaScript frameworks  for development of complex interactive solutions (we have recently shared the insights into the solutions for car tracking and choosing of workout venues and classes with our readers). To meet the challenges of this project, we have built a platform using MS.NET and MS SQL databases to implement API for the back-end and front-end ReactJS application for visualization of data analysis.  

We have used D3.js, a Java Script library for manipulating documents based on data, to allow dynamic and interactive charts. This allows users analyze data from a different point of view or using different parameters simply dragging a particular node on a chart. Specifically, the charts may be used to visualize the following analyses of bid data:    

1. What and how many nodes served the input sources of information for a chosen node and for what sources the node has been further used;  
2. How often or when a particular source of information is used, for example at what period of a day/week/year, at what stage of decision making;  
3. How the use of the node relates to its price; 
4. What departments normally use a particular node in their work. 

To effectively address security concerns, Agiliway experts have implemented a robust user management and security system, which allows management of user rights and tracking of logs. This way, only authorized users can engage in data mining and the logs show what data they accessed and when.  

A well-thought UI effectively complements the visualization and facilitates analysis. For example, when hovering over the node with a mouse, a user can see the details on it pop up directly in the chart. The nodes are visualized using different colors so that users can easily determine the type of information source (e.g. application, database, FTP, email, Excel file, etc.).   

Value Delivered  

Owning a flexible, highly performing, scalable, and secure platform developed by Agiliway, the FinTech company has firmly established on the market and demonstrates a sustainable growth of its revenues. The developed BI data mining solution is successfully employed by many financial institutions to assess the effectiveness of their employees and calculate ROI for their sources of information. Being particularly satisfied with the cooperation, the Fintech company continues using support of our experts to add even more features to the solution. Meanwhile, Agiliway is looking forward to meeting new challenges and sharing details of new exciting cases.