Quantum-Inspired Optimization Techniques for Big Data Warehousing and Real-Time Predictive Analytics

Abstract

Modern businesses are facing more and more challenges in terms of Big Data warehousing and real-time data analytics due to the sheer volume of growing data. Traditional optimization techniques are increasingly ineffective when working with high-dimensional datasets, thus creating delays in resource allocation and query processing. Since there is a growing demand for faster solutions for data analytics, it is necessary to find new methods for solving optimization issues. In this respect, new emerging quantum-inspired computing techniques allow solving complex optimization problems by employing the principles of quantum mechanics—superposition and probability exploration. To enhance the performance of systems used for predictive analytics and data warehousing, a quantum-inspired optimization framework is proposed. This approach involves incorporating quantum-inspired techniques such as simulations of quantum annealing processes into frameworks used for distributed processing, thus resulting in the improvement of the areas of data indexing, query execution paths and load balancing of computers. The data processing machines are improved due to the advancements in feature selection and attainment of results in a faster way. Evaluation of the method on the big datasets showed that the query performance, and the accuracy of prediction is higher than that demonstrated by conventional techniques, and the architecture is efficient and can be scaled for processing the workloads for real-time analytics.