Novel data storage system ready to offer relief for frustrated users, companies

Purdue University innovators have developed a solution to help cut down loading wait times and provide more efficient data storage options for corporations of all sizes. The researchers developed a novel data storage and computer technology system.

"Most organizations rely on something called erasure coding to reduce data storage costs," said Vaneet Aggarwal, an associate professor of industrial engineering in Purdue's College of Engineering. "The rapid growth of streaming and e-commerce has stressed underlying data storage systems. A key solution to relieving this traffic burden has been caching, which basically involves a computer memory storing popular chunks of data so they can be retrieved quickly."

Chunks of popular data can be stored separately closer to end users, reducing congestion in the network and improving delay times. Among stored data, Aggarwal said, 20% of the content may be accessed 80% of the time, so establishing a priority on this data improves functionality significantly.

The Purdue team developed a novel caching framework with an algorithm that optimizes caching across a distributed storage system, which improves performance by splitting data across multiple physical servers.