IBM has used the US Supercomputing conference to announce details of a cloud storage architecture that it claims can convert terabytes of information into usable data twice as fast as rival systems.
The General Parallel File System-Shared Nothing Cluster won an award at the conference, and is best suited for cloud applications and data-intensive workloads such as digital media, data mining and financial analytics, the firm said.
Companies are increasingly performing analytics tasks on large data sets, but struggle to contain the information in limited storage facilities, according to IBM.
The cloud is the ideal solution for these storage pains, the company said, but requires some external assistance.
"Businesses are unable to keep up with the vast amounts of data generated on a daily basis," said Prasenjit Sarkar, master inventor of storage analytics and resiliency at IBM's Almaden research centre.
"We constantly research and develop the industry's most advanced storage technologies to solve the world's biggest data problems. This new storage partitioning is another step forward as it gives faster time-to-insight without concern for traditional storage limitations."
The new storage architecture allows higher availability through the use of clustering, dynamic file system management and data replication tools.
This creates a distributed computing architecture where each node is independent and self-sufficient. Tasks are divided between nodes, and no piece is left waiting for another to finish its task, IBM explained.
IBM and Technical University of Munich team demonstrate how Shor's algorithm, which can't be cracked by conventional computers, can be solved quickly with quantum computing
Hubble Space Telescope finds superflares from young red dwarfs could strip away planetary atmosphere
Younger stars are 100 to 1,000 times more energetic than when they're older
Two of the big four supermarkets will use the system to control sales of restricted products
PUBG news and updates: November's Update #23 to bring new Skorpion pistol and changes to blue zone visibility
Genuinely useful side-arm coming to PUBG in Update #23