Over the next five to ten years, users will find it increasingly necessary to implement exploration warehouses and nearline storage to cut their data warehousing costs and make data analysis more efficient.
Putting all of an organisation’s data in traditional disk storage can be very expensive, but nearline storage, which includes photo optical or silo to tape storage, can cut expenses by an order of magnitude of one and a half to two, said Bill Inmon, widely known as the Father of the Relational Database, during his keynote speech at the Informix Information Portal user conference in San Diego this week.
“Data warehouses tend to separate into two different data categories. If you are dealing with 100-500Gb of data or more, you’ll find that the data starts to separate into actively and inactively used data. Only a fraction of it is used and the majority of that is used very infrequently, so paying the same for storing used and not used data doesn’t make sense,” he explained.
Nearline storage also enabled users to aggregate their data and made data warehousing “affordable,” he added.
“If you have a 10Gb data warehouse, you don’t need nearline storage, if you have a 100Gb one, ask yourself how fast it’s growing, and if you have a 500Gb one, get to know the vendors. If you have a 1,000Gb data warehouse and you don’t have nearline storage, you’re throwing money away. In five years, you won’t be able to afford to buy disk storage because that much hardware and software infrastructure will be totally unnecessary,” he said.
Users would also find that exploration warehouses became increasingly necessary to undertake unstructured queries in their data warehouses, Inmon continued.
The main database was not suitable for exploration processing because most customers could not take it offline for 72 hours to do a large query and the resource impact on it was too high.
IBM and Technical University of Munich team demonstrate how Shor's algorithm, which can't be cracked by conventional computers, can be solved quickly with quantum computing
Hubble Space Telescope finds superflares from young red dwarfs could strip away planetary atmosphere
Younger stars are 100 to 1,000 times more energetic than when they're older
Two of the big four supermarkets will use the system to control sales of restricted products
PUBG news and updates: November's Update #23 to bring new Skorpion pistol and changes to blue zone visibility
Genuinely useful side-arm coming to PUBG in Update #23