Analyst firm Gartner has projected that the growth of the big data market will generate 4.4 million jobs in the IT sector by 2015.
According to Gartner senior vice president and global head of research Peter Sondergaard, this boost in demand may be accompanied by a lack of qualified candidates to fill the growing field of big data.
"There is not enough talent in the industry. Our public and private education systems are failing us. Therefore, only one-third of the IT jobs will be filled. Data experts will be a scarce, valuable commodity," Sondergaard said at the Gartner Symposium ITxpo.
"IT leaders will need immediate focus on how their organisation develops and attracts the skills required. These jobs will be needed to grow your business. These jobs are the future of the new information economy."
Sondergaard says the key to finding qualified big data workers will be finding people who can create quality predictive algorithms.
"You need to understand how to deal with hybrid data, meaning the combination of structured and unstructured data, and how you shine a light on ‘dark data.' Dark data is the data being collected, but going unused despite its value," continued Sondergaard.
"Leading organisations of the future will be distinguished by the quality of their predictive algorithms. This is the [chief financial officer] challenge, and opportunity."
In a recent interview, Oracle president Mark Hurd also warned of the challenges of the growing big data market. Hurd told The Times the world is drowning in vast amounts of data.
According to Hurd data in the wild will grow 35 to 40 percent a year. The former HP executive says that with the onslaught of mobile web devices companies are beginning to struggle to keep up with big data.
"Data is growing exponentially," he said. "This is causing big problems for our customers and tremendous economic pressure. Most of our customers are trying to innovate while cutting costs."
Hurd's latest comments come after a recent interview with V3 where Hurd called much big data "worthless".
In fear of future shortage - or in preparation for its own electric car project?
New Spectre microcode patches released by Intel to fix security flaws in Skylake, Kaby Lake and Coffee Lake CPUs
But if you're running anything older you'll have to wait
Powered by servers based on Qualcomm's scalable 48-core Centriq 2400 10nm CPUs
Malware has been in circulation for more than a year