All the latest UK technology news, reviews and analysis


EMC boosts Hadoop with Pivotal HD rollout

26 Feb 2013
Big data

EMC has introduced a push to integrate its Greenplum products with Hadoop databases in a next-generation big data platform.

The company said that the effort, dubbed Pivotal HD, would deliver a 10 times performance gain over current Hadoop distributions.

The platform will combine Hadoop unstructured database tools with Greenplum massive parallel processing (MPP.) That system, dubbed Hawq, will be based on the Hadoop distributed files system (HDFS) and will seek to expand the performance ceiling in big data systems.

Scott Yara, Greenplum co-founder and vice president of products, said that the Hawq platform was an effort to put to use years of smaller projects Greenplum has been working on.

"What we thought is: what would be possible if we put together all this deep technology that we have developed over the past years?" he said.

The project is part of a Pivotal HD system which the company hopes will be the most powerful Hadoop distribution ever. The company said that in some cases, Pivotal HD performs up to 100 times better than current-generation Hadoop big data systems.

Pivotal HD will serve as the basis for a larger effort by Greenplum and its parent company EMC in the big data sector. EMC has in the past sought to establish itself among the leading firms in the development of new big data platforms and initiatives.

Yara said that the company hopes its efforts will help to build big data tools which can carry through the next decade.

"It is about a once-in-a-generation change in entire data fabrics," Yara said.

"It is the foundation for the next 10 years of computing in and around the data industry."

  • Comment  
  • Tweet  
  • Google plus  
  • Facebook  
  • LinkedIn  
  • Stumble Upon  
Shaun Nichols
About

Shaun Nichols is the US correspondent for V3.co.uk. He has been with the company since 2006, originally joining as a news intern at the site's San Francisco offices.

More on Databases
What do you think?
blog comments powered by Disqus
Poll

Work location poll - office, remote or home?

Where do you spend most time working on your primary work device?
70%
6%
0%
0%
24%
0%

Popular Threads

Powered by Disqus
LG G Flex 2 hands-on review

CES 2015: LG G Flex 2 video

A closer look at LG's latest curved-screen smartphone

Updating your subscription status Loading
Newsletters

Get the latest news (daily or weekly) direct to your inbox with V3 newsletters.

newsletter sign-up button
mubaloo2

Beacon technology: what are the opportunities and how does the technology work?

This paper seeks to provide education and technical insight to beacons, in addition to providing insight to Apple's iBeacon specification

ibmv3may

Converting big data and analytics insights into results

Successful leaders are infusing analytics throughout their organisations to drive smarter decisions, enable faster actions and optimise outcomes

IT Security Analyst (Cyber, Wireshark, SIEM)

IT Security Analyst (Cyber, Wireshark, SIEM) Why apply...

Systems Operations Supervisor

Our Client is seeking an Operations Systems Analyst/Supervisor...

Project Manager / Technical Project Manager - (Prince 2, ERP, MS Project, ISO, PPI)

Project Manager / Technical Project Manager - (Prince...

Software QA Tester - No.1 Online Video Gaming Tech Provider

Software QA Tester - No.1 Online Video Gaming Tech Provider...
To send to more than one email address, simply separate each address with a comma.