Google has taken its Cloud Dataflow and Cloud Pub/Sub services out of beta, making them generally available for customers looking to build cloud-based data processing systems that can scale to meet changes in demand.
Joining the already available BigQuery service on the Google Cloud Platform, Cloud Dataflow and Cloud Pub/Sub are being offered as fully managed services aimed at removing the operational burden of traditional data processing systems, enabling customers to build applications that can scale with the growth of a business while driving down data processing latency, Google said.
Cloud Dataflow offers a unified programming model for ingesting data from batch and streamed data sources, while Cloud Pub/Sub is a messaging system designed to connect applications and services, whether they're hosted on Google Cloud Platform or on-premise. Both have been in beta since earlier this year.
Cloud Dataflow provides access to a fault-tolerant and highly available service for batch and stream processing, backed by service level agreements. It also offers a comprehensive model for balancing correctness, latency and cost when dealing with large volumes of unordered data.
Meanwhile, Cloud Pub/Sub is designed to connect a customer's services to each other, to other Google services, and to those of third parties. It can also be used to analyse big data streams in real time, according to Google.
"Traditional approaches require separate queueing, notification and logging systems, each with their own APIs and trade-offs between durability, availability and scalability. Cloud Pub/Sub addresses a broad range of scenarios with a single API, a managed service that eliminates those trade-offs and remains cost-effective as you grow," said Eric Schmidt, Google's programme manager for Cloud Pub/Sub, writing on the Cloud Platform blog.
Cloud Pub/Sub clocked up delivery rates of up to one million message operations per second during the beta test period, Google claimed, and is now being offered with prices as low as $0.05 per million message operations for sustained use.
Google said that general availability of the two services is part of the firm's ongoing efforts to help developers and businesses benefit from Google's technical and operational expertise in big data.
Latest Tesla news: Tesla share price continues to fall after Saudi Arabia's sovereign wealth fund is linked to investment in rival
SEC 'probe' takes its toll on Tesla as new research suggests that Tesla loses $6,000 on every $35,000 Model 3
RTX 280 Ti will come with 11GB of fast GDDR6 video RAM with a 352-bit memory bus offering 616Gbps
The scale of jobs lost to automation will be at least as large as those in the first three industrial revolutions
10nm Cannon Lake Core i3-8121U CPUs make a rare outing with Intel's NUC mini PC