Google has taken its Cloud Dataflow and Cloud Pub/Sub services out of beta, making them generally available for customers looking to build cloud-based data processing systems that can scale to meet changes in demand.
Joining the already available BigQuery service on the Google Cloud Platform, Cloud Dataflow and Cloud Pub/Sub are being offered as fully managed services aimed at removing the operational burden of traditional data processing systems, enabling customers to build applications that can scale with the growth of a business while driving down data processing latency, Google said.
Cloud Dataflow offers a unified programming model for ingesting data from batch and streamed data sources, while Cloud Pub/Sub is a messaging system designed to connect applications and services, whether they're hosted on Google Cloud Platform or on-premise. Both have been in beta since earlier this year.
Cloud Dataflow provides access to a fault-tolerant and highly available service for batch and stream processing, backed by service level agreements. It also offers a comprehensive model for balancing correctness, latency and cost when dealing with large volumes of unordered data.
Meanwhile, Cloud Pub/Sub is designed to connect a customer's services to each other, to other Google services, and to those of third parties. It can also be used to analyse big data streams in real time, according to Google.
"Traditional approaches require separate queueing, notification and logging systems, each with their own APIs and trade-offs between durability, availability and scalability. Cloud Pub/Sub addresses a broad range of scenarios with a single API, a managed service that eliminates those trade-offs and remains cost-effective as you grow," said Eric Schmidt, Google's programme manager for Cloud Pub/Sub, writing on the Cloud Platform blog.
Cloud Pub/Sub clocked up delivery rates of up to one million message operations per second during the beta test period, Google claimed, and is now being offered with prices as low as $0.05 per million message operations for sustained use.
Google said that general availability of the two services is part of the firm's ongoing efforts to help developers and businesses benefit from Google's technical and operational expertise in big data.
Pixel 2 smartphones and a Pixel-branded laptop also planned by Google
The moment you've all been waiting for...
Are you on the list?
Update will limit background activities of apps to improve battery life (hello, Skype!)