Google has taken its Cloud Dataflow and Cloud Pub/Sub services out of beta, making them generally available for customers looking to build cloud-based data processing systems that can scale to meet changes in demand.
Joining the already available BigQuery service on the Google Cloud Platform, Cloud Dataflow and Cloud Pub/Sub are being offered as fully managed services aimed at removing the operational burden of traditional data processing systems, enabling customers to build applications that can scale with the growth of a business while driving down data processing latency, Google said.
Cloud Dataflow offers a unified programming model for ingesting data from batch and streamed data sources, while Cloud Pub/Sub is a messaging system designed to connect applications and services, whether they're hosted on Google Cloud Platform or on-premise. Both have been in beta since earlier this year.
Cloud Dataflow provides access to a fault-tolerant and highly available service for batch and stream processing, backed by service level agreements. It also offers a comprehensive model for balancing correctness, latency and cost when dealing with large volumes of unordered data.
Meanwhile, Cloud Pub/Sub is designed to connect a customer's services to each other, to other Google services, and to those of third parties. It can also be used to analyse big data streams in real time, according to Google.
"Traditional approaches require separate queueing, notification and logging systems, each with their own APIs and trade-offs between durability, availability and scalability. Cloud Pub/Sub addresses a broad range of scenarios with a single API, a managed service that eliminates those trade-offs and remains cost-effective as you grow," said Eric Schmidt, Google's programme manager for Cloud Pub/Sub, writing on the Cloud Platform blog.
Cloud Pub/Sub clocked up delivery rates of up to one million message operations per second during the beta test period, Google claimed, and is now being offered with prices as low as $0.05 per million message operations for sustained use.
Google said that general availability of the two services is part of the firm's ongoing efforts to help developers and businesses benefit from Google's technical and operational expertise in big data.
Warming was most pronounced in Siberia region
The tank will be subjected to high stresses and loads via dozens of hydraulic cylinders during testing
'Sunlit wet sidewalk' provides evidence of methane rainfall on the north pole of Saturn's moon Titan
Methane rainfall indicates the start of the summer season in Titan's northern hemisphere
Scientists believe there could be other hydrides or superhydrides with super conducting properties