Streamlio, an intelligent platform for fast data, has announced the release of Apache Pulsar 2.0. Apache Pulsar is a distributed pub-sub messaging system that is open source. It was originally created at Yahoo and is now part of the Apache Software Foundation (ASF) (undergoing incubation). Apache Pulsar is at the core of the Streamlio platform. Streamlio combines open-source messaging, processing, and storage technologies to provide a platform for processing streaming data in real-time.
The latest release of Apache Pulsar includes the general availability of Pulsar Functions which are lightweight, stream-native compute processes. Using the Pulsar Functions API, developers can create and manage processing logic for the Apache Pulsar messaging system.
The release also includes several new enhancements including Schema Registry and Topic Compaction. Schema Registry is a new feature that allows developers to specify the structure of the data using the Pulsar REST API or the message producer. Topic Compaction is a new Pulsar enhancement that allows users to trigger Topic Compaction manually via a REST endpoint.
“This is an important milestone demonstrating the maturity and continued innovation of the Apache Pulsar solution,” said Matteo Merli, co-founder of Streamlio and the architect and lead developer of Pulsar while at Yahoo, in a prepared statement. “Designed from day one to deliver unmatched performance, scalability, and operational simplicity, Pulsar provides the enterprise-class technology needed to enable companies to move beyond the limits of traditional batch-centric approaches to the data-driven future where they can immediately process and act on fast-moving data as quickly as it arrives.”
More information about the Apache Pulsar 2.0 release is available on the Streamlio website.