Announcing the release of Starburst Enterprise Platform (SEP) 462-e.1 LTS. This long-term support (LTS) release continues Starburst’s commitment to introducing features and improvements designed to enhance the capabilities, efficiency, and user experience of the Starburst Open Data Lakehouse. This release focuses on moving key capabilities previously announced as public preview to being generally available while also enabling our customers to benefit from all of the innovation happening in the Trino community. Let’s dive into the significant features of this release, their use cases, and the benefits they bring to your data and analytics initiatives.
Now Generally Available
Query result caching in SEP leverages an industry standard method to improve performance. SEP now has the ability to store the outcome of a query in S3 compatible storage for a set period of time, allowing the system to retrieve pre-computed results instead of processing the same query again. This mechanism significantly reduces query processing time by eliminating redundant computations, as SEP can simply fetch results from the cache rather than re-executing the entire query. Users and applications experience dramatically faster response times, system administrators enjoy reduced computational load and resource usage, and organizations save on processing costs since cached results require fewer computing resources than repeated query executions.
Schema discovery in SEP identifies and registers tables and views that are newly added to a known schema location. This allows users to find the newly added files generated by external engines to make sure SEP knows how to query them. A use case that would benefit from schema discovery would be one where a logging process might drop a new log file every hour, rolling over from the previous hour’s log file. With this feature, SEP will be able to find and query these new files.
Additional capabilities
In addition to the performance and discoverability capabilities going to general availability, there is also a new capability that we are eager to announce now in public preview.
Workload management allows users to seamlessly create, adjust, and monitor resource group query admission and concurrency without the need to restart the cluster. By organizing queries into groups, a sysadmin can manage each group independently with appropriate limits set to control the overall query workloads of the cluster. Organizations that experience high query concurrency could benefit from this feature to ensure that one group is not overtaking the cluster with query loads.
A nod to the future
There have been major developments happening in the Trino community since the previous LTS, all of which aim to reduce dependencies on older systems and have Trino remain on the bleeding edge of innovation. Starburst, as the Trino company, offers our customers all the benefits of the Trino query engine with the added value of a platform and support surrounding it. Thus, the 462-e.1 LTS includes the following…
Trino introduced the new AWS, Google, and Azure native file system support that removes legacy hadoop dependencies. This allows Starburst to focus on building new features on top of native file system functionality, rather than retrofit new functionality into the legacy hadoop-based support.
Starting with 462-e, Starburst now bundles the JDK dependency intoSEP artifacts. Starburst will regularly update to run on the latest JDK version, benefitting from the newest updates and performance improvements offered by Java. With the JDK bundling Starburst customers no longer need to manage their own Java dependencies in their environment before deploying Starburst Enterprise.
Summary
The Starburst Enterprise 462-e.1 LTS release is representative of our continued commitment to bringing necessary and forward-looking enhancements to Starburst Enterprise, and a step forward in our journey to provide the most advanced and user-friendly data analytics platform for your open data lakehouse. These features not only enhance the technical capabilities of Starburst Enterprise but also provide tangible business benefits, from improved data discoverability and Java support to increased efficiency and performance.
These are just some of the highlights that have made it into this quarterly LTS release. Read the 462-e.1 LTS release notes for a complete list of features and changes. Contact us to learn more.
