Seeking to expand adoption of its Data Lakehouse technology, Dremio flipped the switch for its Cloud Lakehouse service and launched a new query engine and data management software that bolsters the capabilities of the new platform.

The Dremio Cloud Lake House, originally unveiled in July 2021, is now generally available in a free standard edition, according to the Santa Clara, Calif.-based company. A commercial enterprise edition provides advanced security controls, including custom roles and enterprise identity providers, as well as enterprise support options.

Dremio also launched Dremio Sonar, a new version of the company’s SQL query engine that powers the Cloud Lakehouse system, and provides a preview of Dremio Arctic, a new metadata and data management service that will work with Dremio Cloud.

[Related:

Dremio Looks To Recruit, Enable SI And Consultant Partners With Dremio Looks To Recruit, Enable SI And Consultant Partners With Channel Program LaunchChannel Program Launch

]

“We believe that to truly experience the data lakehouse paradigm, you have to do it in production, at scale,” said Tomer Shiran, co-founder and chief product officer of Dremio, talking about the free edition of Dremio Cloud. in an interview with CRN. .

“Now with all these new features in Sonar and with what we’re doing with Arctic – which is way beyond what you could ever do with a [data] warehouse – it gives people the chance to experience a data lakehouse [as] best approach from a business perspective,” Shiran said.

Dremio is one of a growing number of big data companies promoting data lakehouses as an alternative to traditional data warehouse systems. In January, Dremio raised $160 million in Series E funding, bringing its valuation to $2 billion.

The new Dremio Cloud enables data analysts, data engineers and data scientists to exploit huge volumes of data for business analysis and other tasks. The native cloud service is based on the Dremio SQL Data Lake platform, which includes a query acceleration engine and semantic layer, and works directly with cloud storage systems.

“Dremio Cloud is the world’s first Lakehouse platform that was built from the ground up for SQL workloads, including mission-critical BI,” Dremio CEO Billy Bosworth said in a statement. “In the past, companies had to weigh the pros and cons of data lakes versus data warehouses. We’ve eliminated that trade-off by providing a frictionless, infinitely scalable service that delivers the combined benefits of both.

Data analysts, data engineers, and data scientists can use Dremio Cloud to quickly access the growing volumes of data businesses and organizations work with today. Dremio Cloud provides two-way query functionality with business analytics tools such as Tableau and Microsoft Power BI.

The fully managed service currently runs on the Amazon Web Services cloud platform with plans to make it available on Microsoft Azure and the Google Cloud Platform later this year, Shiran said.

Dremio Sonar is an update of the SQL Lakehouse query engine, the company’s core technology, which businesses and organizations use to perform business intelligence tasks – from ad hoc queries to dashboards and reports to low latency – running on Lakehouse stored data.

Sonar is based on the open source Apache Iceberg table format for analytical datasets (originally developed by Netflix and Apple) and the open source Apache Arrow columnar memory data format. Sonar is more than twice as fast as the previous generation of the product, according to Shiran, and can insert, update and delete records directly on a lake thanks to its SQL Data Manipulation Language (DML) support.

“It basically puts all the data warehouse functionality on a data lake,” Shiran said. “You don’t need a data warehouse anymore.”

Dremio Arctic is a data and metadata management service designed to provide data engineers and data scientists with what Dremio calls a “Git-like” experience, similar to code versioning and change management capabilities. enjoyed by developers with the Git system. Arctic is based on the open source Project Nessie transactional catalog technology.

“It automatically optimizes the data in a data lake,” Shiran said, citing previously manual tasks such as data partitioning and file size management that consume data engineers time.

Dremio Sonar is available now and comes free with Dremio Cloud. Dremio Arctic is in preview

“Tableau is committed to making data and analytics technologies more powerful, easier to use, and integrated into the flow of business. New single sign-on connectivity with Dremio Sonar and Arctic allows analysts to explore and view current, historical and experimental data snapshots on cloud data lakes, without having to create and maintain countless copies of data, which will help to get information faster. said Brian Matsubara, vice president of global technology alliances at Tableau, a Dremio technology partner, in a statement.

Dremio Cloud, Sonar and Arctic will also create opportunities for Dremio systems integrator and consulting partners who design and implement data lakehouse systems for their customers and build applications and services that run on them. Shiran said.

“It’s a big advantage for channel partners because they can get up and running with a data lake much faster and easier,” he said, citing Dremio Cloud’s time-to-value advantage. “They don’t have to develop all that infrastructure-level expertise.”

Dremio Cloud and related software should also drive the adoption of open-source software in the software-as-a-service space, where it’s not as widely used as open-source downloaded software, Shiran said.

“It exposes users to the possibilities of open architectures” in cloud software, he said. “It’s really a big win for customers because when you think about a data lakehouse architecture, you want your data to be open.”