This Week in Databend #120

Databend is a modern cloud data warehouse, serving your massive-scale analytics needs at low cost and complexity. Open source alternative to Snowflake. Also available in the cloud: https://app.databend.com .

What's New

Stay informed about the latest features of Databend.

Managing Storage Access with CONNECTION

Databend now offers preliminary support for

CONNECTION

The following example creates a connection to store access credentials for S3 object storage and creates an external stage using that connection:

CREATE CONNECTION my_conn storage_type = 's3' access_key_id ='minioadmin' secret_access_key ='minioadmin' endpoint_url='${STORAGE_S3_ENDPOINT_URL}';
CREATE STAGE my_stage url= 's3://testbucket/admin/tempdata/' connection = (connection_name='my_conn');

If you want to learn more, please feel free to contact the Databend team, or check out the resources listed below.

• PR #13709 | feat: use self-defined connection.
• PR #13714 | feat: mask connection values in CreateConnection and AttachTable.

Code Corner

Discover some fascinating code snippets or projects that showcase our work or learning journey.

opensrv v0.5.0 Released

OpenSRV v0.5.0 was released this week, primarily focusing on updating upstream dependencies to address security audit issues. The code quality has also been further improved according to clippy's suggestions.

If you need MySQL or ClickHouse server protocol support for database projects, consider opensrv.

• opensrv v0.5.0

Highlights

We have also made these improvements to Databend that we hope you will find helpful:

• Introduced

  @>
  
  and

  <@
  
  JSON operators.
• Added support for evaluating UDF calls using the Async Transform Pipeline.
• Added support for LATERAL FLATTEN.
• Enhanced RBAC with the support for secondary roles.
• The Databend documentation repository has been relocated to databend-docs.

What's Up Next

We're always open to cutting-edge technologies and innovative ideas. You're more than welcome to join the community and bring them to Databend.

Summary Support for Dry Run of VACCUUM TABLE

The

VACUUM TABLE

Databend provides a DRY RUN option for

VACUUM TABLE

We plan to enhance the DRY RUN option by adding a summary, allowing you to check the size of data files to be freed before vacuuming.

Issue #13674 | feat: vacuum table dry run summary

Please let us know if you're interested in contributing to this feature, or pick up a good first issue at https://link.databend.com/i-m-feeling-lucky to get started.

Changelog

You can check the changelog of Databend Nightly for details about our latest developments.

Full Changelog: https://github.com/databendlabs/databend/compare/v1.2.206-nightly...v1.2.216-nightly