23

Support S3 compatible object storage like Wasabi

  • Released

Avatar
Team TreeSize

Add support for S3 compatible object store like:

  • Wasabi
  • Dell EMC ECS
  • Digital Ocean Spaces

Estimated: V9.3

A

Activity Newest / Oldest

Avatar

Team TreeSize

The feature is now finally released. For the support of path style, I opened a new feature request hat is now open for voting: jam-software.upvoty.com/b/treesize/support-path-style-for-aws-s3-and-compatible-object-store


Avatar

Team TreeSize

Status changed to: Released

Avatar

Team TreeSize

We now have a beta version ready that comes with support for S3 compatible object store. All customers with active maintenance can simply install it over their existing version. Here is the download link:
jamsoftwaregmbh.sharepoint.com/:u:/t/Fileshare/EYLjacKHD4RIkHyqDOrxagMBuksWafJfyai9yz-FuHQcfQ?e=x3j08f

When using the "Add scan" button on the top left, there is now a new option "S3 compatible" on the S3 page, which allow you to additionally specify an endpoint.


Avatar

Team TreeSize

Did anyone of the voters have the chance to test scanning S3 compatible object store? We appreciate any kind of feedback, positive or negative.


Avatar

Haagen Waade

I did try it now, but I encountered an issue, since our on-prem s3 is not configured with virtual host but uses path style adressing model, ref:
stackoverflow.com/questions/47755043/what-is-difference-between-aws-s3-virtual-hosted-style-url-v-s-path-style-url
And seems the beta take for granted the use of virtual host style since its adding the bucket name in front of the endpoint


Avatar

Team TreeSize

Since Amazon deprecated the path style addressing model in 2020, we decided to support only the virtual host style in the first step. We'll see what other uses give as feedback.

Do you plan to stick with the path style addressing model in the future?


Avatar

Haagen Waade

Im not in control over the on-prem setup, but have asked the admin if they could consider supporting virtual host style.
Even if Amazon depricated in 2020 (but are still supporting it for old setups), I suspect many are still using path style, since its simpler to setup.
It would have been nice to have the option.


J

Juampa

I hope you will contemplate as soon as possible the possibility of including in TreeSize Professional the access to S3 compatible. We have a NetApp StorageGrid S3 and it would be very helpful if Treesize could give us information. For us it is essential.


Avatar

Team TreeSize

Merged with: S3 Netapp StorageGrid support

J

Juampa

Good;
Perfect, as soon as you have it available, let us know and we will make testers.


Avatar

Team UltraSearch

We had some technical issues and I'm sorry to say that this feature won't make it in V9.2. But we will provide a prerelease with this feature included here shortly.


J

Juampa

Good;
Perfect, as soon as you have it available, let us know and we will make testers.


J

Juampa

Good morning.
Can you tell me when the 9.2 and especially if it is contemplated to support the NetApp S3 (StorageGrid).


Avatar

Juan Pablo Moreno

Add NetApp StorageGrid


  • Avatar
J

Juampa

Good morning.
We have a NetApp StorageGrid (S3). It would be very interesting to be able to use treesize with the tenants of this S3.
Is this possible?


  • Avatar
Avatar

Team SpaceObServer

Merged with: Treesize of Netapp StorageGrid

Avatar

Team TreeSize

Status changed to: In progress

Avatar

Team TreeSize

Status changed to: Planned

Avatar

Jerry Langland

Strongly support. Having AWS and Azure scanning has basically doubled the value of TSP to me, which, admittedly was a hard thing to do. But adding S3 compatibility opens TSP up to the rest of the Cloud.
BackBlaze, Minio, Wasabi, IDrive e2 and dozens if not hundreds of other services. S3 is the defacto standard for cloud storage on the Internet used or supported by almost everyone not named MS or Google. It should be fairly simple, rather than using the AWS endpoint locaters, just take an endpoint given to you by the user and go to town.


Avatar

Haagen Waade

Agree too! Should not be too much change than add the possibility to configure your own endpoint? 3 years without much activity doesnt look good :(


S

Scott

totally agree! I'd absolutely love it if TreeSize could support these endpoints. Ceph-S3 is another example.


A

I agree I would also like to see this. example, Backblaze B2 has S3 compatible storage. Applications like MINIO can provide an S3 compatible layer on any server storage too.