Questions tagged [object-storage]
10 questions
2
votes
2 answers
Deploy Minio distributed on 3 nodes with 1 drive
I need to deploy a MinIO infrastructure on three nodes, where each nodes has a single local directory where they can save files in.
I read the MinIO Erasure Code Quickstart Guide, but I don't need MinIO to manage data replication on different local…
Mat
- 1,783
- 4
- 22
- 39
1
vote
0 answers
Use NGINX as a reverse proxy for Object storage to serve WEBP conditionally
I'm using a location config like this in Nginx for serving WEBP when the user supports it
map $http_accept $webp_suffix {
default "";
"~*webp" ".webp";
}
server {
#...
location ~* \.(?:jpg|jpeg|png|webp)$…
erfan
- 11
- 2
0
votes
0 answers
How suitable is a S3 backend for rsync operations?
I run a large server providing open source software (https://ftp.halifax.rwth-aachen.de), currently serving more than 30 TByte of data with Multi-Gigabit throughput. Data is synchronized and kept up-to-date using rsync, i.e. synchronizing the data…
C-Otto
- 294
- 5
- 16
0
votes
0 answers
OpenStack Object Storage (swift) - Large files multipart upload fails
When uploading files larger than 100GB, at the stage of multipart-manifest validation, we get 404 error for some segments that were previously uploaded successfully. As a result, the client receives a 400 response. Uploading a large file is not…
0
votes
1 answer
Object Storage vs HDD Block Storage
Currently I am using SSD Block Storage at Digital Ocean which is very costly. When I checked Vultr they are providing HDD Block Storage. Which is cheap.
We have to store approx 700GB of data (Mostly images) and serve them on websites.
Should we use…
Future King
- 133
- 1
- 6
0
votes
1 answer
cannot Delete objects on s3 ceph bucket
I have a ceph cluster and running a few s3 bucket on it, 'gitlab-s3-api' user has full permission on everything on ( users=;buckets=;metadata=;usage=;zone=* ) but very oddly it cannot delete any file on its own bucket.
{
"user_id":…
AliReza NaSRi
- 11
- 2
0
votes
1 answer
Ceph Cluster - Reduced data availability: 96 pgs inactive And All OSD Nodes Are Down
I set up my Ceph Cluster by following this document. I have one Manager Node, one Monitor Node, and three OSD Nodes. The problem is that right after I finished setting up the cluster, the ceph health returned HEALTH_OK for all three nodes. However,…
Shaghayegh Tavakoli
- 101
- 2
0
votes
1 answer
How can each OpenStack Swift object-storage container be set up with a different password/key in a standard way?
I'd like to have many storage buckets, each with its own password or key for read & write access for use by end users.
Some options I've discovered:
ACLs: These work on a per-OpenStack-user basis. I don't think it makes sense to create a new…
colan
- 500
- 5
- 9
0
votes
1 answer
Experience with using Openstack Swift with s3fs multi user access?
Does anyone have experience with using Openstack Swift object storage with s3fs and having multiple write mounts accessing the same file(s) at the same time?
The man page for s3, for example: https://linux.die.net/man/1/s3fs has this…
mlum
- 1
0
votes
1 answer
How does an object store write objects to disk
In an object storage solution, how is the object data actually written to the underlying storage volumes? i.e. In what format is it written? Does it use an intermediate file system, or does it access the block storage directly? Or is it different…
swami
- 145
- 4