Questions tagged [sharding]
54 questions
9
votes
3 answers
Run a MongoDB configuration server without 3GB of journal files
For a production sharded MongoDB installation we need 3 configuration servers.
According to the documentation "the config server mongod process is fairly lightweight and can be ran on machines performing other work". However, in the default…
![](../../users/profiles/16018.webp)
Thilo
- 240
- 1
- 2
- 9
7
votes
4 answers
postgreSQL vs Cassandra vs MongoDB vs Voldemort?
Which database to decide upon? Any comparisions?
Existing: postgresql
Issues
Not easily scalable horizontal. Needs sharding etc
Clustering does not solve the data growth problem
Looking for: Any database that is easily horizontally scalable
…
![](../../users/profiles/26161.webp)
Ram on Rails React Native
- 209
- 2
- 5
6
votes
2 answers
Mongo Sharding - Config Server and Mongo Authentication
I am needing to shard a database fairly soon, and am unclear on what the best practice is for enabling authentication on the mongos and config servers.
I would like to have everything be secured with passwords.
Should each config server have auth…
![](../../users/profiles/206925.webp)
nakkor
- 163
- 1
- 4
5
votes
1 answer
Upgrading a mongo cluster
I am looking at adopting a Mongo cluster and am doing research. We hope to have a cluster that can scale from 10k updates per second to 100k updates per second with very write heavy traffic.
The primary question is, If we wanted to move to a newer…
![](../../users/profiles/86295.webp)
EnabrenTane
- 255
- 1
- 2
- 7
4
votes
1 answer
MongoDB sharding: mongos and config servers together?
We want to create a MongoDB shard (v. 2.4). The official documentation recommends to have 3 config servers.
However, the policies of our company won't allow us to get 3 extra servers for this purpose. Since we have already 3 application servers (1…
![](../../users/profiles/112260.webp)
Pablo Torrecilla
- 77
- 1
- 11
4
votes
1 answer
What's the advantage of splitting a mysql table into smaller ones without physical distribution?
I've seen such design in my company.
A big mysql table is split into tens of smaller ones of identical schema on the same server in the same db, without any physical distribution, no innodb_file_per_table, no partitioning, etc. The data is…
![](../../users/profiles/59395.webp)
Arrix
- 225
- 1
- 5
3
votes
2 answers
Nosql autoscaling of compute
Most of the nosql autoscaling faces issue due to the fact the data have to be migrated during peak load. What if data is stored in a shared storage like CLVM which has less overhead(compared to NFS or shared file system). Now if each bucket/shard is…
![](../../users/profiles/149322.webp)
kalyan
- 229
- 1
- 2
- 11
3
votes
1 answer
When and how should we shard MongoDB when we are bound to physical machines?
We maintain a search service that serves data from MongoDB. Our Mongo production instance is arranged in a 4 node replica set across four physical servers.
The database is comprised of several small collections and one large collection. The large…
![](../../users/profiles/290625.webp)
Chris M
- 31
- 1
- 4
3
votes
1 answer
What is the safest way to change MongoDB server structure?
I currently have a MongoDB replica set configured as such:
{
"_id" : "ahspy_mongo_set",
"version" : 13,
"members" : [
{
"_id" : 0,
"host" : "remotedatacenter.in.montreal.dns.com",
…
![](../../users/profiles/74435.webp)
Pierre
- 241
- 1
- 2
- 11
3
votes
3 answers
Is it OK to shard mongodb without replica set?
Lets say I have 4 database servers. I want to add them to the "shard" cluster.
That's it. No replica set, no nothing. Just 4 servers.
If I turn "journaling" on all of them, is it OK?
![](../../users/profiles/81082.webp)
Alex
- 8,111
- 24
- 71
- 99
2
votes
1 answer
Add new shard - always best?
In our setup, we currently have 3 shard set sharded cluster, each shard being a replica set of 3. Our writes are about to go up significantly to implement a new feature, and we know the extra data will be necessary. The nature of our writes are…
![](../../users/profiles/156246.webp)
tonyl7126
- 213
- 2
- 6
2
votes
1 answer
Mongodb Slave replication lag
We using standard mongo setup: 2 replicas + 1 arbiter.
Both replica servers use same AWS m1.medium with RAID10 EBS.
We experiencing constantly growing replication lag on secondary replica.
I tried to do full-resync, you can see it on graph, but it…
![](../../users/profiles/111739.webp)
Leonid Bugaev
- 143
- 5
2
votes
4 answers
Find busiest databases and tables on MySQL server
I have a busy MyMQL server with quite a few databases. I'm trying to figure out the best way to find the busiest databases (and tables) on the server so I can migrate them to a separate machine. What's the best way to go about this?
![](../../users/profiles/21008.webp)
erikcw
- 697
- 13
- 22
2
votes
1 answer
Mongos not using secondary for read in replica/sharding mongo setup
I have a Mongo DB setup of 4 DB (2 shards of 2 replica) and I noticed that the secondary servers of each shard is not being used for read queries. Both secondary servers received all inserts, updates and deletes from their master but when I look at…
![](../../users/profiles/74435.webp)
Pierre
- 241
- 1
- 2
- 11
2
votes
1 answer
How to scale out by elvolving from database partitions to sharding?
Say I have a MySQL table:
CREATE TABLE tweets (
tweet_id INT NOT NULL AUTO_INCREMENT,
author_id INT NOT NULL,
text CHAR(140) NOT NULL,
PRIMARY KEY (tweet_id)
)
PARTITION BY HASH(tweet_id)
PARTITIONS 12;
All is good. The table lives on a single…
![](../../users/profiles/10217.webp)
Continuation
- 3,050
- 5
- 29
- 38