Questions tagged [database-performance]

185 questions
39
votes
18 answers

Poor internal database - replace it or chuck hardware at it?

So - we have an internal company database, the usual kind of stuff: manages clients, phone calls, sales deals and client agreements/schemes. It's an Access 2000 front-end, and an SQL Server 2000 Standard back-end. Single server, dual Xeon 3.2GHz,…
tomfanning
  • 3,308
  • 6
  • 33
  • 34
16
votes
2 answers

How to calculate max_connections for PostgreSQL and default_pool_size for pgbouncer?

Is there a rule or something I can use to calculate a good number for max_connections, default_pool_size and max_client_conn? The defaults are odd. PostgreSQL defaults to max_connections=100 while pgbouncer defaults to default_pool_size=20.…
14
votes
6 answers

SQL Server Express for Production Databases?

We are about to roll out a dual web/internal transactional application where each client has their own database. Each database is very small - under 50MB each, so we were wondering if it would make sense to use SQL Express 2008 instead of the full…
Beep beep
  • 1,843
  • 2
  • 18
  • 33
14
votes
1 answer

Do I need to REINDEX and VACUUM a table after deleting lots of rows?

I am running a PostgreSQL database that has several tables which store logging information. This information is for reporting purposes only and gets dumped to a file and deleted from the database if older than 30 days. There can be millions of rows…
cowgod
  • 3,460
  • 6
  • 27
  • 20
13
votes
2 answers

Is there a MySQL performance benchmark to measure the impact of utf8_unicode_ci versus utf8_general_ci?

I read here and there that using the utf8_unicode_ci collation ensures a better treatment of unicode text (for example, it knowns how to expand characters such as 'œ' into 'oe' for searching and ordering) compared to the default utf8_general_ci…
MiniQuark
  • 3,695
  • 2
  • 20
  • 23
11
votes
3 answers

Too much I/O generated by postgres stats collector process

I am using XenServer with several virtual machines having local postgres databases. Even when all applications are unused and the databases are idle, each vm causes constant storage network traffic which degrades the performance of the iscsi storage…
nn4l
  • 1,336
  • 5
  • 22
  • 40
10
votes
3 answers

Importance of location of installation of Microsoft SQL Server

I have a server with cheap slow disk and an expensive fast disk. I want to use the expensive disk for all the things where it's important that it's fast, such as my databases. To save money, I want to use the slow disk for anything where it doesn't…
10
votes
1 answer

Mysql showing 100% CPU usage

I'm experiencing some problems with my MYSQL server installed with Cpanel. My server is showing 100% usage of mysql even if I don't have too much traffic on web. I am running CentOS 6.5x64 with 80GB SSD & 8GB Ram with 4CPU…
Rahukaal
  • 139
  • 1
  • 1
  • 4
9
votes
2 answers

How well does PostgreSQL perform with a large number of databases?

We have an web application whose architecture requires that any registered user (a company, actually) should be isolated from the other, i.e., I'll run the same webapp with the same data models, but with different data sets for every customer. So,…
8
votes
1 answer

Maintenance of tables: do I need to REINDEX a table after truncating and repopulating?

I have a table with about 2 million rows in it of transactional data that we use for analytics. Every week we reload this with new data, so we've been using TRUNCATE to clear it out and then inserting new rows. There are a couple of indexes on the…
JamesF
  • 195
  • 1
  • 2
  • 5
7
votes
1 answer

Understanding IXSCAN and COLLSCAN in MongoDB logs

I'm attempting to grep through some Mongo logs in an attempt to find slow operations that I need to optimize. Slow query logging is at the default and is logging operations over 100ms. I think that it's safe to say that generally speaking a…
Antonius Bloch
  • 4,480
  • 6
  • 28
  • 41
7
votes
3 answers

How to improve AWS RDS Performance - Heavy read write updates

After searching and reading as many posts, comments and discussions I could find I did not find one specific to my issue. I have multiple AWS EC2 deployments with a single RDS all in the same Delivery zone us-west-2(c) I am testing the load of the…
7
votes
4 answers

postgreSQL vs Cassandra vs MongoDB vs Voldemort?

Which database to decide upon? Any comparisions? Existing: postgresql Issues Not easily scalable horizontal. Needs sharding etc Clustering does not solve the data growth problem Looking for: Any database that is easily horizontally scalable …
6
votes
1 answer

Bad performance for a large join query in PostgreSQL 8.4.4, despite enough memory to cache entirely

Question How can I make the query described in this post faster, in particular by making PostgreSQL using the available RAM? - Note that I have tried to configure effective_cache_size and shared_buffers appropriately. See below. Background I have to…
ehsanul
  • 427
  • 1
  • 8
  • 19
5
votes
1 answer

What does "GC (Allocation Failure)" mean in my ElasticSearch 5.6 logs?

I see these constantly in my Elasticsearch 5.6.3 logs. Is this a signal that I should scale up and add more RAM? Or is this just normal operations for ElasticSearch? [GC (Allocation Failure) [ParNew Desired survivor size 11141120 bytes, new…
1
2 3
12 13