Questions tagged [optimization]

Optimization is the process of modifying a system to make some aspect of it work more efficiently or use fewer resources.

A system may be optimized so that it executes more rapidly, or is capable of operating with less memory storage or other resources, or draw less power. The optimized system will typically only be optimal in one application or for one audience. For example, one might reduce the amount of time a task takes to perform at the price of making it consume more memory.

339 questions
46
votes
7 answers

Why rsync is faster than NFS?

Few days ago I noticed something rather odd (at least for me). I ran rsync copying the same data and deleting it afterwards to NFS mount, called /nfs_mount/TEST. This /nfs_mount/TEST is hosted/exported from nfs_server-eth1. The MTU on both network…
grs
  • 2,235
  • 6
  • 28
  • 36
30
votes
3 answers

Optimal values for ServerLimit, MaxClients, MaxRequestsPerChild directives

I'm running a traffic intense site plenty of dynamic content, mostly user-generated. The server is a dedicated one and has a total of 4 Intel(R) Xeon(R) CPU X3210 @ 2.13GHz proccesors. I need to know to optimal values for ServerLimit and MaxClients…
andreszs
  • 709
  • 1
  • 6
  • 16
29
votes
5 answers

What configuration options for MySQL provide the biggest speed improvements?

What configuration options for MySQL provide the biggest speed improvements? I'm wondering about actual configuration file improvements, table types, hardware setups, replication, etc. Anything other than the query structure and table structure…
Darryl Hein
  • 1,662
  • 2
  • 19
  • 21
28
votes
3 answers

Maximizing rsync performance and throughput - directly-connected gigabit servers

I have two Dell R515 servers running CentOS 6.5, with one of the broadcom NICs in each directly attached to the other. I use the direct link to push backups from the main server in the pair to the secondary every night using rsync over…
dyasny
  • 18,482
  • 6
  • 48
  • 63
27
votes
7 answers

Options to efficiently synchronize 1 million files with remote servers?

At a company I work for we have such a thing called "playlists" which are small files ~100-300 bytes each. There's about a million of them. About 100,000 of them get changed every hour. These playlists need to be uploaded to 10 other remote servers…
Zilvinas
  • 383
  • 1
  • 4
  • 8
25
votes
3 answers

How to determine the best byte size for the dd command

I know that doing a dd if=/dev/hda of=/dev/hdb does a deep hard drive copy. I've heard that people have been able to speed up the process by increasing the number of bytes that are read and written at a time (default: 512) with the bs option. My…
James T
  • 545
  • 1
  • 4
  • 9
22
votes
7 answers

How many files in a directory is too many? (Downloading data from net)

Greetings, I'm writing some scripts to process images from various photo websites. Right now I'm storing all this data in individual text files in the same directory. The directory is web accessible. An end user makes a call to a web service which…
steve
  • 505
  • 1
  • 6
  • 10
20
votes
2 answers

IIS 7.5 optimizations for a site serving only static content

I'm looking to setup a cookie-free domain intended to serve static content for a web application, similar to the http://sstatic.net/ site that the stack exchange sites use. My question is, what optimizations can I make to my IIS 7.5 setup for such a…
DanP
  • 303
  • 1
  • 3
  • 8
18
votes
3 answers

Building a 1,000M row MySQL table

This question is reposted from Stack Overflow based on a suggestion in the comments, apologies for the duplication. Questions Question 1: as the size of the database table gets larger how can I tune MySQL to increase the speed of the LOAD DATA…
Ben
  • 283
  • 2
  • 6
17
votes
6 answers

Optimize apache/php/mysql running on VPS for heavy load

Question about optimizing an apache/mysql server on a VPS with 512m of RAM. Under normal load everything runs fast, no connection lag. However when we get our heavy traffic days (50k+ visits) the site crawls and it takes 30 seconds+ to get content…
Parrots
  • 285
  • 1
  • 3
  • 7
15
votes
5 answers

How to minimise SpamAssassin (spamd) memory use

I'm using SpamAssassin on Debian (the default configuration with Pyzor, AWL and Bayes disabled, and sa-compile enabled), and each of the spamd child processes consume around 100 to 150MB of memory (around 50MB of real memory) on the 32 bit servers,…
Tony Meyer
  • 889
  • 1
  • 13
  • 25
14
votes
6 answers

First days online : how not to kill your site

Suppose you have this fancy new site, with lots of data (like big images), and you're about to put it online. If you do "too much" publicity, during the first days, the site will be overwhelmed with requests. How can I mitigate this risk ? I've…
mathieu
  • 335
  • 3
  • 9
13
votes
1 answer

How to disable keys in MySQL InnoDB tables?

Is it possible to disable keys in InnoDB tables? If yes, how? If not, why?
user12145
  • 1,075
  • 6
  • 26
  • 47
12
votes
2 answers

Nginx auto minify html output

does anyone know of a way to get nginx (or any other method) to minify html output on the fly? It seems straightforward to me and can shave a few kb off and help speed up the site.
Trazx
  • 135
  • 1
  • 1
  • 6
10
votes
2 answers

Linux Slow Start: Changing ip route does not have any effect on initial window

I changed the tcp initial window in my machine to 10 as shown below [user@site etc]$ sudo ip route change default via 17.255.209.1 dev eth0 proto static initcwnd 10 And changed tcp_slow_start_after_idle as shown below [user@site etc]$ sudo…
Quintin Par
  • 4,293
  • 10
  • 46
  • 72
1
2 3
22 23