Questions tagged [benchmark]

Benchmarking is the process of gathering data about the performance of a system in different scenarios to measure the impact of changes to the system, to compare the system with other options, or to determine maximum capacity.

Benchmarking is the process of gathering data about the performance of a system in different scenarios to measure the impact of changes to the system, to compare the system with other options, or to determine maximum capacity.

Benchmarking is a multidisciplinary process and can require management, engineering, operations, data science. and user experience expertise.

A key concern when benchmarking is making sure the tests performed are analogous to how to system is actually used. When benchmarking a server, the following metrics may be considered (in addition to countless others):

  • Ping response time
  • Average Load
  • Number of Dropped Requests
  • Number of Concurrent Connections Possible
  • Power Consumption
271 questions
6
votes
3 answers

IOMeter - What values should I test with?

In some ways I guess this is a piece of string question, however even if there is a "this fits most situations" answer I have no idea what it is, so... I have a SAN on evaluation, an HP P4000. I'd like to use IOMeter to do some benchmarking to see…
flooble
  • 2,364
  • 7
  • 28
  • 32
5
votes
1 answer

Root-causing vastly different performance on iozone O_SYNC benchmark for two HDD manufacturers

I have two servers A and B with the following configuration: A: 4TB HDDs, with RAID 1 (MegaRAID SAS 2008), 128MB cache, no BBU, write-through mode, 7.2k RPM, manufacturer A. B: 1.5TB HDDs, with RAID 1 (MegaRAID SAS 3108), 64MB cache, with BBU, but…
Vimal
  • 153
  • 4
5
votes
2 answers

Is Amazon EC2 reliable for benchmarking?

I've been rethinking the compiler shootout and I began to wonder: is Amazon EC suitable for benchmarking? The environment is totally virtual, so are there any guarantees that benchmarking results will be repeatable? Or should I assume that the…
jldugger
  • 14,122
  • 19
  • 73
  • 129
5
votes
1 answer

How can I measure complex I/O activity to develop realistic benchmarking?

I need to retrieve a few metric from my service server to benchmark another stroage solution. There are various options are provied by benchmark program(I choosed FIO,http://freecode.com/projects/fio). I could easily set up io pattern with it. But I…
jinhwan
  • 183
  • 5
5
votes
2 answers

Does LXC container performance depends of host load?

I am wondering if LXC could offer a full isolated benchmarking environment. Let's say we have 2 identical machines, with the same fresh Linux and without network connection. First machine has a load average of 50 and second one only 1. I put the…
5
votes
1 answer

Apache 2.4: mod_php vs php-fpm performance

There are plenty of old benchmarks on Apache mod_php vs nginx with php-fpm However, with version 2.4, Apache can use php-fpm. Are there any sensible benchmarks comparing mod_php with php-fpm (both on Apache 2.4.x)?
OC2PS
  • 539
  • 2
  • 8
  • 21
5
votes
3 answers

Tools to Benchmark VMware Datastore

Is there a tool that can be used to determine the maximum IOPS on my Datastores? Due to the way the SAN is configured (poorly by the installer) it's difficult to calculate this and we want to know where the ceiling is. It looks like we have lots…
Scott Keck-Warren
  • 1,670
  • 1
  • 14
  • 23
5
votes
2 answers

Apache ab: choosing number of concurrent connections

I can't find anything that specifically elucidates the number of concurrent connections that are reasonable - nor can I find any treatises or research on this topic. The boss says "The server needs to handle 50,000 concurrent users - so measure with…
Mei
  • 4,560
  • 8
  • 44
  • 53
5
votes
5 answers

is there anyway to know if your supposedly fully dedicated server is really a virtually resource-shared machine?

sometimes I feel my server not responding as smoothly as I would expect (i have a Intel(R) Xeon(TM) CPU 2.80GHz Quad Core), given that for example, the 'top' commands reports a low load < 0.5, CPU are almost completely idle ... I maybe have internet…
arod
  • 542
  • 6
  • 19
4
votes
1 answer

How can I verify my vserver provider offers SSD as promised?

For this month I have rented two vServer, each from a different provider. Both indicated that the disks of the system use SSD technology (making me expect a bandwidth of at least 300MB/s and maybe more, as I know from experience in my…
4
votes
1 answer

Apache ab - testing with 1000 concurrency

I am just trying to gather some information on server capacity and ran these apache ab test. I tested with 1, 10, 100, 1000 concurrency over 1 minute. The result below is for 1000 concurrent users I am using this benchmark script -…
TigerTiger
  • 306
  • 4
  • 6
4
votes
1 answer

How to circumvent siege concurrency socket select timed out

Being trying to test load capacity of a web site. I am using an aws ubuntu xenial server t2.micro as test client and have SIEGE 3.0.8 and apache benchmark Version 2.3 while ab -c 100 -n 100000 url completes without an issue thes on the other hand…
black sensei
  • 609
  • 3
  • 8
  • 25
4
votes
1 answer

NVMe drives write performance in software RAID 1

We have just received two brand new Supermicro servers 1028U-TN10RT+ with 10 NVMe slots, two of them with Intel DC P3600 800gb hard drives. We were eager to test the performance of the drives as the specification is promising very good read (up to…
markz
  • 173
  • 1
  • 4
4
votes
1 answer

"Hot data" and erasure coding: how to know if it is efficiently handled?

It is well known that erasure coding adds extra complexity because of encoding and decoding operations. Due to this drawback, most of cloud services recommend to use data replication for hot data and erasure coding for cold data. For example, from…
denaitre
  • 88
  • 5
4
votes
1 answer

How to have proper expectations about AWS performance?

I'm in the process of moving a webapp from the local server that's been its development home to somewhere else for eventual deployment. I'm currently evaluating AWS and Rackspace, and am in the middle of trying the site out on AWS. I've tried to…
Jim Miller
  • 713
  • 2
  • 11
  • 23
1 2
3
18 19