Simulate high traffic using data from log files

Question

I need to test a saas service load by sending 1000s requests/sec from multiple remote sources. The urls need to be from my access log.

Is there a service that can simulate high traffic using the data from my log files?

your going to need to write a script that parses the logs, and the use something like wget or curl to do the http requests. You can run them in parallel with some scripting too. send the logs i may be able to do it for you. — The Unix Janitor, Nov 16 '11 at 22:39
@user37899 post that as an answer (possibly along with the script) and get yourself some free rep :-) — voretaq7, Nov 16 '11 at 22:47

score 3 · Accepted Answer · answered Nov 17 '11 at 05:16

3

You can replay a log with httperf

answered Nov 17 '11 at 05:16

ckliborn

Thanks, I'm doing that currently but I want to do it from multiple sources to simulate real life better. – Niro Nov 17 '11 at 06:24

score 2 · Answer 2 · edited Sep 01 '12 at 14:59

2

edited Sep 01 '12 at 14:59

Kenny Rasschaert

answered Aug 02 '12 at 23:50

sellerjd

score 1 · Answer 3 · answered Nov 17 '11 at 08:08

1

Apachebench ("ab") can read urls from files, but you'd have to process the access logs first.

Check out these for distributed testing:

answered Nov 17 '11 at 08:08

AndreasM

3 Answers3