wget (or curl) the entire contents of a forum thread?

Question

The url of the forum thread I'm trying to get access to is in the form

http://domain.com/showthread.php?threadid=3333333&userid=0&perpage=40&pagenumber=1

I've tried

wget --user-agent=Mozilla/5.0 -k -m -E -p -np -R http://domain/showthread.php?noseen=0&threadid=3333333&pagenumber=1

and I've had no luck.

Answer 1

Why not just in a for loop:

for pageno in {1..1000000}; do
    wget ... http://domain/showthread.php?noseen=0&threadid=3333333&pagenumber=$pageno || break
done

or perhaps a while loop is better, if a little longer to write:

i=1
while true; do
    wget ... http://domain/showthread.php?noseen=0&threadid=3333333&pagenumber=$pageno
    if test $? -ne 0; then
        break
    fi
    i=$((i+1))
done

Answer 2

Might be worth checking if the forum supports rss feeds of sections / threads. It'd save you bother.