I have a little stupid question, but i'm really stucked. We have two pfsense in different location. In first location we have LAN net 10.200.1.0/24 with gateway 10.200.1.1. In second location we have LAN net 10.200.40.0/24 with gateway 10.200.40.3.
All time we used OpenVPN static connect and all worked fine, but recently we got dedicated canal between two location. I'm try to setting routing, like this: Static route to 10.200.40.0/24 through GW 10.200.1.1. Static route to 10.200.1.0/24 through GW 10.200.40.3.
Okay, it work, but... not good. We have a traceroute like this: From 10.200.1.13 => 10.200.1.1 => 10.200.40.51- looks good, but the network was unstable - especially with TCP-connections. And iperf(for speed test) show like this:
[ ID] Interval > Transfer Bandwidth
[ 4] 0.00-1.00 sec 256 KBytes 2.09 > Mbits/sec
[ 4] 1.00-2.00 sec 0.00 Bytes 0.00 bits/sec
[ 4] 2.00-3.00 sec 0.00 Bytes 0.00 bits/sec
[ 4] 3.00-4.00 sec 0.00 Bytes 0.00 bits/sec
etc.
After i add on local computer 10.200.1.30 route like:
route add 10.200.40.0 255.255.255.0 10.200.40.3
Everything began to work perfectly, iperf show this(with the same settings):
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-1.00 sec 66.5 MBytes 558 Mbits/sec
[ 4] 1.00-2.00 sec 68.5 MBytes 574 Mbits/sec
[ 4] 2.00-3.00 sec 68.0 MBytes 571 Mbits/sec
[ 4] 3.00-4.00 sec 69.6 MBytes 584 Mbits/sec
[ 4] 4.00-5.00 sec 46.0 MBytes 386 Mbits/sec
[ 4] 5.00-5.24 sec 16.2 MBytes 562 Mbits/sec
And now i'm stucked - how i can push all traffic from 1.0 for 40.0 subnet through remote GW, not for each machine? And vice versa - from 40.0 to 1.0:) I can't add GW to interface LAN - i get "The gateway address 10.200.40.3 does not lie within one of the chosen interface's subnets.".
Please, help! Thank you in advance!
UPD: Oh, sorry, it's very simple scheme - i'm just took this infrastructure without any docs. If you need get more info - please, tell me. Thanks!