How to pull huge table (80 millions rows) from Oracle into SQL DB or SQL dump via VPN

1

I have the task to pull a huge table from an Oracle DB into a SQL DB or SQL dump via the internet. The source DB (Oracle) is in an enterprise setting which I access via Cisco VPN (Split tunneling is not allowed).

I have tried a tool from Intelligent Converters: Progress is very slow, which seems to be a latency issue (84MB in 8 hours pulled), at this rate I need more than 60 days.

The table itself is extremely simple (no no views, storage produceres, no indexes, identities etc.). Options are restricted by the VPN that does not allow split tunneling: The moment the connection stands no internet connection is present on the connected machine, I therefore need physical access.

Matthias

Posted 2011-08-02T09:23:51.877

Reputation: 13

2why not create a database dump using expdp, compress it and then transfer via scp? – Sathyajith Bhat – 2011-08-02T09:45:02.263

Answers

0

Why not create a database dump using expdp, compress it using bzip2 / gzip and then transfer via scp?

I'm assuming Oracle is hosted on a *nix based OS

Sathyajith Bhat

Posted 2011-08-02T09:23:51.877

Reputation: 58 436

expdp can only be imported by another Oracle database, so you'd need to do remote oracle export, compress, scp, local oracle import, copy from local oracle to local SQL (I guess SQL Server) – Gary – 2011-08-02T23:47:05.247

0

Try to experiment on Oracle TCP related parameters Nagle algorithm (TCP_NODELAY).

You can also adjust sending/receiving data buffer (SDU/TDU/RECV_BUF_SIZE/SEND_BUF_SIZE) in tnsnames.ora or on OS level.

ibre5041

Posted 2011-08-02T09:23:51.877

Reputation: 113