Is there any way to download the values of a public DB (ASP.NET) to hard drive?

I'm a social science researcher, and I'm working with data from various public databases of NGO, government, etc. Let's assume that I've got no opportunity to ask the admins for the whole database. However, if I have enough patience, I'm able to download all the data one-by-one. But the size of the DB makes it almost impossible solving the problem with brute-force.

So, is there any way to download a public DB with all of it's components?

Here's an example: http://www.trademap.org/tradestat/Country_SelProductCountry_TS.aspx

You can see the Japanese Live animal import (USD) by the importing countries. Is there a faster way to download all the data for every country and products as well than clicking them one-by-one?

Thank you in advance.

Übel Yildmar

Posted 2016-09-09T10:08:28.910

Reputation: 149

What is possible depends on the public API, since you can't access the database directly, and run a query on the data. – Ramhound – 2016-09-09T13:44:36.623

Answers

I think the best option you have is to download the Excel file it produces.

Then use that file and upload/insert to your database.

Another option would be screen scraping but probably not worth the hassle since they provide you with the Excel file any way

Dave

Posted 2016-09-09T10:08:28.910

Reputation: 24 199

It looks like the site you mentioned uses an ASP.NET ValueState.

Check out this answer for more information on how to decrypt it.

https://stackoverflow.com/questions/1350216/what-does-the-viewstate-hold

Jay M

Posted 2016-09-09T10:08:28.910

Reputation: 203

Thank you! They don't mention: what should I do after I've decoded the ViewState? – Übel Yildmar – 2016-09-09T14:33:28.267