2
I've been working with Excel for quite a while for some statistical analysis that I do regularly. The size of the data that I'm working with has gotten much larger as of late, however. The layout of the databases in question is quite simple, usually just three rows which includes a UNIX timestamp, and EST value, a proprietary numeric value and finally an average of the rows that have a timestamp +/- 1000 that row's timestamp (little AVERAGEIFS()
formula). That formula and the EST conversion are the only formulas in the sheet.
I'm beginning to work with files with 500,000+ rows. Running the average formula down the entire row takes forever. The end result is the production of print-worthy graphs. I'm looking for either a UNIX CL utility or separate spreadsheet/database application that can handle this amount of data without melting my CPU or making me wait an hour. Is there anything out there?
TL;DR: Simple excel sheet with over half a million rows is getting too slow to work with. OS X alternatives?
Your similar question answered in SO: http://stackoverflow.com/a/11387240/1248931
– andy holaday – 2012-07-09T00:28:38.710Please don't waste our time with questions in two areas. Ask it in one. If that turns out to be the wrong place, flag it and ask a moderator to migrate it. – Julian Knight – 2012-07-09T13:08:18.743
@JulianKnight If you looked at the specifics of either question, they're inherently different. Thank you for the suggestion however. – Peter Kazazes – 2012-07-10T01:09:54.443
Hmm, I did look at the other question but in reality, the answers certainly seem to be related. I just think it would have been better to have just one single question like this answered first and then to follow up with another question if further clarification was required or a slightly different question needed. – Julian Knight – 2012-07-10T14:21:53.367