Server Fault Stack Exchange
Server Fault Stack Exchange

Questions tagged [csv]

Comma Separated Values is a tabular to store data

Comma Separated Values is a tabular to store data in plain text. There is no single CSV format, but in general there are 4 principles:

  • are plain text files (basically, this means numeric, graphical, or other values are expressed using printable characters rather than various-sized groups of bits),
  • consists of records (typically one per line),
  • with the records divided into fields that are separated by delimiters (typically a single reserved character such as comma or TAB, or sometimes any sequence of spaces and tabs),
  • where every record includes exactly the same sequence of fields (this is very occasionally violated).

Source: wikipedia

75 questions
47
votes
5 answers

How to export result of a MySQL query using phpMyAdmin 3.4.3?

I've got a 30K row table When I run a long, 50-line query on that table, a GROUP function reduces the number of rows to 7K I want to export the grouped 7K rows as a new table, or save them as a CSV When I attempt to export, instead of getting the…
grape
  • 471
  • 1
  • 4
  • 3
29
votes
3 answers

How does one list warnings from the 'mysqlimport' utility?

To start off, this is not about loading data from within MySQL itself, but using the command-line tool "mysqlimport". I am using it to load a CSV directly into a table and need to see the warnings it has generated. I cannot seem to get warnings to…
brink
  • 293
  • 1
  • 3
  • 5
14
votes
5 answers

Install ssconvert (part of gnumeric) on a server without GNOME

I need to use gnumeric's file conversion tool ssconvert on a server. The problem is that gnumeric is a gnome application and can't be installed without a desktop installed. There is also no separate packages for ssconvert, and I can not compile it…
Martin Taleski
  • 363
  • 3
  • 5
  • 14
9
votes
9 answers

How to store 3 million records in key value format?

We have to store basic information about 3 million products. Currently the info is one 180 mb CSV which gets updated quarterly. There will be about 30,000 queries per day, but the queries are just a very simple key value store. We only need to…
Phil
  • 105
  • 1
  • 5
7
votes
2 answers

Import a 260GB csv file into MySQL

I have a really big csv ~260GB and I want to import it into MySQL. I use the following mysql script in MacOS DROP TABLE IF EXISTS tmp_catpath_5; create table tmp_catpath_5( a1 BIGINT(20),a2 BIGINT(20),a3 BIGINT(20),a4 BIGINT(20),a5 BIGINT(20), …
jimkont
  • 173
  • 1
  • 6
6
votes
1 answer

mongoexport csv output array values

I'm using mongoexport to export some collections into CSV files, however when I try to target fields which are members of an array I cannot get it to export correctly. command I'm using: mongoexport -d db -c collection -fieldFile fields.txt --csv >…
9point6
  • 175
  • 1
  • 1
  • 6
5
votes
3 answers

How to Split a Huge CSV File in Linux?

I have 60TB of data that resides in 12 csv files. The data will be loaded into a clustered database where the loading processes is single threaded. In order to improve my load performance I need to initiate a load process from each node. So far…
Up_One
  • 150
  • 1
  • 5
5
votes
4 answers

MS SQL Server 2008: How to export all the tables into CSV?

I have to migrate from MS SQL Server and now creating a new ORACLE database with the data partially got from my old tables. For that I need to get the data from dozens of tables as unicode CSV or TXT files, with fields separated by "|". The bad…
Andrew
  • 321
  • 3
  • 5
  • 11
5
votes
1 answer

Loading large CSV into Postgres

I'm trying to load a CSV of about 100M records (around 8GB on disk) into Postgres via the copy command: copy mytable from 'path/to/myfile.csv' with CSV; I have been monitoring the progress by checking the reported table size in pgAdmin and comparing…
G__
  • 294
  • 2
  • 9
4
votes
9 answers

Convert a CSV file to a XLS file on the linux command line?

I'm using Debian Linux and I want to convert a CSV file to an Excel XLS Spreadsheet file. The catdoc package includes the xls2csv command that converts from XLS to CSV. However it doesn't do the reverse. Since I just have a CSV file, I don't care…
Amandasaurus
  • 30,211
  • 62
  • 184
  • 246
4
votes
1 answer

Powershell script to import CSV to AD

In attempts to automate a few things, I've come across a stumbling block with an import script for AD. A part of the script contains: New-ADUser -Name $Name –GivenName $Person.givenName –Surname $Person.sn –DisplayName $Name –SamAccountName…
Cold T
  • 2,391
  • 2
  • 16
  • 28
4
votes
2 answers

export proper csv from SqlServer management studio query result

in SqlServer management studio, you can export query results to a csv file by right click -> "Save Results as" -> csv. However, the csv file does not contain column headers and does not escape any commas in the data itself, which often leads to a…
Gabe Moothart
  • 153
  • 1
  • 1
  • 5
3
votes
1 answer

PowerShell Exporting to CSV / Workflow?

When the server is ping'd the resulting address is compared to an inventory for purposes of keeping the inventory up to date. I'm trying to tack on the result as "good" or "bad" in the next corresponding cell over. It sort of works except the result…
evenyougreg
  • 85
  • 1
  • 6
3
votes
1 answer

import list of pcs using import-Csv and change attribute using powershell script

Im trying to write a powershell script to change attribute called "comment" in a list of pcs using csv and import-Csv. Here is my script $computers=Import-Csv -Path "C:\sds.csv" foreach ($item in $computers){ Set-ADComputer -identity…
user879
  • 269
  • 2
  • 6
  • 21
3
votes
2 answers

Performance of Cluster Shared Volume file copy from SAN

I am hoping someone can help me out with a strange issue. We are running a Microsoft Failover Cluster with Server 2008 R2 and an Equallogic PS4000 SAN. Our main configuration has 2 Dell Poweredge T710 Servers in the cluster. We have CSV and Quorm…
Sequenzia
  • 181
  • 2
  • 6
1
2 3 4 5