How do I truncate a csv file?A unix command to truncate each line of a filecsv file with multiple columns to zenityHow to select rows from a CSV file based on different column values?Simple efficient concatenation of CSV filesExtract data from csvRemove Columns from a CSV Filegenerate a csv fileSelecting rows in a CSV file based on column value that contains an embedded commaAdd lines at end of csvHow to concatenate several CSV files avoiding some lines at the beginning and in some at the end
Why does my electric oven present the option of 40A and 50A breakers?
Is there any Biblical Basis for 400 years of silence between Old and New Testament?
The most awesome army: 80 men left and 81 returned. Is it true?
Starting VLC from command line always puts the window behind other windows
Explain Ant-Man's "not it" scene from Avengers: Endgame
Scala list with same adjacent values
Are grass strips more dangerous than tarmac?
Creating Fictional Slavic Place Names
Singlequote and backslash
Is having a hidden directory under /etc safe?
Asking bank to reduce APR instead of increasing credit limit
Different PCB color ( is it different material? )
The qvolume of an integer
Is American Express widely accepted in France?
California: "For quality assurance, this phone call is being recorded"
Strange math syntax in old basic listing
What if you don't bring your credit card or debit for incidentals?
Rotated Position of Integers
What does the behaviour of water on the skin of an aircraft in flight tell us?
Are academic associations obliged to comply with the US government?
What are the problems in teaching guitar via Skype?
Why is Colorado so different politically from nearby states?
Self-Preservation: How to DM NPCs that Love Living?
The original word for a wild boar
How do I truncate a csv file?
A unix command to truncate each line of a filecsv file with multiple columns to zenityHow to select rows from a CSV file based on different column values?Simple efficient concatenation of CSV filesExtract data from csvRemove Columns from a CSV Filegenerate a csv fileSelecting rows in a CSV file based on column value that contains an embedded commaAdd lines at end of csvHow to concatenate several CSV files avoiding some lines at the beginning and in some at the end
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty margin-bottom:0;
I have a csv file that is 6 gigabytes, but I don't need that much data, I need like 100 rows or so. How can I truncate it?
csv
New contributor
add a comment |
I have a csv file that is 6 gigabytes, but I don't need that much data, I need like 100 rows or so. How can I truncate it?
csv
New contributor
@K7AAY, sorry, I have no idea, that would require me to download the whole thing from s3 and check, which will take a while.
– hey_you
8 hours ago
@K7AAY do csv files have 'n' at the end, should i just readline 100 times and write it to another file?
– hey_you
8 hours ago
Windows and DOS use carriage return and line feed ("rn") as a line ending, which Unix uses just line feed ("n").
– K7AAY
8 hours ago
add a comment |
I have a csv file that is 6 gigabytes, but I don't need that much data, I need like 100 rows or so. How can I truncate it?
csv
New contributor
I have a csv file that is 6 gigabytes, but I don't need that much data, I need like 100 rows or so. How can I truncate it?
csv
csv
New contributor
New contributor
New contributor
asked 8 hours ago
hey_youhey_you
1114
1114
New contributor
New contributor
@K7AAY, sorry, I have no idea, that would require me to download the whole thing from s3 and check, which will take a while.
– hey_you
8 hours ago
@K7AAY do csv files have 'n' at the end, should i just readline 100 times and write it to another file?
– hey_you
8 hours ago
Windows and DOS use carriage return and line feed ("rn") as a line ending, which Unix uses just line feed ("n").
– K7AAY
8 hours ago
add a comment |
@K7AAY, sorry, I have no idea, that would require me to download the whole thing from s3 and check, which will take a while.
– hey_you
8 hours ago
@K7AAY do csv files have 'n' at the end, should i just readline 100 times and write it to another file?
– hey_you
8 hours ago
Windows and DOS use carriage return and line feed ("rn") as a line ending, which Unix uses just line feed ("n").
– K7AAY
8 hours ago
@K7AAY, sorry, I have no idea, that would require me to download the whole thing from s3 and check, which will take a while.
– hey_you
8 hours ago
@K7AAY, sorry, I have no idea, that would require me to download the whole thing from s3 and check, which will take a while.
– hey_you
8 hours ago
@K7AAY do csv files have 'n' at the end, should i just readline 100 times and write it to another file?
– hey_you
8 hours ago
@K7AAY do csv files have 'n' at the end, should i just readline 100 times and write it to another file?
– hey_you
8 hours ago
Windows and DOS use carriage return and line feed ("rn") as a line ending, which Unix uses just line feed ("n").
– K7AAY
8 hours ago
Windows and DOS use carriage return and line feed ("rn") as a line ending, which Unix uses just line feed ("n").
– K7AAY
8 hours ago
add a comment |
2 Answers
2
active
oldest
votes
Depending on what you want you can:
Take the 1st 100 rows as suggested by @K7AAY.
head -n100 filename.csv > file100.csv
Take the last 100 rows
tail -n100 filename.csv > file100.csv
Take a random selection of 100 rows. This requires you have the GNU
shuf
program installed. It should be installable from your distribution's repositories if you're on Linux.shuf -n100 filename.csv > file100.csv
Alternatively, if your
sort
supports the-R
(random sort) option, you can do:sort -R filename.csv | head -n100 > file100.csv
add a comment |
Use head to display only the first 100 lines and direct them to a new file. Please substitute the current file name for filename.csv:
head -n100 filename.csv > file100.csv
add a comment |
Your Answer
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "106"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
hey_you is a new contributor. Be nice, and check out our Code of Conduct.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f521772%2fhow-do-i-truncate-a-csv-file%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
2 Answers
2
active
oldest
votes
2 Answers
2
active
oldest
votes
active
oldest
votes
active
oldest
votes
Depending on what you want you can:
Take the 1st 100 rows as suggested by @K7AAY.
head -n100 filename.csv > file100.csv
Take the last 100 rows
tail -n100 filename.csv > file100.csv
Take a random selection of 100 rows. This requires you have the GNU
shuf
program installed. It should be installable from your distribution's repositories if you're on Linux.shuf -n100 filename.csv > file100.csv
Alternatively, if your
sort
supports the-R
(random sort) option, you can do:sort -R filename.csv | head -n100 > file100.csv
add a comment |
Depending on what you want you can:
Take the 1st 100 rows as suggested by @K7AAY.
head -n100 filename.csv > file100.csv
Take the last 100 rows
tail -n100 filename.csv > file100.csv
Take a random selection of 100 rows. This requires you have the GNU
shuf
program installed. It should be installable from your distribution's repositories if you're on Linux.shuf -n100 filename.csv > file100.csv
Alternatively, if your
sort
supports the-R
(random sort) option, you can do:sort -R filename.csv | head -n100 > file100.csv
add a comment |
Depending on what you want you can:
Take the 1st 100 rows as suggested by @K7AAY.
head -n100 filename.csv > file100.csv
Take the last 100 rows
tail -n100 filename.csv > file100.csv
Take a random selection of 100 rows. This requires you have the GNU
shuf
program installed. It should be installable from your distribution's repositories if you're on Linux.shuf -n100 filename.csv > file100.csv
Alternatively, if your
sort
supports the-R
(random sort) option, you can do:sort -R filename.csv | head -n100 > file100.csv
Depending on what you want you can:
Take the 1st 100 rows as suggested by @K7AAY.
head -n100 filename.csv > file100.csv
Take the last 100 rows
tail -n100 filename.csv > file100.csv
Take a random selection of 100 rows. This requires you have the GNU
shuf
program installed. It should be installable from your distribution's repositories if you're on Linux.shuf -n100 filename.csv > file100.csv
Alternatively, if your
sort
supports the-R
(random sort) option, you can do:sort -R filename.csv | head -n100 > file100.csv
edited 6 hours ago
answered 8 hours ago
terdon♦terdon
136k33276457
136k33276457
add a comment |
add a comment |
Use head to display only the first 100 lines and direct them to a new file. Please substitute the current file name for filename.csv:
head -n100 filename.csv > file100.csv
add a comment |
Use head to display only the first 100 lines and direct them to a new file. Please substitute the current file name for filename.csv:
head -n100 filename.csv > file100.csv
add a comment |
Use head to display only the first 100 lines and direct them to a new file. Please substitute the current file name for filename.csv:
head -n100 filename.csv > file100.csv
Use head to display only the first 100 lines and direct them to a new file. Please substitute the current file name for filename.csv:
head -n100 filename.csv > file100.csv
edited 8 hours ago
answered 8 hours ago
K7AAYK7AAY
1,6041029
1,6041029
add a comment |
add a comment |
hey_you is a new contributor. Be nice, and check out our Code of Conduct.
hey_you is a new contributor. Be nice, and check out our Code of Conduct.
hey_you is a new contributor. Be nice, and check out our Code of Conduct.
hey_you is a new contributor. Be nice, and check out our Code of Conduct.
Thanks for contributing an answer to Unix & Linux Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f521772%2fhow-do-i-truncate-a-csv-file%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
@K7AAY, sorry, I have no idea, that would require me to download the whole thing from s3 and check, which will take a while.
– hey_you
8 hours ago
@K7AAY do csv files have 'n' at the end, should i just readline 100 times and write it to another file?
– hey_you
8 hours ago
Windows and DOS use carriage return and line feed ("rn") as a line ending, which Unix uses just line feed ("n").
– K7AAY
8 hours ago