Read a delimited file by chunks
Read a delimited file by chunks
read_delim_chunked( file, callback, chunk_size = 10000, delim, quote = "\"", escape_backslash = FALSE, escape_double = TRUE, col_names = TRUE, col_types = NULL, locale = default_locale(), na = c("", "NA"), quoted_na = TRUE, comment = "", trim_ws = FALSE, skip = 0, guess_max = min(1000, chunk_size), progress = show_progress(), skip_empty_rows = TRUE ) read_csv_chunked( file, callback, chunk_size = 10000, col_names = TRUE, col_types = NULL, locale = default_locale(), na = c("", "NA"), quoted_na = TRUE, quote = "\"", comment = "", trim_ws = TRUE, skip = 0, guess_max = min(1000, chunk_size), progress = show_progress(), skip_empty_rows = TRUE ) read_csv2_chunked( file, callback, chunk_size = 10000, col_names = TRUE, col_types = NULL, locale = default_locale(), na = c("", "NA"), quoted_na = TRUE, quote = "\"", comment = "", trim_ws = TRUE, skip = 0, guess_max = min(1000, chunk_size), progress = show_progress(), skip_empty_rows = TRUE ) read_tsv_chunked( file, callback, chunk_size = 10000, col_names = TRUE, col_types = NULL, locale = default_locale(), na = c("", "NA"), quoted_na = TRUE, quote = "\"", comment = "", trim_ws = TRUE, skip = 0, guess_max = min(1000, chunk_size), progress = show_progress(), skip_empty_rows = TRUE )
file |
Either a path to a file, a connection, or literal data (either a single string or a raw vector). Files ending in Literal data is most useful for examples and tests. It must contain at least one new line to be recognised as data (instead of a path) or be a vector of greater than length 1. Using a value of |
callback |
A callback function to call on each chunk |
chunk_size |
The number of rows to include in each chunk |
delim |
Single character used to separate fields within a record. |
quote |
Single character used to quote strings. |
escape_backslash |
Does the file use backslashes to escape special
characters? This is more general than |
escape_double |
Does the file escape quotes by doubling them?
i.e. If this option is |
col_names |
Either If If Missing ( |
col_types |
One of If If a column specification created by Alternatively, you can use a compact string representation where each character represents one column:
|
locale |
The locale controls defaults that vary from place to place.
The default locale is US-centric (like R), but you can use
|
na |
Character vector of strings to interpret as missing values. Set this
option to |
quoted_na |
Should missing values inside quotes be treated as missing values (the default) or strings. |
comment |
A string used to identify comments. Any text after the comment characters will be silently ignored. |
trim_ws |
Should leading and trailing whitespace be trimmed from each field before parsing it? |
skip |
Number of lines to skip before reading data. |
guess_max |
Maximum number of records to use for guessing column types. |
progress |
Display a progress bar? By default it will only display
in an interactive session and not while knitting a document. The display
is updated every 50,000 values and will only display if estimated reading
time is 5 seconds or more. The automatic progress bar can be disabled by
setting option |
skip_empty_rows |
Should blank rows be ignored altogether? i.e. If this
option is |
Other chunked:
callback
,
melt_delim_chunked()
,
read_lines_chunked()
# Cars with 3 gears f <- function(x, pos) subset(x, gear == 3) read_csv_chunked(readr_example("mtcars.csv"), DataFrameCallback$new(f), chunk_size = 5)
Please choose more modern alternatives, such as Google Chrome or Mozilla Firefox.