Package perl-Fsdb

A set of commands for manipulating flat-text databases from the shell

http://www.isi.edu/~johnh/SOFTWARE/FSDB/

FSDB is a package of commands for manipulating flat-ASCII databases from
shell scripts.  FSDB is useful to process medium amounts of data (with
very little data you'd do it by hand, with megabytes you might want a
real database).  FSDB is very good at doing things like:

        - extracting measurements from experimental output
        - re-examining data to address different hypotheses
        - joining data from different experiments
        - eliminating/detecting outliers
        - computing statistics on data (mean, confidence intervals,
                correlations, histograms)
        - reformatting data for graphing programs

Rather than hand-code scripts to do each special case, FSDB provides
higher-level functions than one gets with raw perl or shell scripts.
(Some features:  control uses names instead of column numbers,
it is self-documenting, and is robust with good error and memory handling.)
General Commands
Command Description
cgi_to_db convert stored CGI files (from CGI.pm) to fsdb
combined_log_format_to_db convert Apache Combined Log Format to Fsdb
csv_to_db convert comma-separated-value data into fsdb
dbcol select columns from an Fsdb file
dbcolcopylast create new columns that are copies of prior columns
dbcolcreate create new columns
dbcoldefine define the columns of a plain text file to make it an Fsdb file
dbcolhisto compute a histogram over a column of Fsdb data
dbcolize DEPRICATED, now use dbfilealter
dbcolmerge merge multiple columns into one
dbcolmovingstats compute moving statistics over a window of a column of data
dbcolneaten pretty-print columns of Fsdb data (assuming a monospaced font)
dbcolpercentile compute percentiles or ranks for an existing column
dbcolrename change the names of columns in a fsdb schema
dbcolscorrelate find the coefficient of correlation over columns
dbcolsplittocols split an existing column into multiple new columns
dbcolsplittorows split an existing column into multiple new rows
dbcolsregression compute linear regression between two columns
dbcolstats compute statistics on a fsdb column
dbcolstatscores compute z-scores or t-scores for each value in a population
dbfilealter alter the format of an Fsdb file, changing the row/column separator
dbfilecat concatenate two files with identical schema
dbfilediff compare two fsdb tables
dbfilepivot pivot a table, converting multiple rows into single wide row
dbfilestripcomments remove comments from a fsdb file
dbfilevalidate insure the source input is a well-formed Fsdb file
dbformmail write a shell script that will send e-mail to many people
dbjoin join two tables on common columns
dblistize DEPRICATED, now use dbfilealter
dbmapreduce reduce all input rows with the same key
dbmerge merge all inputs in sorted order based on the the specified columns
dbmerge2 merge exactly two inputs in sorted order based on the the specified columns
dbmultistats run dbcolstats over each group of inputs identified by some key
dbrecolize DEPRICATED, now use dbfilealter
dbrow select rows from an Fsdb file based on arbitrary conditions
dbrowaccumulate compute a running sum of a column
dbrowcount count the number of rows in an Fsdb stream
dbrowdiff compute row-by-row differences of some column
dbrowenumerate enumerate rows, starting from zero
dbroweval evaluate code for each row of a fsdb file
dbrowuniq eliminate adjacent rows with duplicate fields, maybe counting
dbrvstatdiff evaluate statistical differences between two random variables
dbsort sort rows based on the the specified columns
dbstats DEPRICATED, now use dbcolstats
db_to_csv convert fsdb to the comma-separated-value file-format
db_to_html_table convert db to an HTML table
html_table_to_db convert HTML tables into fsdb
kitrace_to_db convert kitrace output to Fsdb format
ns_to_db convert one of ns's output format to jdb
sqlselect_to_db convert MySQL or MariaDB selected tables to fsdb
tabdelim_to_db convert tab-delimited data into fsdb
tcpdump_to_db convert tcpdump textual output to fsdb
xml_to_db convert a subset of XML into fsdb
yaml_to_db convert a subset of YAML into fsdb