ngramrandtest(1)
Generates random data/models.
DESCRIPTION
Generates random data/models.
-
SYNOPSIS
ngramrandtest [--options]
OPTIONS
-
--directory: type = string, default = "."
-
- directory where files will be placed
-
--max_length: type = int32, default = 1000
-
- Maximum sentence length
-
--mean_length: type = int32, default = 100
-
- maximum mean string length
-
--ngram_max: type = int32, default = 3
-
- maximum n-gram order size
-
--sample_max: type = int32, default = 10000
-
- maximum sample corpus size
-
--seed: type = int32, default = 1462816699
-
- Randomization seed
-
--thresh_max: type = double, default = 3
-
- maximum threshold size
-
--vars: type = string, default = ""
-
- file name for outputting variable values
-
--vocabulary_max: type = int32, default = 5000
-
- maximum vocabulary size
-
--help: type = bool, default = false
-
- show usage information
-
--helpshort: type = bool, default = false
-
- show brief usage information
-
--tmpdir: type = string, default = "/tmp"
-
- temporary directory
-
--v: type = int32, default = 0
-
- verbose level
-
--fst_align: type = bool, default = false
-
- Write FST data aligned where appropriate
-
--fst_default_cache_gc: type = bool, default = true
-
- Enable garbage collection of cache
-
--fst_default_cache_gc_limit: type = int64, default = 1048576
-
- Cache byte size that triggers garbage collection
-
--fst_read_mode: type = string, default = "read"
-
- Default file reading mode for mappable files
-
--fst_verify_properties: type = bool, default = false
-
- Verify fst properties queried by TestProperties
-
--fst_weight_parentheses: type = string, default = ""
-
- Characters enclosing the first weight of a printed composite weight (e.g. pair weight, tuple weight and derived classes) to ensure proper I/O of nested composite weights; must have size 0 (none) or 2 (open and close parenthesis)
-
--fst_weight_separator: type = string, default = ","
-
- Character separator between printed composite weights; must be a single character
-
--save_relabel_ipairs: type = string, default = ""
-
- Save input relabel pairs to file
-
--save_relabel_opairs: type = string, default = ""
-
- Save output relabel pairs to file
-
--end_symbol: type = string, default = "</s>"
-
- Class label for sentence start
-
--start_symbol: type = string, default = "<s>"
-
- Class label for sentence start
-
--fst_compat_symbols: type = bool, default = true
-
- Require symbol tables to match when appropriate
-
--fst_field_separator: type = string, default = " "
-
- Set of characters used as a separator between printed fields
-
--fst_error_fatal: type = bool, default = true
-
- FST errors are fatal; o.w. return objects flagged as bad:
-
e.g., FSTs - kError prop. true, FST weights - not a Member()
-
--ngram_error_fatal: type = bool, default = true
-
- NGram errors are fatal; o.w. return objects flagged as bad:
-
e.g., NGramModel::Error() returns true.