textflint.generation_layer.transformation.CWS.swap_syn

Replace word with its SwapSyn.

class textflint.generation_layer.transformation.CWS.swap_syn.SwapSyn(**kwargs)

Bases: textflint.generation_layer.transformation.transformation.Transformation

Replace word with its synonym.

Example:

先生过奖了 -> 先生过誉了

__init__(**kwargs)

Parameters

synonym_dict (dict) – the dictionary of synonym

static make_dict(path)

read data and make dictionary

Parameters

path (str) – the path of data

Return dict

the dict of data

class textflint.generation_layer.transformation.CWS.swap_syn.Transformation(**kwargs)

Bases: abc.ABC

An abstract class for transforming a sequence of text to produce a list of potential adversarial example.

processor = <textflint.common.preprocess.en_processor.EnProcessor object>

transform(sample, n=1, field='x', **kwargs)

Transform data sample to a list of Sample.

Parameters

• sample (Sample) – Data sample for augmentation.

• n (int) – Max number of unique augmented output, default is 5.

• field (str|list) – Indicate which fields to apply transformations.

• **kwargs (dict) –

  other auxiliary params.

Returns

list of Sample

classmethod sample_num(x, num)

Get ‘num’ samples from x.

Parameters

• x (list) – list to sample

• num (int) – sample number

Returns

max ‘num’ unique samples.

textflint.generation_layer.transformation.CWS.swap_syn.descartes(calculation_items, n)

Parameters

• calculation_items (list) –

• n (int) – quantity to select

Return list

list items which we random choice from Cartesian product.

textflint.generation_layer.transformation.CWS.swap_syn.download_if_needed(folder_name)

Folder name will be saved as .cache/textflint/[folder_name]. If it doesn’t exist on disk, the zip file will be downloaded and extracted.

Parameters

folder_name (str) – path to folder or file in cache

Returns

path to the downloaded folder or file on disk

textflint.generation_layer.transformation.CWS.swap_syn.plain_lines_loader(path)

read data