textflint
latest
Notebook Tutorials
Transformation
SubPopulation
AttackRecipe
Sample
Dataset
Validator
FlintModels
API
textflint
textflint.common
textflint.common.preprocess
textflint.common.preprocess.cn_processor
textflint.common.preprocess.en_processor
textflint.common.preprocess.nltk_res_load
textflint.common.utils
textflint.common.utils.error
textflint.common.utils.file_io
textflint.common.utils.format_change
textflint.common.utils.fp_utils
textflint.common.utils.importing
textflint.common.utils.install
textflint.common.utils.list_op
textflint.common.utils.load
textflint.common.utils.logger
textflint.common.utils.num_word
textflint.common.utils.overlap_templates
textflint.common.utils.seed
textflint.common.utils.shift_utils
textflint.common.utils.word_op
textflint.common.settings
textflint.generation_layer
textflint.generation_layer.attack
textflint.generation_layer.attack.attack
textflint.generation_layer.generator
textflint.generation_layer.generator.absa_generator
textflint.generation_layer.generator.coref_generator
textflint.generation_layer.generator.cws_generator
textflint.generation_layer.generator.dp_generator
textflint.generation_layer.generator.generator
textflint.generation_layer.generator.mrc_generator
textflint.generation_layer.generator.ner_generator
textflint.generation_layer.generator.nli_generator
textflint.generation_layer.generator.pos_generator
textflint.generation_layer.generator.re_generator
textflint.generation_layer.generator.sa_generator
textflint.generation_layer.generator.sm_generator
textflint.generation_layer.generator.ut_generator
textflint.generation_layer.subpopulation
textflint.generation_layer.subpopulation.ABSA
textflint.generation_layer.subpopulation.COREF
textflint.generation_layer.subpopulation.CWS
textflint.generation_layer.subpopulation.DP
textflint.generation_layer.subpopulation.MRC
textflint.generation_layer.subpopulation.NER
textflint.generation_layer.subpopulation.NLI
textflint.generation_layer.subpopulation.POS
textflint.generation_layer.subpopulation.RE
textflint.generation_layer.subpopulation.SA
textflint.generation_layer.subpopulation.SM
textflint.generation_layer.subpopulation.UT
textflint.generation_layer.subpopulation.subpopulation
textflint.generation_layer.transformation
textflint.generation_layer.transformation.ABSA
textflint.generation_layer.transformation.COREF
textflint.generation_layer.transformation.CWS
textflint.generation_layer.transformation.DP
textflint.generation_layer.transformation.MRC
textflint.generation_layer.transformation.NER
textflint.generation_layer.transformation.NLI
textflint.generation_layer.transformation.POS
textflint.generation_layer.transformation.RE
textflint.generation_layer.transformation.SA
textflint.generation_layer.transformation.SM
textflint.generation_layer.transformation.UT
textflint.generation_layer.transformation.pipeline
textflint.generation_layer.transformation.transformation
textflint.generation_layer.transformation.word_substitute
textflint.generation_layer.validator
textflint.generation_layer.validator.edit_distance
textflint.generation_layer.validator.gpt2_perplexity
textflint.generation_layer.validator.max_words_perturbed
textflint.generation_layer.validator.sentence_encoding
textflint.generation_layer.validator.translate_score
textflint.generation_layer.validator.validator
textflint.input_layer
textflint.input_layer.component
textflint.input_layer.component.field
textflint.input_layer.component.sample
textflint.input_layer.config
textflint.input_layer.config.config
textflint.input_layer.dataset
textflint.input_layer.dataset.dataset
textflint.input_layer.model
textflint.input_layer.model.flint_model
textflint.input_layer.model.metrics
textflint.input_layer.model.test_model
textflint.input_layer.model.tokenizers
textflint.report_layer
textflint.report_layer.analyzer
textflint.report_layer.analyzer.analyzer
textflint.report_layer.report_generator
textflint.report_layer.report_generator.report_generator
textflint.adapter
textflint.engine
textflint
»
textflint
»
textflint.input_layer
»
textflint.input_layer.model
»
textflint.input_layer.model.tokenizers
Edit on GitHub
textflint.input_layer.model.tokenizers
¶
Tokenizers for Model Wrapper
¶
Submodules
¶
textflint.input_layer.model.tokenizers.glove_tokenizer
Read the Docs
v: latest
Versions
latest
stable
Downloads
pdf
html
epub
On Read the Docs
Project Home
Builds