tf.keras.preprocessing.text

TensorFlow 1 version

View source on GitHub

One-hot encodes a text into a list of word indexes of size n.

View aliases

Compat aliases for migration

See Migration guide for more details.

tf.compat.v1.keras.preprocessing.text.one_hot

tf.keras.preprocessing.text.one_hot(
    input_text, n,
    filters='!"#$%&()*+,-./:;<=>?@[\\]^_`{|}~\t\n',
    lower=True, split=' '
)

This function receives as input a string of text and returns a list of encoded integers each corresponding to a word (or token) in the given input string.

Arguments
`input_text`	Input text (string).
`n`	int. Size of vocabulary.
`filters`	list (or concatenation) of characters to filter out, such as punctuation. Default: '!"#$%&()*+,-./:;<=>?@[\]^_`{\|}~\t\n, includes basic punctuation, tabs, and newlines.
`lower`	boolean. Whether to set the text to lowercase.
`split`	str. Separator for word splitting.

Returns
List of integers in `[1, n]`. Each integer encodes a word (unicity non-guaranteed).

TensorFlow

tf

tf.audio

tf.autograph

tf.bitwise

tf.compat

tf.config

tf.data

tf.debugging

tf.distribute

tf.dtypes

tf.errors

tf.estimator

tf.experimental

tf.feature_column

tf.graph_util

tf.image

tf.initializers

tf.io

tf.keras

tf.linalg

tf.lite

tf.lookup

tf.losses

tf.math

tf.metrics

tf.nest

tf.nn

tf.optimizers

tf.quantization

tf.queue

tf.ragged

tf.random

tf.raw_ops

tf.saved_model

tf.sets

tf.signal

tf.sparse

tf.strings

tf.summary

tf.sysconfig

tf.test

tf.tpu

tf.train

tf.version

tf.xla

tf.keras / preprocessing / preprocessing.text.Overview

View aliases

Arguments

Returns