tf.distribute.HierarchicalCopyAllReduce

TensorFlow 1 version

View source on GitHub

Replication mode for input function.

View aliases

Compat aliases for migration

See Migration guide for more details.

tf.compat.v1.distribute.InputReplicationMode

PER_WORKER: The input function will be called on each worker independently, creating as many input pipelines as number of workers. Replicas will dequeue from the local Dataset on their worker. tf.distribute.Strategy doesn't manage any state sharing between such separate input pipelines.
PER_REPLICA: The input function will be called on each replica seperately. tf.distribute.Strategy doesn't manage any state sharing between such separate input pipelines.

Class Variables
PER_REPLICA	`tf.distribute.InputReplicationMode`
PER_WORKER	`tf.distribute.InputReplicationMode`

TensorFlow

tf

tf.audio

tf.autograph

tf.bitwise

tf.compat

tf.config

tf.data

tf.debugging

tf.distribute

tf.dtypes

tf.errors

tf.estimator

tf.experimental

tf.feature_column

tf.graph_util

tf.image

tf.initializers

tf.io

tf.keras

tf.linalg

tf.lite

tf.lookup

tf.losses

tf.math

tf.metrics

tf.nest

tf.nn

tf.optimizers

tf.quantization

tf.queue

tf.ragged

tf.random

tf.raw_ops

tf.saved_model

tf.sets

tf.signal

tf.sparse

tf.strings

tf.summary

tf.sysconfig

tf.test

tf.tpu

tf.train

tf.version

tf.xla

tf.distribute / HierarchicalCopyAllReduce

View aliases

Class Variables