tf.distribute.CrossDeviceOps

TensorFlow 1 version

View source on GitHub

Returns the current tf.distribute.ReplicaContext or None.

View aliases

Compat aliases for migration

See Migration guide for more details.

tf.compat.v1.distribute.get_replica_context

tf.distribute.get_replica_context()

Used in the notebooks

Used in the guide
Random number generation

Returns None if in a cross-replica context.

Note that execution:

starts in the default (single-replica) replica context (this function will return the default ReplicaContext object);
switches to cross-replica context (in which case this will return None) when entering a with tf.distribute.Strategy.scope(): block;
switches to a (non-default) replica context inside strategy.run(fn, ...);
if fn calls get_replica_context().merge_call(merge_fn, ...), then inside merge_fn you are back in the cross-replica context (and again this function will return None).

Most tf.distribute.Strategy methods may only be executed in a cross-replica context, in a replica context you should use the API of the tf.distribute.ReplicaContext object returned by this method instead.

assert tf.distribute.get_replica_context() is not None  # default
with strategy.scope():
  assert tf.distribute.get_replica_context() is None

  def f():
    replica_context = tf.distribute.get_replica_context()  # for strategy
    assert replica_context is not None
    tf.print("Replica id: ", replica_context.replica_id_in_sync_group,
             " of ", replica_context.num_replicas_in_sync)

  strategy.run(f)

Returns
The current `tf.distribute.ReplicaContext` object when in a replica context scope, else `None`. Within a particular block, exactly one of these two things will be true: `get_replica_context()` returns non-`None`, or `tf.distribute.is_cross_replica_context()` returns True.

Returns

The current tf.distribute.ReplicaContext object when in a replica context scope, else None.

Within a particular block, exactly one of these two things will be true:

get_replica_context() returns non-None, or
tf.distribute.is_cross_replica_context() returns True.

TensorFlow

tf

tf.audio

tf.autograph

tf.bitwise

tf.compat

tf.config

tf.data

tf.debugging

tf.distribute

tf.dtypes

tf.errors

tf.estimator

tf.experimental

tf.feature_column

tf.graph_util

tf.image

tf.initializers

tf.io

tf.keras

tf.linalg

tf.lite

tf.lookup

tf.losses

tf.math

tf.metrics

tf.nest

tf.nn

tf.optimizers

tf.quantization

tf.queue

tf.ragged

tf.random

tf.raw_ops

tf.saved_model

tf.sets

tf.signal

tf.sparse

tf.strings

tf.summary

tf.sysconfig

tf.test

tf.tpu

tf.train

tf.version

tf.xla

tf.distribute / CrossDeviceOps

View aliases

Used in the notebooks

Note that execution:

Returns