Class GPUOptions.Experimental.StreamMergeOptions
java.lang.Object
com.google.protobuf.AbstractMessageLite
com.google.protobuf.AbstractMessage
com.google.protobuf.GeneratedMessageV3
org.tensorflow.proto.GPUOptions.Experimental.StreamMergeOptions
- All Implemented Interfaces:
Message, MessageLite, MessageLiteOrBuilder, MessageOrBuilder, Serializable, GPUOptions.Experimental.StreamMergeOptionsOrBuilder
- Enclosing class:
GPUOptions.Experimental
public static final class GPUOptions.Experimental.StreamMergeOptions
extends GeneratedMessageV3
implements GPUOptions.Experimental.StreamMergeOptionsOrBuilder
Whether to merge data transfer streams into the compute stream in the same stream group. Stream merging helps reduce the overhead caused by stream synchronization, especially when data transfers are frequent. For example, setting "merge_host_to_device_stream = true" will make the compute stream responsible for both computation and host to device memory copy.Protobuf type
tensorflow.GPUOptions.Experimental.StreamMergeOptions- See Also:
-
Nested Class Summary
Nested ClassesModifier and TypeClassDescriptionstatic final classWhether to merge data transfer streams into the compute stream in the same stream group.Nested classes/interfaces inherited from class GeneratedMessageV3
GeneratedMessageV3.BuilderParent, GeneratedMessageV3.ExtendableBuilder<MessageType, BuilderType>, GeneratedMessageV3.ExtendableMessage<MessageType>, GeneratedMessageV3.ExtendableMessageOrBuilder<MessageType>, GeneratedMessageV3.FieldAccessorTable, GeneratedMessageV3.UnusedPrivateParameterNested classes/interfaces inherited from class AbstractMessageLite
AbstractMessageLite.InternalOneOfEnum -
Field Summary
FieldsModifier and TypeFieldDescriptionstatic final intstatic final intstatic final intFields inherited from class GeneratedMessageV3
alwaysUseFieldBuilders, unknownFieldsFields inherited from class AbstractMessage
memoizedSizeFields inherited from class AbstractMessageLite
memoizedHashCode -
Method Summary
Modifier and TypeMethodDescriptionbooleanstatic final Descriptors.DescriptorbooleanIf true, the compute stream will be used for device_to_device copy as well.booleanIf true, the compute stream will be used for device_to_host copy as well.booleanIf true, the compute stream will be used for host_to_device copy as well.intfinal UnknownFieldSetinthashCode()protected GeneratedMessageV3.FieldAccessorTablefinal booleanprotected ObjectparseDelimitedFrom(InputStream input) parseDelimitedFrom(InputStream input, ExtensionRegistryLite extensionRegistry) parseFrom(byte[] data) parseFrom(byte[] data, ExtensionRegistryLite extensionRegistry) parseFrom(ByteString data) parseFrom(ByteString data, ExtensionRegistryLite extensionRegistry) parseFrom(CodedInputStream input) parseFrom(CodedInputStream input, ExtensionRegistryLite extensionRegistry) parseFrom(InputStream input) parseFrom(InputStream input, ExtensionRegistryLite extensionRegistry) parseFrom(ByteBuffer data) parseFrom(ByteBuffer data, ExtensionRegistryLite extensionRegistry) parser()voidwriteTo(CodedOutputStream output) Methods inherited from class GeneratedMessageV3
canUseUnsafe, computeStringSize, computeStringSizeNoTag, emptyBooleanList, emptyDoubleList, emptyFloatList, emptyIntList, emptyLongList, getAllFields, getDescriptorForType, getField, getOneofFieldDescriptor, getRepeatedField, getRepeatedFieldCount, hasField, hasOneof, internalGetMapField, isStringEmpty, makeExtensionsImmutable, mergeFromAndMakeImmutableInternal, mutableCopy, mutableCopy, mutableCopy, mutableCopy, mutableCopy, newBooleanList, newBuilderForType, newDoubleList, newFloatList, newIntList, newLongList, parseDelimitedWithIOException, parseDelimitedWithIOException, parseUnknownField, parseUnknownFieldProto3, parseWithIOException, parseWithIOException, parseWithIOException, parseWithIOException, serializeBooleanMapTo, serializeIntegerMapTo, serializeLongMapTo, serializeStringMapTo, writeReplace, writeString, writeStringNoTagMethods inherited from class AbstractMessage
findInitializationErrors, getInitializationErrorString, hashBoolean, hashEnum, hashEnumList, hashFields, hashLong, toStringMethods inherited from class AbstractMessageLite
addAll, addAll, checkByteStringIsUtf8, toByteArray, toByteString, writeDelimitedTo, writeToMethods inherited from interface MessageLite
toByteArray, toByteString, writeDelimitedTo, writeToMethods inherited from interface MessageOrBuilder
findInitializationErrors, getAllFields, getDescriptorForType, getField, getInitializationErrorString, getOneofFieldDescriptor, getRepeatedField, getRepeatedFieldCount, hasField, hasOneof
-
Field Details
-
MERGE_HOST_TO_DEVICE_STREAM_FIELD_NUMBER
public static final int MERGE_HOST_TO_DEVICE_STREAM_FIELD_NUMBER- See Also:
-
MERGE_DEVICE_TO_HOST_STREAM_FIELD_NUMBER
public static final int MERGE_DEVICE_TO_HOST_STREAM_FIELD_NUMBER- See Also:
-
MERGE_DEVICE_TO_DEVICE_STREAM_FIELD_NUMBER
public static final int MERGE_DEVICE_TO_DEVICE_STREAM_FIELD_NUMBER- See Also:
-
-
Method Details
-
newInstance
- Overrides:
newInstancein classGeneratedMessageV3
-
getUnknownFields
- Specified by:
getUnknownFieldsin interfaceMessageOrBuilder- Overrides:
getUnknownFieldsin classGeneratedMessageV3
-
getDescriptor
-
internalGetFieldAccessorTable
- Specified by:
internalGetFieldAccessorTablein classGeneratedMessageV3
-
getMergeHostToDeviceStream
public boolean getMergeHostToDeviceStream()If true, the compute stream will be used for host_to_device copy as well. It's no longer necessary to record an event before the copy to let the copy stream wait for the compute stream to finish. There is also no need to wait for the copy to complete before executing the callback function.
bool merge_host_to_device_stream = 1;- Specified by:
getMergeHostToDeviceStreamin interfaceGPUOptions.Experimental.StreamMergeOptionsOrBuilder- Returns:
- The mergeHostToDeviceStream.
-
getMergeDeviceToHostStream
public boolean getMergeDeviceToHostStream()If true, the compute stream will be used for device_to_host copy as well. It's no longer necessary to record an event before the copy to let the copy stream wait for the compute stream to finish.
bool merge_device_to_host_stream = 2;- Specified by:
getMergeDeviceToHostStreamin interfaceGPUOptions.Experimental.StreamMergeOptionsOrBuilder- Returns:
- The mergeDeviceToHostStream.
-
getMergeDeviceToDeviceStream
public boolean getMergeDeviceToDeviceStream()If true, the compute stream will be used for device_to_device copy as well. It's no longer necessary to record an event before the copy to let the copy stream wait for the compute stream of the sending device to finish. There is also no need to wait for the compute stream of the receiving device to finish if the copy is within the same device.
bool merge_device_to_device_stream = 3;- Specified by:
getMergeDeviceToDeviceStreamin interfaceGPUOptions.Experimental.StreamMergeOptionsOrBuilder- Returns:
- The mergeDeviceToDeviceStream.
-
isInitialized
public final boolean isInitialized()- Specified by:
isInitializedin interfaceMessageLiteOrBuilder- Overrides:
isInitializedin classGeneratedMessageV3
-
writeTo
- Specified by:
writeToin interfaceMessageLite- Overrides:
writeToin classGeneratedMessageV3- Throws:
IOException
-
getSerializedSize
public int getSerializedSize()- Specified by:
getSerializedSizein interfaceMessageLite- Overrides:
getSerializedSizein classGeneratedMessageV3
-
equals
- Specified by:
equalsin interfaceMessage- Overrides:
equalsin classAbstractMessage
-
hashCode
public int hashCode()- Specified by:
hashCodein interfaceMessage- Overrides:
hashCodein classAbstractMessage
-
parseFrom
public static GPUOptions.Experimental.StreamMergeOptions parseFrom(ByteBuffer data) throws InvalidProtocolBufferException - Throws:
InvalidProtocolBufferException
-
parseFrom
public static GPUOptions.Experimental.StreamMergeOptions parseFrom(ByteBuffer data, ExtensionRegistryLite extensionRegistry) throws InvalidProtocolBufferException - Throws:
InvalidProtocolBufferException
-
parseFrom
public static GPUOptions.Experimental.StreamMergeOptions parseFrom(ByteString data) throws InvalidProtocolBufferException - Throws:
InvalidProtocolBufferException
-
parseFrom
public static GPUOptions.Experimental.StreamMergeOptions parseFrom(ByteString data, ExtensionRegistryLite extensionRegistry) throws InvalidProtocolBufferException - Throws:
InvalidProtocolBufferException
-
parseFrom
public static GPUOptions.Experimental.StreamMergeOptions parseFrom(byte[] data) throws InvalidProtocolBufferException - Throws:
InvalidProtocolBufferException
-
parseFrom
public static GPUOptions.Experimental.StreamMergeOptions parseFrom(byte[] data, ExtensionRegistryLite extensionRegistry) throws InvalidProtocolBufferException - Throws:
InvalidProtocolBufferException
-
parseFrom
public static GPUOptions.Experimental.StreamMergeOptions parseFrom(InputStream input) throws IOException - Throws:
IOException
-
parseFrom
public static GPUOptions.Experimental.StreamMergeOptions parseFrom(InputStream input, ExtensionRegistryLite extensionRegistry) throws IOException - Throws:
IOException
-
parseDelimitedFrom
public static GPUOptions.Experimental.StreamMergeOptions parseDelimitedFrom(InputStream input) throws IOException - Throws:
IOException
-
parseDelimitedFrom
public static GPUOptions.Experimental.StreamMergeOptions parseDelimitedFrom(InputStream input, ExtensionRegistryLite extensionRegistry) throws IOException - Throws:
IOException
-
parseFrom
public static GPUOptions.Experimental.StreamMergeOptions parseFrom(CodedInputStream input) throws IOException - Throws:
IOException
-
parseFrom
public static GPUOptions.Experimental.StreamMergeOptions parseFrom(CodedInputStream input, ExtensionRegistryLite extensionRegistry) throws IOException - Throws:
IOException
-
newBuilderForType
- Specified by:
newBuilderForTypein interfaceMessage- Specified by:
newBuilderForTypein interfaceMessageLite
-
newBuilder
-
newBuilder
public static GPUOptions.Experimental.StreamMergeOptions.Builder newBuilder(GPUOptions.Experimental.StreamMergeOptions prototype) -
toBuilder
- Specified by:
toBuilderin interfaceMessage- Specified by:
toBuilderin interfaceMessageLite
-
newBuilderForType
protected GPUOptions.Experimental.StreamMergeOptions.Builder newBuilderForType(GeneratedMessageV3.BuilderParent parent) - Specified by:
newBuilderForTypein classGeneratedMessageV3
-
getDefaultInstance
-
parser
-
getParserForType
- Specified by:
getParserForTypein interfaceMessage- Specified by:
getParserForTypein interfaceMessageLite- Overrides:
getParserForTypein classGeneratedMessageV3
-
getDefaultInstanceForType
- Specified by:
getDefaultInstanceForTypein interfaceMessageLiteOrBuilder- Specified by:
getDefaultInstanceForTypein interfaceMessageOrBuilder
-