Send feedback
Class SpeculativeDecodingSpec.NgramSpeculation.Builder (3.58.0)
Stay organized with collections
Save and categorize content based on your preferences.
Version latest keyboard_arrow_down
public static final class SpeculativeDecodingSpec . NgramSpeculation . Builder extends GeneratedMessageV3 . Builder<SpeculativeDecodingSpec . NgramSpeculation . Builder > implements SpeculativeDecodingSpec . NgramSpeculationOrBuilder
N-Gram speculation works by trying to find matching tokens in the
previous prompt sequence and use those as speculation for generating
new tokens.
Protobuf type google.cloud.aiplatform.v1.SpeculativeDecodingSpec.NgramSpeculation
Inherited Members
com.google.protobuf.GeneratedMessageV3.Builder.getUnknownFieldSetBuilder()
com.google.protobuf.GeneratedMessageV3.Builder.internalGetMapFieldReflection(int)
com.google.protobuf.GeneratedMessageV3.Builder.internalGetMutableMapFieldReflection(int)
com.google.protobuf.GeneratedMessageV3.Builder.mergeUnknownLengthDelimitedField(int,com.google.protobuf.ByteString)
com.google.protobuf.GeneratedMessageV3.Builder.mergeUnknownVarintField(int,int)
com.google.protobuf.GeneratedMessageV3.Builder.parseUnknownField(com.google.protobuf.CodedInputStream,com.google.protobuf.ExtensionRegistryLite,int)
com.google.protobuf.GeneratedMessageV3.Builder.setUnknownFieldSetBuilder(com.google.protobuf.UnknownFieldSet.Builder)
Static Methods
public static final Descriptors . Descriptor getDescriptor ()
Methods
public SpeculativeDecodingSpec . NgramSpeculation . Builder addRepeatedField ( Descriptors . FieldDescriptor field , Object value )
Overrides
public SpeculativeDecodingSpec . NgramSpeculation build ()
public SpeculativeDecodingSpec . NgramSpeculation buildPartial ()
public SpeculativeDecodingSpec . NgramSpeculation . Builder clear ()
Overrides
public SpeculativeDecodingSpec . NgramSpeculation . Builder clearField ( Descriptors . FieldDescriptor field )
Overrides
public SpeculativeDecodingSpec . NgramSpeculation . Builder clearNgramSize ()
The number of last N input tokens used as ngram to search/match
against the previous prompt sequence.
This is equal to the N in N-Gram.
The default value is 3 if not specified.
int32 ngram_size = 1;
public SpeculativeDecodingSpec . NgramSpeculation . Builder clearOneof ( Descriptors . OneofDescriptor oneof )
Overrides
public SpeculativeDecodingSpec . NgramSpeculation . Builder clone ()
Overrides
public SpeculativeDecodingSpec . NgramSpeculation getDefaultInstanceForType ()
public Descriptors . Descriptor getDescriptorForType ()
Overrides
public int getNgramSize ()
The number of last N input tokens used as ngram to search/match
against the previous prompt sequence.
This is equal to the N in N-Gram.
The default value is 3 if not specified.
int32 ngram_size = 1;
Returns
Type
Description
int
The ngramSize.
protected GeneratedMessageV3 . FieldAccessorTable internalGetFieldAccessorTable ()
Overrides
public final boolean isInitialized ()
Overrides
public SpeculativeDecodingSpec . NgramSpeculation . Builder mergeFrom ( SpeculativeDecodingSpec . NgramSpeculation other )
public SpeculativeDecodingSpec . NgramSpeculation . Builder mergeFrom ( CodedInputStream input , ExtensionRegistryLite extensionRegistry )
Overrides
public SpeculativeDecodingSpec . NgramSpeculation . Builder mergeFrom ( Message other )
Parameter
Name
Description
other
Message
Overrides
public final SpeculativeDecodingSpec . NgramSpeculation . Builder mergeUnknownFields ( UnknownFieldSet unknownFields )
Overrides
public SpeculativeDecodingSpec . NgramSpeculation . Builder setField ( Descriptors . FieldDescriptor field , Object value )
Overrides
public SpeculativeDecodingSpec . NgramSpeculation . Builder setNgramSize ( int value )
The number of last N input tokens used as ngram to search/match
against the previous prompt sequence.
This is equal to the N in N-Gram.
The default value is 3 if not specified.
int32 ngram_size = 1;
Parameter
Name
Description
value
int
The ngramSize to set.
public SpeculativeDecodingSpec . NgramSpeculation . Builder setRepeatedField ( Descriptors . FieldDescriptor field , int index , Object value )
Overrides
public final SpeculativeDecodingSpec . NgramSpeculation . Builder setUnknownFields ( UnknownFieldSet unknownFields )
Overrides
Send feedback
Except as otherwise noted, the content of this page is licensed under the Creative Commons Attribution 4.0 License , and code samples are licensed under the Apache 2.0 License . For details, see the Google Developers Site Policies . Java is a registered trademark of Oracle and/or its affiliates.
Last updated 2025-02-05 UTC.
Need to tell us more?
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Hard to understand","hardToUnderstand","thumb-down"],["Incorrect information or sample code","incorrectInformationOrSampleCode","thumb-down"],["Missing the information/samples I need","missingTheInformationSamplesINeed","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2025-02-05 UTC."],[],[]]