Skip to content

EmbeddingModelDefinition

One embedding model Maitento can index and search with, and the limits that decide how text is cut into chunks before it reaches it. The limits differ per model because their input ceilings differ (for example, gemini-embedding-001 accepts 2,048 tokens where text-embedding-3-large accepts 8,191).

Kind: an object, used in responses.

Every field is present in a response; empty ones are null.

FieldTypeDescription
providerEmbeddingProviderThe provider that serves the model.
modelstringThe provider’s model id (for example text-embedding-3-large).
nativeDimensionsintegerThe width the model produces when no output width is requested.
supportedDimensionsinteger[]The output widths a partition may be indexed at with this model.
maxInputTokensintegerThe provider’s hard input ceiling for one embedding call, in the model’s own tokens.
defaultChunkSizeTokensintegerThe chunk size used when a partition’s profile does not choose one.
defaultChunkOverlapTokensintegerThe overlap between consecutive chunks used when a partition’s profile does not choose one.
maxChunkSizeTokensintegerThe largest chunk size a profile may choose for this model.
isDefaultbooleanWhether this is the default: the model every partition without a profile of its own embeds with. Exactly one listed model is the default.
isWithdrawnbooleanTrue for a model Maitento no longer offers, which a partition was indexed with before it was withdrawn. The partition can still be read, searched and re-indexed, but a new profile cannot choose it: move the partition to a listed model.
isCustombooleanTrue for your own model rather than one Maitento lists: a model id served by one of the providers’ APIs, typically an OpenAI-compatible endpoint of yours, whose width a test call measured. Its limits are the most conservative of any model, it embeds at its natural width, and it never falls back to Maitento’s key.
maxWordsPerEmbeddingintegerThe most words one embedding call may carry for this model: 4,000 for an 8,191-token model, and in proportion for others. Set by Maitento.
wholeDocumentMaxWordsintegerAbove this many words a document is chunked rather than embedded whole: at most 750, and never more than one call can carry. Set by Maitento.
wholeDocumentMaxCharactersintegerAbove this many characters a document is chunked rather than embedded whole: at most 30,000, and fewer for a model with a small input ceiling. Set by Maitento.
{
"provider": "OpenAi",
"model": "...",
"nativeDimensions": 0,
"supportedDimensions": [
0
],
"maxInputTokens": 0,
"defaultChunkSizeTokens": 0,
"defaultChunkOverlapTokens": 0,
"maxChunkSizeTokens": 0,
"isDefault": false,
"isWithdrawn": false,
"isCustom": false,
"maxWordsPerEmbedding": 0,
"wholeDocumentMaxWords": 0,
"wholeDocumentMaxCharacters": 0
}