AiSearchIndex
laktory.models.resources.databricks.AiSearchIndex
¤
Bases: AiSearchIndexBase
Databricks AI Search Index
Searchable collection of records hosted on an AI Search endpoint, kept in
sync with a source Delta table (DELTA_SYNC) or written to through the API
(DIRECT_ACCESS). Replacement of VectorSearchIndex. Can also be declared
directly in the indexes of an AiSearchEndpoint.
Examples:
import io
from laktory import models
index_yaml = '''
parent: workspaces/1234567890/endpoints/default
index_id: dev.finance.stock_news_index
primary_key: id
index_type: DELTA_SYNC
delta_sync_index_spec:
source_table: dev.finance.slv_stock_news
pipeline_type: TRIGGERED
embedding_source_columns:
- name: text
embedding_model_endpoint: databricks-gte-large-en
'''
index = models.resources.databricks.AiSearchIndex.model_validate_yaml(
io.StringIO(index_yaml)
)
| BASE | DESCRIPTION |
|---|---|
delta_sync_index_spec
|
Specification for a Delta Sync index. Set when
TYPE:
|
direct_access_index_spec
|
Specification for a Direct Access index. Set when
TYPE:
|
index_id
|
The user-supplied Unity Catalog table name for the Index, per AIP-133. The server composes the full
TYPE:
|
index_subtype
|
The subtype of the index. Set on create and immutable thereafter. Possible values are:
TYPE:
|
index_type
|
Type of index. Required on create and immutable thereafter. Possible values are:
TYPE:
|
parent
|
Endpoint hosting the index, in the format
TYPE:
|
primary_key
|
Primary key of the index. Set on create and immutable thereafter
TYPE:
|
provider_config
|
Configure the provider for management through account provider
TYPE:
|
laktory.models.resources.databricks.aisearchindex.AiSearchIndexDeltaSyncIndexSpec
¤
Bases: BaseModel
| PARAMETER | DESCRIPTION |
|---|---|
columns_to_sync
|
[Optional] Select the columns to sync with the index. If left blank, all columns from the source table are synced. The primary key column and embedding source or vector column are always synced
TYPE:
|
embedding_source_columns
|
The columns that contain the embedding source
TYPE:
|
embedding_vector_columns
|
The columns that contain the embedding vectors
TYPE:
|
embedding_writeback_table
|
[Optional] Name of the Delta table to sync the index contents and computed embeddings to
TYPE:
|
pipeline_type
|
Pipeline execution mode. Required on create — the backend rejects an unset value. Storage Optimized endpoints accept only
TYPE:
|
source_table
|
The full name of the source Delta table
TYPE:
|
laktory.models.resources.databricks.aisearchindex.AiSearchIndexDeltaSyncIndexSpecEmbeddingSourceColumns
¤
Bases: BaseModel
| PARAMETER | DESCRIPTION |
|---|---|
embedding_model_endpoint
|
Name of the embedding model endpoint, used by default for both ingestion and querying
TYPE:
|
model_endpoint_name_for_query
|
Name of the embedding model endpoint which, if specified, is used for querying (not ingestion)
TYPE:
|
name
|
Name of the AI Search index. Server-assigned full resource path (
TYPE:
|
laktory.models.resources.databricks.aisearchindex.AiSearchIndexDeltaSyncIndexSpecEmbeddingVectorColumns
¤
Bases: BaseModel
| PARAMETER | DESCRIPTION |
|---|---|
embedding_dimension
|
Dimension of the embedding vector
TYPE:
|
name
|
Name of the AI Search index. Server-assigned full resource path (
TYPE:
|
laktory.models.resources.databricks.aisearchindex.AiSearchIndexDirectAccessIndexSpec
¤
Bases: BaseModel
| PARAMETER | DESCRIPTION |
|---|---|
embedding_source_columns
|
The columns that contain the embedding source
TYPE:
|
embedding_vector_columns
|
The columns that contain the embedding vectors
TYPE:
|
schema_json_
|
The schema of the index in JSON format. Supported types are
TYPE:
|
laktory.models.resources.databricks.aisearchindex.AiSearchIndexDirectAccessIndexSpecEmbeddingSourceColumns
¤
Bases: BaseModel
| PARAMETER | DESCRIPTION |
|---|---|
embedding_model_endpoint
|
Name of the embedding model endpoint, used by default for both ingestion and querying
TYPE:
|
model_endpoint_name_for_query
|
Name of the embedding model endpoint which, if specified, is used for querying (not ingestion)
TYPE:
|
name
|
Name of the AI Search index. Server-assigned full resource path (
TYPE:
|
laktory.models.resources.databricks.aisearchindex.AiSearchIndexDirectAccessIndexSpecEmbeddingVectorColumns
¤
Bases: BaseModel
| PARAMETER | DESCRIPTION |
|---|---|
embedding_dimension
|
Dimension of the embedding vector
TYPE:
|
name
|
Name of the AI Search index. Server-assigned full resource path (
TYPE:
|
laktory.models.resources.databricks.aisearchindex.AiSearchIndexProviderConfig
¤
Bases: BaseModel
| PARAMETER | DESCRIPTION |
|---|---|
workspace_id
|
Workspace ID which the resource belongs to. This workspace must be part of the account which the provider is configured with
TYPE:
|