
BAAI/BGE Embedding ICL
BGE Embedding ICL is an excellent all-around model for text embedding.
BAAI/bge-en-icl is a text-embeddings model, producing a 1D embeddings vector, given an input. It's frequently used for downstream tasks like clustering, used with vector databases.
This model is quantized to FP8 for deployment, which is supported by Nvidia's newest GPUs e.g. H100, H100_40GB or L4. Quantization is optional, but leads to higher efficiency.
Input
from openai import OpenAI
import os
client = OpenAI(
api_key=os.environ['BASETEN_API_KEY'],
base_url="https://model-xxxxxx.api.baseten.co/environments/production/sync/v1"
)
embedding = client.embeddings.create(
input="Baseten Embeddings are fast",
model="model"
)Output
{
"data": [
{
"embedding": [
0
],
"index": 0,
"object": "embedding"
}
],
"model": "thenlper/gte-base",
"object": "list",
"usage": {
"prompt_tokens": 512,
"total_tokens": 512
}
}