LLM
Ling 3.0 Flash INT4
Ling 3.0 Flash INT4Ling 3.0 Flash is an efficient 124B hybrid MoE model with 5.1B active parameters, 256K context, and strong coding and agentic reasoning.
Model details
View repositoryinclusionAI’s Ling-3.0-flash-int4 is an INT4-quantized version of its 124B-parameter Ling-3.0-flash reasoning model, built on a hybrid-linear sparse MoE architecture that activates only 5.1B parameters per token. With a 256K context window and near-BF16 benchmark performance, it is designed for efficient production inference across coding, deep research, instruction following, and long-running agentic workflows.
Input
1export BASETEN_MODEL_ID="<your-model-id>"
2
3curl -N -X POST \
4 "https://model-${BASETEN_MODEL_ID}.api.baseten.co/environments/production/sync/v1/chat/completions" \
5 -H "Authorization: Bearer $BASETEN_API_KEY" \
6 -H "Content-Type: application/json" \
7 -d '{"model": "inclusionAI/Ling-3.0-flash-int4",
8 "messages": [{"role": "user", "content": "hello!"}],
9 "chat_template_kwargs": {"enable_thinking": true},
10 "stream": true,
11 "temperature": 0.6,
12 "top_k": 20,
13 "top_p": 0.95
14 }'
