large language
Step 3.7 Flash
Step 3.7 FlashStep 3.7 Flash is a 198B sparse MoE vision-language model (~11B active params/token) built for high-frequency agentic workloads.
Model details
View repositoryExample usage
Input
This is a minimal image understanding example taking from Step 3.7 Flash Quickstart.
1from openai import OpenAI
2import os
3
4model_url = "" # Copy in from API pane in Baseten model dashboard
5
6client = OpenAI(
7 api_key=os.environ['BASETEN_API_KEY'],
8 base_url=model_url
9)
10
11# Taken from https://platform.stepfun.ai/docs/en/guides/models/step-3.7-flash-quickstart#minimal-example
12response = client.chat.completions.create(
13 model="stepfun-ai/Step-3.7-Flash-FP8",
14 messages=[{
15 "role": "user",
16 "content": [
17 {
18 "type": "text",
19 "text": "What's in this image? Describe it in 100 words or less."
20 },
21 {
22 "type": "image_url",
23 "image_url": {
24 "url": "https://postimg.aliavv.com/step/daesog.png"
25 }
26 }
27 ]
28 }],
29 max_completion_tokens=500,
30)
31
32print(response.to_json())JSON output
1{
2 "choices": [
3 {
4 "finish_reason": "length",
5 "index": 0,
6 "logprobs": null,
7 "message": {
8 "content": "This aerial view captures the sprawling Shanghai skyline",
9 "refusal": null,
10 "role": "assistant",
11 "annotations": null,
12 "audio": null,
13 "function_call": null,
14 "tool_calls": [],
15 "reasoning": "The user wants a description of the image provided.\nThe image is a high-angle, nighttime aerial shot of a major city, specifically Shanghai.\nKey elements to identify:\n- The river: The Huangpu River snakes through the middle.\n- The skyline: Many tall, modern skyscrapers.\n- Distinctive buildings:\n - The Oriental Pearl Tower is visible on the right, lower down.\n - The Shanghai World Financial Center (the one with the hole at the top) is not the most prominent, but there's a tall, thin one (Shanghai Tower) and the Jin Mao Tower.\n - The Lujiazui district is in the foreground (Pudong side).\n - The Bund is on the left bank (Puxi side), though it's harder to distinguish individual colonial buildings due to the angle/distance, but the density of lights indicates it.\n - The Nanpu Bridge curve is visible in the far background on the left.\n- Lighting: City lights, street lights, car lights creating streaks.\n- Atmosphere: Haze, smog, dark blue/moody tone (teal and orange look).\n- Watermark: \"Unsplash+\" is visible.\n\nDrafting the description:\nThis is an aerial night view of Shanghai, China. The Huangpu River curves through the center of the frame, separating the Pudong district in the foreground from Puxi in the background. Dominating the right side is the Oriental Pearl Tower. Luminous skyscrapers, including the twisting Shanghai Tower and the stepped Jin Mao Tower, rise from the riverfront. Traffic trails along the highways and the Nanpu Bridge is visible in the distance on the left. The city is bathed in warm artificial lights against a hazy, dark blue sky, showcasing a dense urban metropolis.\n\nRefining for length (under 100 words):\nThis aerial view captures the sprawling Shanghai skyline at night. The Huangpu River curves through the center, separating the illuminated skyscrapers of the Pudong district in the foreground from the dense urban fabric of Puxi in the background. Prominent structures like the Oriental Pearl Tower and twisting high-rises are bathed in warm light against a hazy, dark atmosphere. Vehicles create glowing streaks on the highways and bridges, emphasizing the city's vibrant, bustling energy.\n\nWord count check: ~85 words. This fits the criteria."
16 },
17 "stop_reason": null,
18 "token_ids": null,
19 "routed_experts": null
20 }
21 ],
22 "created": "xxxx",
23 "model": "stepfun-ai/Step-3.7-Flash-FP8",
24 "object": "chat.completion",
25 "usage": {
26 "completion_tokens": 500,
27 "prompt_tokens": 1196,
28 "total_tokens": 1696,
29 "prompt_tokens_details": null
30 },
31 "prompt_logprobs": null,
32 "prompt_token_ids": null,
33 "prompt_text": null,
34 "kv_transfer_params": null
35}
