GeethanTechGeethanTechTech, decoded daily.
LatestAISoftware & PlatformsCybersecurityStartups & VentureTech Business & Markets
All posts
AIabout 1 month ago

DeepSeek-V4.1-Flash pairs cache changes with a new prompt format

The release changes how cached attention data is handled. Operators also need to account for its prompt format and the limits of its integration toolkit.

DeepSeek-V4.1-Flash pairs cache changes with a new prompt format

DeepSeek released DeepSeek-V4.1-Flash on September 10, 2026, with changes to attention caching and the prompt format used to connect applications to the model. For operators evaluating the release, memory figures and integration requirements deserve separate checks.

The model card describes image and text inputs, text output and a context window of up to one million tokens. The repository and model weights carry an MIT licence.

What the cache figure measures

DeepSeek reports a global key-value, or KV, cache footprint of 890 bytes per token, roughly a quarter of DeepSeek-V4-Flash’s. KV caching retains attention data that can be reused during generation.

The design combines a causal encoder-decoder structure with attention data shared across layers and FP4 caching. The decoder’s global cache is projected from the encoder’s final hidden states.

That global-cache measurement is not the model’s total serving-memory requirement. It does not establish that a deployment needs one-quarter of the hardware or delivers four times the throughput.

Prompt compatibility needs attention

The release has no Jinja-format chat template. Its encoding reference documents changes from V4, including revised tool-call tags, a numeric reasoning-effort setting and support for system messages within a conversation.

In that reference, reasoning effort accepts integers from 1 to 100. The setting applies in thinking mode and is inserted at the conversation’s beginning. Its completion parser expects well-formed output and does not repair malformed responses. Applications therefore need their own error handling.

For a team migrating an existing integration, those details make prompt and parser tests a practical first step before judging model quality.

The toolkit leaves deployment work to operators

DeepSeek’s separate deepseek-recipe toolkit provides Rust libraries and Python bindings for converting requests and parsing responses across several API formats. The caller still supplies inference, tool execution and HTTP transport.

Its documented gaps include enforcement of strict tool settings and JSON Schema output constraints, plus conversation retrieval through previous_response_id. Supporting a request format therefore does not establish complete behavioural compatibility.

The model’s inference example is explicitly a reference implementation, not a production serving engine. Deployment decisions still require workload-specific checks of memory, latency, output handling and failure behaviour.

Continue with this topicAI
Browse categoryarrow_forward
Continue reading

Related posts

A ribbed ceramic token sits in one recess of a terracotta disk, beside other empty recesses and a small green stop.
AI6 days agoBy megan

Google details Gemini agent identity, network and cost controls

Google says its new work agent will use a distinct identity, a policy gateway and a project spend cap. IT teams need to test how those controls behave and confirm which capabilities are available.

Read article
Abstract illustration of a vertical threshold separating cool grey and coral blocks, representing a price change above 100,000 prompt tokens.
AI7 days agoBy megan

Claude Haiku 5.5 costs more above 100K prompt tokens

Anthropic’s new small model offers low API rates for shorter prompts, but requests above 100,000 prompt tokens move to a higher price tier. A move from Haiku 4.5 also requires checks for token counts, thinking settings and request compatibility.

Read article
GeethanTech
GeethanTech
Tech, decoded daily.
Read
Latest postsAISoftware & PlatformsCybersecurityStartups & VentureTech Business & MarketsRSS feed
Connect
mailEmaillanguageWebsiteinLinkedInIGInstagramfFacebook@Xsmart_displayYouTube
From the publisher

Read all our publications: GeethanPost | GeethanTech

A chapter in the ElegantHumanity story

Powered byElegantArc