Package com.axelor.ai.chat.plugin

Class ContextWindowPlugin

java.lang.Object

com.axelor.ai.chat.plugin.ContextWindowPlugin

All Implemented Interfaces:

ChatPlugin

@Singleton
public class ContextWindowPlugin
extends Object
implements ChatPlugin

Manages the LLM context window by transparently trimming message history when it exceeds the model's input token limit. Uses a hybrid approach: older messages are summarized by the LLM, and a sliding window of recent messages is preserved intact.

Priority 40 makes this the outermost decorator. It intercepts the raw conversation messages before prompt enhancements are applied — system prompt (AgentResolverPlugin), RAG context (KnowledgePlugin), and skill context (SkillPlugin) are injected by inner decorators after trimming. The budget is computed dynamically by querying each plugin's ChatPlugin.estimateInjectedTokens(com.axelor.ai.chat.ChatRequest) to reserve accurate headroom for those injections.

A singleton: what it learns outlives a request — each model's calibration, each chat's summarization failures — while the streamer, and the plugin set with it, is built per request.

Method Summary

Modifier and Type	Method	Description
ChatProvider	decorateProvider(ChatRequest request, ChatProvider provider)	Wraps the provider to intercept or enrich LLM calls (e.g.
StreamWriter	decorateWriter(ChatRequest request, StreamWriter writer)	Wraps the stream writer to intercept events (e.g.
void	onComplete(ChatRequest request)	Called after the loop completes successfully.
void	onError(ChatRequest request, Exception error)	Called when the loop fails with an exception.
int	priority()	Execution priority.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface com.axelor.ai.chat.ChatPlugin

decorateToolExecutor, estimateInjectedTokens, onMessage, onRequest

Method Details

priority

public int priority()

Description copied from interface: ChatPlugin

Execution priority. Lower values run first. Default is 100.

Specified by:

priority in interface ChatPlugin

decorateWriter

public StreamWriter decorateWriter(ChatRequest request,
 StreamWriter writer)

Description copied from interface: ChatPlugin

Wraps the stream writer to intercept events (e.g. persistence, metrics).

Specified by:

decorateWriter in interface ChatPlugin

onComplete

public void onComplete(ChatRequest request)

Description copied from interface: ChatPlugin

Called after the loop completes successfully.

Specified by:

onComplete in interface ChatPlugin

onError

public void onError(ChatRequest request,
 Exception error)

Description copied from interface: ChatPlugin

Called when the loop fails with an exception.

Specified by:

onError in interface ChatPlugin

decorateProvider

public ChatProvider decorateProvider(ChatRequest request,
 ChatProvider provider)

Description copied from interface: ChatPlugin

Wraps the provider to intercept or enrich LLM calls (e.g. RAG, system prompt injection).

Specified by:

decorateProvider in interface ChatPlugin