All posts
THE BLUENEXUS BLOGPRODUCT

Context is the new code: rethinking how we build AI agents

Context is the new code: rethinking how we build AI agents

The BlueNexus team are constantly researching emerging trends within the AI sector. Earlier this week we came across an extremely interesting article which proposed the notion of focusing strongly on context within LLM training methods. We find this particularly interesting as it strongly aligns with our product offering and wider vision of how AI not only should be developed, but how it must be developed.

What if the secret to building smarter AI agents wasn’t better models, but rather better memory & context? This is the core idea behind Yichao Ji’s recent writeup, which details lessons from developing Manus, a production-grade AI system that ditched traditional model training in favour of something far more agile: “context engineering”.

From training to thinking

Rather than teaching an LLM what to think through intensive fine-tuning, Manus has been focusing on designing how it thinks, via structured, persistent, runtime context.

Key tactics include:

  • KV-cache optimization to reduce latency and cost
  • External memory layers that store files and tasks without bloating prompts
  • Contextual “recitation”, for example agents reminding themselves of their to-do list
  • Error preservation as a learning loop
  • Tool masking over tool removal, to retain compatibility and stability

This approach points to a deeper shift in the LLM training debate, moving from “prompt engineering” to context architecture, and it’s changing how intelligent systems are being built.

Diving deeper

Ji’s article observes that developers still default to the “if the model isn’t good enough, retrain it” approach. But Manus demonstrates that this isn’t scalable. It’s expensive, brittle, & hard to maintain across use cases. Instead, they show that by designing the right context window with memory, goals, state, & constraints, developers can achieve robust agentic behavior from existing LLMs.

We don’t necessarily see this as a “workaround” but rather the new standard emerging, which is fantastic within the R&D lens of LLM training.

Obligatory mention that we carry some level of bias here, as this new standard plays straight into our wheelhouse.

Alas, BlueNexus agrees

We won’t sit here and “shill” this approach from the rooftops, but it’s fair to say this emerging standard aligns strongly with what we have been building.

The future of AI isn’t just about inference, speed or model accuracy. In our opinion it’s about relevance, continuity, portability and coordination.

By this we mean:

  • Knowing what data should (and shouldn’t) be in scope within any given prompt or automation
  • Remembering past actions across sessions & various tools / 3rd party applications
  • Structuring memory & state for reasoning, not just retrieval

Subscribe to our blog

Product insights, AI and product thinking delivered to your inbox.