Cookie Consent
Hi, this website uses essential cookies to ensure its proper operation and tracking cookies to understand how you interact with it. The latter will be set only after consent.
Read our Privacy Policy

LLM Agents

An LLM (large language model) Agent is an autonomous system built with a large language model as its central controller. Rather than just producing textual content, the LLM Agent is conceptualized as a robust general problem solver, inspired by demonstrations like AutoGPT, GPT-Engineer, and BabyAGI.

LLM Agents in practice

Core Controller

At the heart of the LLM Agent is the LLM, acting as the agent's brain, directing its actions and making decisions.


  1. Subgoal and Decomposition: The agent segments vast tasks into smaller, more manageable subgoals. This approach ensures intricate tasks are tackled efficiently.
  2. Reflection and Refinement: The LLM Agent possesses the capability for self-analysis and introspection. It reviews its past actions, learns from any errors, and fine-tunes its strategies for subsequent tasks, enhancing the outcome's quality.


  1. Short-term Memory: The agent utilizes the model's short-term memory for in-context learning, as discussed in Prompt Engineering.
  2. Long-term Memory: The agent can store and retrieve an infinite amount of data over prolonged durations. This is typically achieved through external vector storage systems and swift data retrieval processes.

Tool Use

The agent can interface with external APIs to gather additional data not encapsulated within the model's pre-trained weights. This includes obtaining real-time information, executing code, and accessing exclusive data sources, among others.

Lakera LLM Security Playbook
Learn how to protect against the most common LLM vulnerabilities

Download this guide to delve into the most common LLM security risks and ways to mitigate them.

Related terms
untouchable mode.
Get started for free.

Lakera Guard protects your LLM applications from cybersecurity risks with a single line of code. Get started in minutes. Become stronger every day.

Join our Slack Community.

Several people are typing about AI/ML security. 
Come join us and 1000+ others in a chat that’s thoroughly SFW.