Cookie Consent
Hi, this website uses essential cookies to ensure its proper operation and tracking cookies to understand how you interact with it. The latter will be set only after consent.
Read our Privacy Policy
VOCABULARY

Large Language Model (LLM)

A Large Language Model (LLM) is a type of machine learning model that is trained on a vast amount of text data. Essentially, these models learn patterns in human language and generate text that mimics human-like writing. They are designed to improve performance in Natural Language Processing (NLP) tasks such as language translation, question answering, summarization, and more.

How Large Language Models work

Large Language Models learn from the statistical patterns in the data they are trained on. Typically, they are trained on entire internet text or sizable subsets of it. These models utilize algorithms such as the Transformer architecture, which allows them to understand the context in text data.

The models are trained to predict the probability of a word given its preceding words in a sentence, a process called autoregression. This way, they learn grammar, facts about the world, reasoning abilities, and also unfortunately, any biases in the data they were trained on.

For instance, models like OpenAI's GPT-3 consist of 175 billion machine learning parameters, enabling them to generate impressively human-like text. When given a prompt, these models can generate coherent and contextually relevant sentences. Furthermore, they can be fine-tuned for specific tasks, increasing their versatility and utility in various domains.

Lakera LLM Security Playbook
Learn how to protect against the most common LLM vulnerabilities

Download this guide to delve into the most common LLM security risks and ways to mitigate them.

Related terms
Activate
untouchable mode.
Get started for free.

Lakera Guard protects your LLM applications from cybersecurity risks with a single line of code. Get started in minutes. Become stronger every day.

Join our Slack Community.

Several people are typing about AI/ML security. 
Come join us and 1000+ others in a chat that’s thoroughly SFW.