Glossary & Key Formulas

Comprehensive reference for all key terms and mathematical formulas

Glossary Terms

Transformer Unit 1

Neural network architecture using self-attention mechanisms for parallel sequence processing.

Tokenization Unit 1

Process of splitting text into smaller units (tokens) for model processing.

Attention Mechanism Unit 1

Component that allows models to weigh the importance of different input parts.

Large Language Model (LLM) Unit 1

AI model trained on vast text data with billions of parameters.

Fine-tuning Unit 1

Process of further training a pre-trained model on specific domain data.

Embedding Unit 1

Numerical representation of text tokens in vector space.

Prompt Engineering Unit 1

Technique of designing inputs to guide AI model outputs.

Zero-shot Learning Unit 1

Model performing tasks without specific training examples.

Few-shot Learning Unit 1

Model learning from a small number of examples provided in the prompt.

Temperature Unit 1

Parameter controlling randomness in model output (0=deterministic, 1=creative).

Role Prompting Unit 2

Assigning a specific persona or role to the AI model.

Text Style Unbundling Unit 2

Decomposing text into isolated style features (tone, length, etc.).

Chain of Thought (CoT) Unit 2

Prompting technique encouraging step-by-step reasoning.

Meta Prompting Unit 2

Using prompts to generate or optimize other prompts.

Double-Barreled Question Unit 2

Survey question asking about two things at once.

Likert Scale Unit 2

Psychometric scale for measuring attitudes and opinions.

ReAct Framework Unit 3

Combining reasoning and acting in an iterative loop.

AI Agent Unit 3

Autonomous system that reasons, plans, and acts using tools.

LangChain Unit 3

Framework for building applications with LLMs and tools.

OpenAI Functions Unit 3

API feature enabling structured data extraction with defined schemas.

Tool Use Unit 3

Capability of AI models to interact with external systems and APIs.

Memory (AI) Unit 3

Component allowing agents to retain and recall past interactions.

Diffusion Model Unit 4

Generative model that creates images by reversing a noise-adding process.

Denoising Unit 4

Process of progressively removing noise to generate coherent outputs.

Latent Space Unit 4

Compressed representation where diffusion process occurs.

ControlNet Unit 4

Extension allowing structural control over diffusion model outputs.

Negative Prompt Unit 4

Instructions specifying what the model should NOT include.

Inpainting Unit 4

Technique for filling in missing or selected parts of an image.

Outpainting Unit 4

Technique for extending an image beyond its original borders.

img2img Unit 4

Image-to-image generation using reference images as starting point.

SEO (Search Engine Optimization) Unit 5

Practice of optimizing content for search engine visibility.

Keyword Density Unit 5

Frequency of target keywords in content relative to total word count.

Readability Score Unit 5

Metric measuring how easy text is to read (e.g., Flesch score).

A/B Testing Unit 5

Comparing two versions to determine which performs better.

Title Tag Unit 5

HTML element defining the title shown in search results.

Meta Description Unit 5

Summary text shown below title in search engine results.

Backlink Unit 5

Link from another website pointing to your content.

EEAT Unit 5

Experience, Expertise, Authoritativeness, Trustworthiness (Google quality guidelines).

API (Application Programming Interface) General

Set of protocols for building software applications.

Hallucination General

AI generating plausible but factually incorrect information.

Parameter General

Adjustable value in a model that is learned during training.

Inference General

Process of using a trained model to make predictions.

Token Limit General

Maximum number of tokens a model can process in one request.

Key Formulas

Cosine Similarity Unit 3

cos(θ) = (A·B) / (||A|| × ||B||)

Measures similarity between two vectors.

Attention Score Unit 1

Attention(Q,K,V) = softmax(QKT/√dk)V

Core transformer computation.

Support (Association Rules) Unit 5

Support(A→B) = P(A∪B) = count(A∪B)/N

Frequency of itemset.

Confidence Unit 5

Confidence(A→B) = Support(A∪B)/Support(A)

Conditional probability.

Lift Unit 5

Lift(A→B) = Confidence(A→B)/Support(B)

Strength of association.

F1 Score General

F1 = 2 × (Precision × Recall)/(Precision + Recall)

Harmonic mean.

Precision General

Precision = TP/(TP+FP)

Accuracy of positive predictions.

Recall General

Recall = TP/(TP+FN)

Coverage of actual positives.

Accuracy General

Accuracy = (TP+TN)/(TP+TN+FP+FN)

Overall correctness.

Temperature Sampling Unit 1

P(token) = exp(logit/temperature) / Σexp(logits/temperature)

Controls randomness.

Euclidean Distance Unit 4

d = √Σ(xi - yi)²

Distance between two points.

Elbow Method Unit 4

Optimal K where WCSS stops decreasing significantly

Heuristic for cluster count selection.

Gini Impurity Unit 4

Gini = 1 - Σpi²

Measure of node impurity.

TF-IDF Unit 5

TF-IDF(t,d) = TF(t,d) × log(N/DF(t))

Term importance measure.

Log Loss General

LogLoss = -(1/N)Σ[y·log(ŷ)+(1-y)·log(1-ŷ)]

Classification loss.