Outliers: Keep Them, Remove Them, or Investigate?

A single weird value can distort your entire analysis. But outliers are also where the most interesting stories live. Knowing when to remove them is an art.

30 min · Reviewed 2026

The Value That Does Not Fit

You are analyzing student test scores. 98 percent of scores are between 60 and 100. One score is 3,400,000. Obviously a data-entry error. Remove it. But sometimes outliers are the real story: the one billionaire in an income dataset, the one fraudulent transaction, the one patient whose recovery changed medicine.

Three kinds of outliers

Type	Example	What to do
Error	Height of 2,340 cm	Remove or fix
Extreme but valid	CEO earning $500M	Keep, but note it
Anomaly of interest	Fraudulent transaction	That IS the signal

Detection methods

IQR rule: flag anything below Q1 - 1.5*IQR or above Q3 + 1.5*IQR
Z-score: flag anything with |z| > 3
Isolation Forest: ML-based anomaly detection, works in high dimensions
Domain knowledge: the best detector, often ignored

import pandas as pd import numpy as np df = pd.read_csv('data.csv') # IQR method Q1 = df['value'].quantile(0.25) Q3 = df['value'].quantile(0.75) IQR = Q3 - Q1 low = Q1 - 1.5 * IQR high = Q3 + 1.5 * IQR outliers = df[(df['value'] < low) | (df['value'] > high)] print(f'Found {len(outliers)} outliers out of {len(df)} rows') # Inspect before removing print(outliers.head(20))IQR-based outlier detection

Decision framework

Plot your data first — outliers often jump out visually
Check whether the outlier is likely an error (units, typos)
If it is an error, either fix or remove it and document why
If it is real, ask whether your analysis goal can tolerate extreme values
Consider using robust statistics (median, MAD) instead of removing
Report sensitivity: how much do results change with/without outliers?

Robust alternatives

Instead of removing outliers, use statistics that are less sensitive to them. The median is more robust than the mean. Median Absolute Deviation (MAD) is more robust than standard deviation. Robust regression methods like Huber loss can accept outliers without being distorted by them.

The big idea: outliers are questions, not answers. Investigate each one and decide deliberately, rather than scrubbing them reflexively. Sometimes the anomaly is the discovery.

End-of-lesson check

8 questions · take it digitally for instant feedback at tendril.neural-forge.io/learn/quiz/end-data-outliers

What is the main idea of "Outliers: Keep Them, Remove Them, or Investigate?"?
1. A single weird value can distort your entire analysis.
2. Use AI as the final authority for the whole decision
3. Avoid checking the answer once it sounds polished
4. Focus only on speed instead of judgment
Which concept is most central to "Outliers: Keep Them, Remove Them, or Investigate?"?
1. anomaly detection
2. outliers
3. robust statistics
4. outlier
Which use of AI fits this topic best?
1. Let the AI decide what matters without your review
2. Use the answer before checking whether it fits the situation
3. IQR rule: flag anything below Q1 - 1.5*IQR or above Q3 + 1.5*IQR
4. Treat the AI output as automatically correct
What should a careful learner remember about "Never blindly remove outliers"?
1. Use AI to draft or organize ideas about outliers, then verify before acting.
2. Skip the context so the tool can guess faster
3. Treat the output as private even after sharing it online
4. Use the answer without checking the source
You want to use AI after this lesson. What is the safest next step?
1. Act immediately because the AI answer is written clearly
2. Use AI for drafting and comparison, but verify before publishing or relying on it.
3. Hide uncertainty so the final answer looks cleaner
4. Use private or sensitive details before checking permission
How should AI output about outliers be treated?
1. As proof that no other source is needed
2. As a replacement for context, consent, or expert review
3. As a draft or helper output that still needs human judgment and verification
4. As something that becomes correct when it sounds confident
Name one way to verify an AI answer about outliers.
Which action would help you apply "Outliers: Keep Them, Remove Them, or Investigate?" responsibly?
1. Use the tool to avoid thinking through the tradeoff
2. Keep going even if the output conflicts with a trusted source
3. Treat the AI output as automatically correct
4. Z-score: flag anything with |z| > 3

← Back to interactive lesson

Tendril · Creators · AI Foundations