Remove Duplicate Lines
Clean up any list in seconds – remove repeated lines, keep only unique ones, find the duplicates or count how often each line appears, with options to ignore case, spaces and punctuation.
- Dedupe, unique or count
- Ignore case and spaces
- Sort the result
- Runs in your browser
More options
Processed in your browser – your text is never uploaded.
How to remove duplicate lines
- Paste your listPaste lines of text into the left box, or open or drop a .txt or .csv file. Press Sample to try it.
- Choose what to keepRemove duplicates, keep only lines that appear once, show only the repeated lines, or count every line. Ignore case, spaces or punctuation if you need to.
- Copy the clean listThe result updates instantly. Copy it, download it as .txt, or move it back to the input for more cleaning.
Common clean-up jobs
| Job | Settings |
|---|---|
| Clean an email list | Remove duplicates + Ignore case + Ignore spaces at the ends |
| Find people who signed up twice | Show only duplicates (compare the email column of a CSV) |
| Keep entries that appear in only one of two lists | Paste both lists, then Only unique lines |
| See the most common search terms or log entries | Count every line (sorted by most repeated) |
| Alphabetical list without repeats | Remove duplicates + Sort A → Z |
Natural sorting puts “item 2” before “item 10”, and accented letters sort as you’d expect. Counting output is tab-separated, so you can paste it straight into a spreadsheet.
Frequently asked questions
How do I remove duplicate lines?
Paste your text and keep “Remove duplicates” selected. Every repeated line is removed and the first copy of each stays in its original position. Choose “Keep last” if the newest entry is at the bottom.
Can I ignore upper and lower case?
Yes. Tick “Ignore case” and Apple, apple and APPLE count as the same line. The kept line keeps its original spelling.
What’s the difference between “Remove duplicates” and “Only unique lines”?
Remove duplicates keeps one copy of every line. Only unique lines keeps just the lines that appeared once – anything that was repeated is removed completely. That’s useful for finding entries that appear in only one of two merged lists.
How do I find which lines are duplicated?
Choose “Show only duplicates” to list each repeated line once, or look at the Duplicated lines panel, which shows how many times each appears and jumps to it in your text.
Can it remove duplicates based on one column of a CSV?
Yes. Under Compare, choose the column number and separator. Rows are then treated as duplicates when that column matches – for example, the same email address with different names.
How many lines can it handle?
Hundreds of thousands of lines work smoothly in a modern browser, and files up to 50 MB can be opened. Everything stays on your device.
Does it change my original text?
No. The input is left as it is, and the cleaned list appears on the right. Use “Use as input” if you want to keep working on the result.
Related tools
Last updated: