How to use the Remove Duplicate Lines
- Paste your list, one item per line.
- Choose case sensitivity and trimming options.
- See how many duplicates were removed.
- Copy the unique lines.
Example
| Input | apple banana apple Cherry banana |
|---|---|
| Result | apple banana Cherry |
Four ways to work with duplicates
Choose what you want from the Output menu:
- Remove duplicates (keep first): each line appears once, in the order it first appeared.
- Show only duplicated lines: lists the lines that appear more than once, with how many times.
- Show only lines that appear once: removes everything that was repeated, leaving the unique entries.
- Unique lines with counts: every distinct line with a count such as (×3).
Options that decide what counts as a duplicate
- Ignore case: treats “Apple” and “apple” as the same line. Off by default.
- Trim spaces before comparing: ignores spaces at the start and end of lines. On by default.
- Remove empty lines: drops blank lines. On by default. Turn it off to keep them.
- Sort result A–Z: sorts the output alphabetically, with numbers in natural order.
The summary under the result says how many duplicate lines were removed and how many unique lines remain.
Useful for
- Cleaning keyword, tag and email lists before you import them.
- Finding repeated entries in logs, exports and spreadsheets columns.
- Merging two lists by pasting both together, removing duplicates, then sorting.
- Checking which items of a list appear only once.
Tips
Items are compared as whole lines, so “apple” and “apple pie” are different. If your list is separated by commas instead of line breaks, put each item on its own line first. To compare two separate lists rather than clean one, use the Compare Lists, and to order your lines use the Sort Lines Alphabetically.
Frequently asked questions
Can I see which lines are duplicated?
Yes. Change “Output” to show only duplicated lines (with how many times each appears), only lines that appear once, or every unique line with its count.
Does it keep the original order?
Yes. The first occurrence of each line stays in its original position; later repeats are removed.
What does “ignore case” do?
With ignore case on, “Apple” and “apple” count as duplicates. With it off, they are treated as different lines.
Does it work with a very long list?
Yes. Long lists of thousands of lines are handled in your browser, so the speed depends on your device.
Why was a similar line not removed?
Lines must match exactly. Differences in capital letters or spaces count unless you tick “Ignore case” or keep “Trim spaces before comparing” on.