Remove Duplicate Lines
Paste a list with one item per line and get back only the unique lines, in their original order. Choose whether to trim spaces, ignore case, drop blanks or sort. Nothing leaves your browser.
Remove duplicate lines
Paste a list to begin.
How to remove duplicate lines
- Paste your list into the box, one item per line.
- Tick the options you need: trim spaces, ignore case, remove empty lines or sort.
- The result updates as you go, with a count of how many duplicates were removed.
- Press Copy result.
How duplicates are detected
A line is a duplicate when it matches an earlier line exactly. The first occurrence is kept and later ones are removed, so the original order is preserved unless you tick sort. With Trim spaces on (the default), apple and apple count as the same. Turn on Ignore case to treat Apple and apple as the same too.
Clean up lists of emails, keywords and URLs
It is useful for cleaning keyword lists, mailing lists, URL lists, product codes and log extracts. Put one item on each line, tick Ignore case for things like email addresses, and copy the cleaned list back out.
Remove empty lines and sort
Remove empty lines drops blank lines before counting. Sort A to Z orders the unique lines alphabetically, which makes the list easier to scan.
Large lists
Lists with tens of thousands of lines work comfortably on most devices. Very large files depend on your browser's memory.
Frequently asked questions
How do I remove duplicates from a list online?
Paste the list, one item per line, and read the unique lines in the result box.
Does it keep the original order?
Yes, unless you tick Sort A to Z. The first occurrence of each line is kept.
How do I ignore upper and lower case?
Tick Ignore case. Apple and apple are then treated as the same line.
Can I remove blank lines at the same time?
Yes. Tick Remove empty lines.
Is my list uploaded?
No. It is processed in your browser.