Free · no sign-up · runs in your browser
Remove Duplicate Lines Online
Paste any list — emails, roll numbers, URLs, keywords — and get unique lines back instantly, with occurrence counts. Optional case-insensitive matching, whitespace trimming and A→Z sorting.
De-duplicate your list
Results update as you type. Tweak the options any time — nothing is uploaded or stored.
Unique lines
Duplicate report — no duplicated lines
How it works
Three steps, all of them in your browser.
Drop your list into the box — one item per line. CRLF and LF line endings are both handled and normalised to LF on output.
Ignore case, trim surrounding spaces, drop blank lines, then sort A→Z or keep the original order. The first occurrence always survives — with its original spelling.
Read the stats bar, open the duplicate report to see the ×N counts, then copy the clean list or save it as a .txt file.
Built for real pasted lists
Deduplication is a single hash-map pass; huge pastes are chunked with a live progress line so the tab never locks up.
Every line is NFC-normalised before comparing, so look-alike invisible-character duplicates get caught too.
“[email protected] ” and “[email protected]” merge only when trimming is on — you decide how aggressive the match is.
Lines in, unique lines, duplicates removed and characters saved, updated within milliseconds of every change.
A collapsible table lists each repeated value with a ×N chip, sorted by frequency and capped at 100 rows.
No sign-up, no upload, no server round-trip: your text never leaves the device you are typing on.
FAQ
Does “ignore case” lowercase my output?
No. Matching is case-insensitive, but the output always keeps the spelling of the first occurrence — “[email protected]” stays exactly as you first typed it.
Is my list uploaded anywhere?
Never. All de-duplication runs in your browser with JavaScript; the page makes no requests while you work, so even confidential lists stay local.
How large a paste can it handle?
Up to 20,000,000 characters. Pastes above 2,000,000 characters show a notice and are processed in chunks so the page stays responsive.
Which line endings does it produce?
Windows (CRLF), old Mac (CR) and Unix (LF) input are all accepted and written out as clean LF — copy-paste friendly everywhere.
Can I keep the order of my list?
Yes — “Keep original order” is the default and preserves the first occurrence of each line. Choosing A→Z or Z→A sorts the unique lines only, using a stable, number-aware comparison.
Why does a line still appear twice after trimming?
Check the duplicate report: if two entries differ inside the line (double spaces, dashes, accents) they are genuinely different values. Turn on trimming for edge whitespace, but inner differences are always kept.
Latest updates
More free tools
Step-by-step guides in our blog & guides.