Remove Duplicate Lines
🔒 Your files are deleted from our servers automatically 20 minutes after processing. We don’t store or keep anyone’s data.
🔒 Your files are deleted from our servers automatically 20 minutes after processing. We don’t store or keep anyone’s data.
This free tool removes duplicate lines from your text the moment you paste it. Paste a list, log, or anything copied from a text file and every repeated line is stripped out in one click — keeping the original order by default. No signup, nothing uploaded, no waiting.
It's a complete remove duplicate lines tool: keep the first of each line and drop the rest, remove duplicates and sort the result alphabetically, or flip it around to keep only duplicates so you can see what repeated. Turn on Ignore case so 'Apple' and 'apple' count as the same line, or Trim each line so trailing spaces don't hide a match. Whether you're cleaning a list pasted from a text file, an export, or a spreadsheet column, this online tool does it live in your browser so your data stays private.
To remove duplicate lines from text, paste your list or document into the box and pick a mode. Remove duplicates keeps the first time each line appears and drops every later repeat, preserving the original order — ideal for cleaning a list of emails, URLs or keywords. Remove + sort does the same but also sorts the unique lines alphabetically. Keep only duplicates flips it around, showing just the lines that appeared more than once, which is handy when you want to find the repeats rather than remove them.
Two options make matching reliable. Ignore case treats 'Apple' and 'apple' as the same line, so different capitalisation doesn't slip a duplicate through. Trim each line strips leading and trailing spaces before comparing, so 'cat' and 'cat ' are matched as identical. Together they catch the near-duplicates that a strict line-by-line match would miss — useful when you're cleaning data pasted from a text file or a spreadsheet.
People also look for how to remove duplicate lines in Excel or Unix. In Excel you'd use Data ▸ Remove Duplicates on a column; on Unix you'd run sort file.txt | uniq (or awk '!seen[$0]++' file.txt to keep order). Those work well for files, but for a quick one-off it's faster to paste the lines here, click a mode, and copy the clean result — no command line or spreadsheet needed.
To use it, paste your text, choose Remove duplicates, Remove + sort or Keep only duplicates, tick Ignore case or Trim if needed, and copy the output. Everything runs locally in your browser, so your text never leaves your device — no upload, no signup and no waiting. It's a fast, free and private way to remove duplicate lines from a text file or any block of text.
Paste your text into this free tool and choose Remove duplicates. It keeps the first of each line and removes every later repeat, preserving the original order — instant, with no signup.
Yes. Remove duplicates keeps the first occurrence of each line in its original position. If you'd rather sort the unique lines alphabetically, choose Remove + sort instead.
Yes. Choose Keep only duplicates and the tool shows just the lines that appeared more than once, so you can find the repeats instead of removing them.
Turn on Ignore case so 'Apple' and 'apple' count as the same line, and Trim each line so leading or trailing spaces don't stop a match. You can use both together.
In Excel use Data ▸ Remove Duplicates on the column. On Unix, sort file.txt | uniq removes duplicates, or awk '!seen[$0]++' file.txt removes them while keeping order. For a quick job, pasting the lines here is faster.
This tool removes duplicate lines, not duplicate line breaks. To collapse blank lines and extra breaks, use the Remove Line Breaks tool instead.
Yes. It's completely free with no signup, and it runs entirely in your browser, so your text never leaves your device or gets shared with anyone.