How to Use the Text Line Deduplicator
The Text Line Deduplicator scans multi-line text for lines that repeat and keeps only the first occurrence of each, automatically filtering out the rest. It's handy for cleaning up a merged contact list or email list, or quickly removing duplicate rows from data copied out of a spreadsheet.
Paste your text into the box and each line is compared against the ones before it, preserving the order of first appearance while keeping only unique lines in the result. Turn on "Trim whitespace before comparing" to ignore trailing spaces or indentation differences when checking for duplicates, and turn on "Case-insensitive" to treat lines that only differ in letter case as the same line.
Above the result you'll see the total line count, unique line count, and how many duplicates were removed, so you can see exactly how much got cleaned up. The cleaned result can be copied to your clipboard with one click and pasted straight into another document or spreadsheet.
Frequently Asked Questions
Yes, the order of first appearance is kept, and only later duplicate occurrences of a line are removed.
By default only exactly identical lines are treated as duplicates. Turn on "Trim whitespace before comparing" to treat lines that differ only by leading/trailing spaces as duplicates.