Remove Duplicate Lines
Remove duplicate lines from a list.
Result
The de-duplicated list will appear here.
How to use it
- Paste your list, one item per line.
- Choose whether to ignore case and surrounding spaces.
- Copy the de-duplicated list.
About this tool
This tool removes repeated lines from a list and keeps the first occurrence of each, preserving the original order. You can ignore leading and trailing spaces and ignore case when deciding what counts as a duplicate. It compares whole lines, so two lines that differ by any visible character are both kept.
Examples
Input
apple, banana, apple, cherry (one per line)Output
apple, banana, cherryInput
Apple and apple with ignore case onOutput
Only the first is keptCommon uses
- Clean a list of emails or keywords
- Remove repeated entries from data
- Tidy a copy pasted list
- Deduplicate log or export lines
FAQ
Is my list uploaded?
No. De-duplication runs in your browser. Nothing you paste is sent anywhere.
Which copy of a duplicate is kept?
The first occurrence, and the original order of the remaining lines is preserved.
Can it ignore case and spacing?
Yes. Toggle ignore case and ignore surrounding spaces to control what counts as a duplicate.
Related tools
Text
Word Counter
Count words, characters, sentences, and reading time live.
Open toolText
Case Converter
Convert text between UPPERCASE, lowercase, Title, camelCase, snake_case, kebab-case.
Open toolText
Reverse Text
Reverse text by characters, words, or lines.
Open toolText
Lorem Ipsum Generator
Generate lorem ipsum placeholder text.
Open toolText
X Character Counter
Count characters against X (Twitter) limits, live.
Open toolEmbed this tool
Paste this snippet to put the tool on your own site. It runs entirely in the visitor's browser, the same as it does here.