Clean a pasted list without sorting it. Find repeated lines, see how often each appears, and keep one copy of every entry—or show only repeated entries or entries that appear once.
Find and remove duplicate lines
Paste one item per line. Processing happens in your browser without uploading text.
Repeated lines and total occurrences
How to remove duplicate lines
- Paste your text with one item per line.
- Choose whether to trim outer spaces, ignore English letter case or remove blank lines.
- Click Find duplicates.
- Select a result, review it, then copy it or download a UTF-8 TXT file.
Three results for different tasks
- Keep one copy: remove extra copies while keeping every distinct entry.
- Only repeated lines: find entries that appear at least twice, displayed once each.
- Only lines that appear once: exclude every entry that repeats, including its first copy.
The repeated-lines panel shows total occurrences. For example, 3 × Apple means Apple appeared three times, so two extra copies are removed from the clean result.
A practical example
Paste Apple, Banana, Apple, Mango, Banana on five separate lines. The clean list is Apple, Banana, Mango. The repeated entries are Apple and Banana, with two occurrences each. The once-only result is Mango. Five entries become three distinct lines, with two extra copies removed.
What can you clean?
Try filenames, IDs, copied spreadsheet columns, keyword lists, URLs or complete repeated log lines. The first occurrence and its order are preserved. IDs remain text: 00123 and 123 are different entries.
Matching options and limits
By default, comparison is exact and case-sensitive. Outer spaces stay as pasted unless you enable trimming. Blank lines are removed by default. If you keep blanks, each identical blank line is treated like another repeated entry. English case ignoring keeps the spelling of the first copy. Internal spaces and punctuation still matter. Each input supports up to 200,000 characters.
This processes complete lines. It does not remove repeated words within a sentence, find paraphrases, or compare spreadsheet columns inside a CSV file. It does not decide whether similarly spelled names refer to the same person.
If duplicates are not detected
Check extra spaces, letter case and invisible characters copied from PDFs. Enable outer-space trimming if appropriate. Two visually similar Unicode strings may differ. A URL with a different query string is a different line. Review the output before replacing your original list.
Frequently asked questions
Does this preserve the original order?
Yes. The first copy of each matching line stays in its original order. The tool does not sort your list.
How do I count repeated lines?
Click Find duplicates and read the repeated-lines panel. Counts include the first appearance.
Can I remove all copies of repeated entries?
Yes. Choose Only lines that appear once. This excludes both the first copy and later copies of every repeated entry.
Does it support Hindi and emoji?
Yes. Hindi text and emoji remain text. Different Unicode spellings can still count as different entries.
Can I paste from Excel or Google Sheets?
Yes, paste a single column. No spreadsheet file upload or parsing is included.
Are capital and lowercase letters considered duplicates?
By default they are different. Enable Ignore English letter case to match Apple with apple.
Is pasted text uploaded?
The duplicate search runs locally in this browser without uploading your pasted text. Download or copy results before leaving.
Related tools
Compare two lists when you want common and missing entries between two separate lists. Clean copied PDF text before checking a list with broken lines. Browse all tools.