Text Processing Tools

These tools fix plain text that came from somewhere messy: a spreadsheet column, a PDF, a log file, an email thread or a query result. Developers use them to prepare values for code or SQL, analysts use them to tidy lists, and anyone can use them to get a list into a different shape without writing a script.

11 free tools · no sign-up · no ads

All Text Processing (11)

Which tool do I need?

  • Remove repeated email addresses without reordering the list

    Remove Duplicate Lines keeps the first occurrence of each line in its original position. Run Find Duplicate Entries first if you want to see which ones repeated and how often.

    Remove Duplicate LinesFind Duplicate Entries

  • Turn a column of IDs into a quoted list for a SQL IN clause

    Use Add Quotes to Lines in the Online Text Processor, then Lines to Comma to join them with commas and spaces.

    Online Text ProcessorLines to Comma

  • Fix text pasted from a PDF with odd spacing and gaps

    Remove Extra Spaces collapses runs of spaces, tabs and non-breaking spaces on each line, then Remove Empty Lines drops the blank lines left behind.

    Remove Extra SpacesRemove Empty Lines

  • Rename an identifier from camelCase to snake_case

    The Case Converter splits on humps, acronyms and separators and converts each line separately, so a whole column of names converts at once.

    Case Converter

  • Check a regular expression before putting it in code

    The Regex Tester runs your pattern and flags with JavaScript's own engine and shows every match or the first match with its capture groups.

    Regex Tester

  • Turn a multi-line message into a string literal

    Escape Characters turns line breaks, tabs, quotes and backslashes into \n, \t, \" and \\, and reverses them in one pass.

    Escape Characters Tool

About Text Processing

Most tools here do one operation and are named for it. The Online Text Processor puts sixteen of those operations on one page and edits the text in place, so you can chain them and undo a step. A common order for a pasted list is Remove Extra Spaces (which also turns non-breaking spaces into ordinary ones), then Remove Empty Lines, then Find Duplicate Entries to see what repeats, then Remove Duplicate Lines, and finally Lines to Comma to produce an IN list or a tag field. Comma to Lines goes the other way. Case Converter handles identifier styles such as snake_case and camelCase and splits acronyms like HTTP correctly, and Escape Characters converts between real line breaks and backslash escapes such as \n for string literals.

Two things are worth knowing about matching. Remove Duplicate Lines is exact and case-sensitive, so a trailing space or a capital letter makes two lines different, while Find Duplicate Entries trims and ignores case by default. The comma tools split on every comma, including ones inside quotes, so real CSV belongs in the CSV to JSON converter. The Regex Tester uses JavaScript's RegExp engine, so results match browser and Node.js code but can differ from PCRE, Python or Java. The Word Cloud Generator counts word frequency and draws it; quote its frequency table rather than the picture. Everything in this group runs in the browser.

Guides

Frequently asked questions

What order should I run text cleanup steps in?

Fix whitespace first, then blank lines, then duplicates, then join or split. Trailing spaces and non-breaking spaces make lines that look identical compare as different, so deduplicating before trimming leaves repeats behind. Joining last means you only quote and separate the values you are keeping.

Why do two lines that look the same still compare as different?

Usually an invisible character is involved: a trailing space or tab, a non-breaking space (U+00A0) from a web page, a Windows carriage return, a zero-width space (U+200B), or a difference in letter case. Remove Extra Spaces handles the first three, Find Duplicate Entries can ignore case, and zero-width spaces need a find and replace.

Can the text tools handle CSV with commas inside quoted fields?

No. Lines to Comma, Comma to Lines and the comma options in the Online Text Processor treat every comma as a separator and do not understand quoting. For real CSV use the CSV to JSON converter, which parses quoted fields, and for tab-separated exports use the TSV parser.

Do the text processing tools work with non-English text?

Yes for most operations, because they work on Unicode strings. The Case Converter keeps accented and non-Latin letters, and the Word Cloud Generator counts accented Latin, Cyrillic and Greek words whole. In the Regex Tester, add the u flag when your text contains emoji so each one counts as a single character.

How much text can these browser tools process at once?

Lists of hundreds of thousands of lines are fine for single operations such as Remove Duplicate Lines, which finishes in well under a second on a typical laptop. Pastes of tens of megabytes make the Online Text Processor sluggish, because every click reprocesses the whole text.

Is text pasted into the text processing tools sent anywhere?

No. Every tool in this group runs in your browser with JavaScript, and nothing you paste is uploaded or stored. Undo history in the Online Text Processor lives in the page and resets when you reload.