✈️ Text Cleaner / Sanitizer
WHAT THIS DOES: Attempts to reduce (or hopefully remove) all watermarking from text, including AI-generated text.
WHY THIS IS HERE: It's actually handy for a lot of purposes. For AI text, there are a few notes: (1) Some people think running AI-generated text could harm SEO. I don't know of any evidence for that, but you never know. That said, (2) quite a lot of people use AI as much for editing as they do for composing. So, you should not (in my opinion) be pinged for pasting something that you wrote but your AI assistant edited/polished. Ergo, this tool could help you reclaim it, to to speak.
HOW TO USE: Input your text below, click the blue button, and your sanitized text will appear in the box below.
This code scans for and addresses the following:
- Change em dashes to --
- Change non-breaking spaces to regular
- Convert smart single quotes to normal
- Convert smart double quotes to normal
- Change ellipsis characters to ...
- Change en dashes to single dashes
- Address ligature (fi)
- Addres ligature (fl)
- Remove soft hyphens
- Remove zero-width spaces
- Remove zero-width non-joiners
- Remove zero-width joiners
- Replace bullet points with *
- Replace Cyrillic 'a' with a
- Replace Cyrillic 'i' with i
- Replace Cyrillic 'o' with o
- Replace accented 'a' with a
- Replace accented 'e' with e
- Replace accented 'i' with i
- Replace accented 'o' with o
- Replace accented 'u' with u
- Replace accented 'n' with n
- Remove space before a comma
- Remove space before periods
- Remove multiple commas
- Remove HTML comments
- Remove AI-GEN tag
- Replace tabs with ' '
- Remove private use area characters
- Remove repeated common words
- Deal with multiple line breaks
- Replace multiple spaces or tabs
- Remove markdown bold
- Remove markdown bold/italic
- Remove markdown italic
- Convert HTML entity & to &
- Convert HTML entity " to normal
- Convert HTML entity < to <
- Convert HTML entity > to >
- Remove trailing spaces