What is data scrubbing, and the rest of the questions
Data scrubbing is the same job as data cleaning: finding the records in a file that are duplicated, wrongly formatted or damaged, and putting them right. Below is every question people ask before they trust a tool with a customer list.
Answers, in the order people ask them
Does my file get uploaded anywhere?
What does it actually fix?
Will it change something I did not want changed?
How is this different from Remove Duplicates in Excel?
How is this different from OpenRefine?
How big a file can it handle?
What counts as a row?
Do you sell or train on my data?
Can my whole team use it? Is there SSO and a DPA?
What happens after I sign up?
Words this category uses interchangeably
Scrubbing, cleansing, cleaning, hygiene, deduplication and entity resolution overlap heavily. Here is what each one usually means when somebody says it.
- Data scrubbing
- Fixing or removing records that are wrong, damaged or duplicated in a file.
- Data cleansing
- The same job, usually said about a CRM or a database rather than about a file.
- Data hygiene
- Keeping it clean over time, as a habit rather than as a one-off project.
- Deduplication
- Specifically finding and collapsing records that describe the same thing.
- Fuzzy matching
- The technique that finds near duplicates which are not spelled identically.
- Entity resolution
- Deciding which records across sources refer to one real person or company.
- Normalization
- Putting values into one consistent form: dates, currencies, states, casing.
What happens when the engine gets it wrong
It will, on some column, on some file. The design of the whole tool assumes it.
How the process worksA wrong proposal costs one click
Rejecting it leaves the original value exactly as it was. Nothing is applied until you approve it, so a bad guess never reaches your data.
A misread column is visible
Column detection is a proposal too. When it reads a reference number as a date, you see it as a row of proposals you can reject together.
Your original file is untouched
The cleaned CSV is a new file. There is no in-place edit and no overwrite, so the worst case is that you close the tab.
Tell us which row
Send the column, the value it proposed and the value you expected to our email address. A few anonymised rows are enough.
The answer to most of these is on screen in a second
Load a sample and watch what it proposes and, just as usefully, what it leaves alone.
1. Load a file
Your file is read on your own machine. Nothing is uploaded, so nothing can leak.
Or start from a messy sample
Status
Loading the sample file.
File: CRM contact export
Rows
--
Columns
--
Changes
--
Duplicate rows
--
Date formats
--
Blank emails
--
Load a file to see the diff
Drop a CSV or pick one of the messy samples. Every proposed change appears here as a line you approve or reject.
2. Review every change
Nothing approved yet.
Nothing is applied to your file until you approve it, and your original file is never modified.
Proposed changes
Original Proposed
Showing the first 400 changes. 0 more are in the audit log download.
Duplicate clusters
Merge or keep both
Want this on bigger files, on a schedule, with your team?
Saved recipes, scheduled cleans and shared seats are part of the paid plans. Start with your email and we will send you a code.
3. Take the result
The downloads work without an email. The cleaned CSV contains only the changes you approved.
Clean the file, and be able to show what you changed
Try the demo on your own CSV first. It runs in your browser, it costs nothing, and no card is required.
No card required. Your file never leaves your computer.