The sort engine can handle files with millions of records. The concept is simple; one or many files go in and two files come out. The uniques in one file and the match duplicates in the other file.
Each file can have a priority level assigned to it. The file with the lowest number will be given preference for choosing the master record. If you give a priority of 0 to a file it automatically becomes a suppression file. Which means that any matches to this file will be considered duplicates and sent to the second output file. But... The records in the suppression file are not written to the first file. They are simply not written out at all.
After the process is completed there will be special indexing files sitting in the folder. These files will be used by the software in the future if needed. So if an input file has not changed the sorting process will be faster the second time that file is used.
And the format of the saved configuration file for your run is written in a basic scripting syntax and can be used for automation routines - if needed.
I've seen the term ASCII, but what is it? view it
We show you how to perform a Google Image Search that is customized to find images that fit your desktop size. view it
We point you to a free online tool you can use to calculate your body mass index and get a reading on what sort of shape you are in view it
Here's how to find products using Google Product Search! view it
Here's how to create a shopping list using Google Product Search! view it
We explain how to find product reviews using Google Product Search! view it
Narrowing down eBay search results to find exactly what you're looking for view it
