Merge Dedupe Datasets
Merge Apify datasets and remove duplicates by any fields, keeping the first or the newest copy.
Merge Dedupe Datasets merges many Apify datasets into one and removes duplicates by any fields, including nested dot paths. It keeps the first or last copy of each duplicate and allows picking and renaming fields. The actor streams items page by page so memory stays low on large datasets.
Pricing starts from $0.03 per 1,000 results.
Summary drafted from the project's own website. Every sentence is backed by text on that page and was reviewed before publishing.