Remove Duplicate Data with a Process Shape

Last updated Mon Jul 25 2022

Set yourself up for success with this solution, which includes:

  • Steps for converting a document into a Flat File
  • How to combine multiple documents into one
  • Steps to configure a Data Process shape to spot duplicates

Overview:

One of the major challenges with data today is the issue of duplicate data. It can be misleading in so many ways and cause pain-points for any kind of business, small or large. Inaccurate reporting, missed sales opportunities, and lost productivity are only a few of the potentially devastating obstacles duplicate data can cause.

In this recipe, learn how to remove duplicates by using Boomi’s Data Process shape. The recipe starts off by pulling in multiple XML documents that are then converted into a flat files. From there, the documents are combined into one flat file document via the Data Process shape and then they are sent to a document cache that can be referenced at any point. The Document Cache is configured to only pull one line from a flat file, which will eliminate the possibility of introducing duplicate data.

Locating and eliminating duplicate data is a major piece in the ever expanding data integrity puzzle for businesses. Use Boomi Integration to help ease your businesses data duplication issues! Check out another way to remove duplicates by using a Map shape and a Profile Element here.

The recipe qualifies for Boomi’s Recipe Program

This Recipe is eligible for Boomi’s Recipe Program – that bundles free expertise from the Boomi PSO team included in the price of this prebuilt offering. The Boomi experts will help you get set up faster than ever, allowing you to get the most out of the Boomi AtomSphere Platform.

Learn More

Related Solutions

Accelerator

Boomi EDI Dashboard

Simplify EDI with End-to-End Visibility

Recipe

Cloud Atom Migration

Kick start your cloud atom migration process using this recipe. By utilizing Atomsphere API, various parts of the migration are automated.
Learn more

Recipe

Local Atom Migration

Kick start your local atom migration process using this recipe. By utilizing Atomsphere API, various parts of the migration are automated.
Learn more