Remove Duplicate Data with a Map Shape and Profile Element

Last updated Mon Jul 25 2022

Set yourself up for success with this solution, which includes:

  • Steps for converting a document into a Flat File format
  • Steps for combining multiple documents into one
  • Steps to configure a Profile Element to spot and remove duplicates


Duplicated data has been known to cause major problems for businesses. Introducing data that already exists in a system can cause confusion, misleading information and cost your business time and energy.

In this recipe, learn how to spot and remove duplicated data by using Boomi Integration in two different ways. This example walks through how to remove duplicate data with a Map and how to remove duplicated data with a flat file profile that is set to enforce uniqueness.

Regardless of the use case, duplicate data is something everyone wants to avoid. With the help of Boomi Integration, you can automate the process and be sure to never introduce duplicates and keep your data integrity. Check out another way to avoid introducing duplicates by using Boomi Integration via a Data Process shape here.

The recipe qualifies for Boomi’s Recipe Program.

Qualifying customers get access to Boomi’s Recipe Program* with the purchase of a Boomi subscription. As part of the Recipe Program you have direct access to a Boomi specialist to get you up and running with Boomi at no additional cost. Learn more

*Offer applies only to new customers and requires purchase of a qualifying Boomi subscription.

Related Solutions


Get Started with Structuring Complex Objects and Lists in Flow

Learn the importance of Types, Object Values, and List Values in flow and how to structure data in your flow build.
Learn more


Simply Vision: Boomi Monitoring Solution

Monitor your deployed assets and accurately forecast support requirements with Boomi!


Oracle Cloud ERP Integration Accelerator – HCM/HR: Employee by Apps Associates

Automatically load employee data into Oracle Cloud ERP and connect to HCM/HR systems with Boomi.