Validate Master Data Hub Batch Completion Across Sources
Last updated Tue Jul 19 2022
Use this recipe to connect your Hub synchronization processes with the Master Data Hub API to effectively query for batch completion across sources. The recipe includes:
- Quick steps for setting up the HTTP Client connector to query the batch history per Hub Repository, Model and Source
- Adjustable timing options for repeated batch history API calls
- Logic to query each Source sequentially before proceeding to the next processing step
Overview
In Boomi Master Data Hub synchronization designs, it is common to have one primary process which handles Source system updates to Hub and then consecutive branches which query the outbound channels of each Source.
After a Boomi Process sends a Golden Record Upsert request to Hub, there can be a delay before Hub has processed the request all the way through. This is due to the internal steps that Hub is doing behind the scenes such as validation, enrichment and matching. Before a Master Sync process moves on to any branch where it queries a Source’s outbound channels (or attempts to query a Golden Record directly), it can be helpful to confirm that the batch has finished all of its Hub processing.
This recipe includes an adjustable looping and timing pattern that calls the Query Batch History API endpoint to confirm that all current batches are in a completed state before moving on to any subsequent steps. In practice, this process can be called in your Master Hub Synchronization process in between any branches that do Upserts and any branches that query outbound channel updates.
Once this recipe is set up, you can be confident that your trusted golden record data is being effectively synchronized with all the systems that require it!
The recipe qualifies for Boomi’s Recipe Program
This Recipe is eligible for Boomi’s Recipe Program – that bundles free expertise from the Boomi PSO team included in the price of this prebuilt offering. The Boomi experts will help you get set up faster than ever, allowing you to get the most out of the Boomi AtomSphere Platform.