Remove Duplicates node

Remove duplicate items, either fully identical ones or those with equal values in selected fields. Dedupes within the current run only.

Use Remove Duplicates as a clearly defined step in an anymize workflow.

• Processes one input.
• Provides one output for following steps.
• Runs as a regular step in the flow.

1. 01Open a workflow and add Remove Duplicates from the node catalog.
2. 02Complete the required fields and map values from previous steps.
3. 03Run the node with a small test record and inspect its output.
4. 04Connect the successful output and activate the workflow after an end-to-end test.

Remove Duplicates has one focused purpose. Its available settings appear when you select the node.

Test-run example: begin with a small, recognizable record. Inspect the output and only map fields that are present there.

{
  "input": "value"
}

Before activation, review which data enters this step and what its output contains.

• No output: inspect the latest run and confirm that the previous node returned the expected fields.
• Empty variable: open the previous step output and use a field name from the real test data.