Clean and deduplicate URL lists

What this template does

Accept credential-free HTTPS URLs, remove fragments, utm parameters, fbclid and gclid, sort remaining query keys and keep the first exact normalized URL.

Prepare these inputs

A list of URL strings. Path letter case and nontracking query parameters are preserved because changing them may change the destination resource.

Field map: url

From input to reviewable output.

Use the synthetic example or edit its JSON structure. This demo sends no input to an AI service or our server. Keep real personal data in your approved environment. Up to 1,000 records and 100 KB of JSON.

Ready. Run the sample to inspect the result.

Use the starter in n8n

1. Download the JSON and import it using n8n’s import-from-file option. Keep it unpublished.
2. Inspect the three nodes: Manual start → Sample input → Reviewable output. Run it manually with the synthetic example.
3. Compare records, rejected and the counts with the demo here. The output is one item containing an envelope; split the records array if a later node expects individual items.
4. Replace Sample input with an approved source only after mapping its data to the same single-item JSON structure shown above. Supply an explicit as_of where required.
5. Add a separate review or approval step before any external write. Test credentials and permissions in your own environment, then decide whether a schedule is appropriate.

The download has no live connector, schedule, credential or external request. Connecting a mailbox, CRM, spreadsheet or notification destination is a separate setup and test.

SHA-256: 1501403cbdc0258ba3f211b4232f2b629d219e92f3e7361e82cb49dbb828f2e1

Limits and review points

Removing a fragment can merge anchors or application routes. This is suitable for your chosen content inventory, not a universal proof that two URLs are equivalent or reachable. This uses a conservative ASCII HTTPS parser, with optional valid port and percent-encoded UTF-8 query values. IPv6 and raw Unicode URLs are rejected. Dot segments in paths are not resolved. This is string processing, not a full URL validator.

Rejected rows are returned with their one-based input position and a reason. Review them before using the result; an empty output can be a valid outcome. Unknown or malformed top-level inputs produce an error instead of a guessed result. Keep an untouched input export for reconciliation.

Run costs and data handling

The browser step has no service fee, API call or account requirement. It uses no browser storage for your input. Ordinary website access logs still apply. Downloaded results are saved only when you request them. Your own n8n hosting, cloud plan and any later connected service may have charges; no paid AI model is required by this starter.