Tool for detecting and removing duplicates? [Available in 8.10.18]

(NOTE: there was a typo in the previous posting - the original script is 1pcsv.pl not 1pecsv.pl - so the usage of the script has the wrong name in it, sorry)

Here's a https://www.dropbox.com/s/w2ljygjicaxoca1/1p2csv.pl?dl=0 that bases the duplications on the domain of the URL - i.e., it ignores:
* http:// vs https://
* http://www. at the beginning
* anything following the first '/' (after the http:// has been removed)

so things like (space added to prevent these as showing up as links):
* http:/ /http://www.gianteagle.com/pharmacy
* https:/ /http://www.gianteagle.com/pharmacy
* https:/ /http://www.gianteagle.com/Sign-In/?return=https%3A%2F%2Fwww.gianteagle.com%2F
* http:/ /http://www.gianteagle.com
* https:/ /gianteagle.com

Would all be treated as duplicates of one another for the "gianteagle.com" domain.

Not sure if this is better than the previous script or should be run before or after the previous script - but regardless, it provides another means of finding duplications that you might want to archive/delete.

Usage (after downloading the script and having your 1Password CSV exported data):

 `cd ~/Downloads`
 `perl ./1p2csv.pl ./1PasswordExport-1234858.csv ./1pe2.csv1

In the end, you'd see:

 `RESULTS IN: ./1pe2.csv`

Again, you can then load up the result file in Numbers (or Excel, etc.) to then manually process it, going back and forth between the spreadsheet and 1Password to archive/delete duplications.

Hope this helps (I'm still working through cleaning up my data)