Tool for detecting and removing duplicates? [Available in 8.10.18]

Please add another vote for me. This is an important feature that I would have thought would have been included in the initial release, as it had been in previous versions of 1password.

Hi loyed256, thank you for the question - and I'm sorry to learn you've run into this duplicate issue! 👀

I'd like to connect you with one of our specialists teams who will be best positioned to help with this. Can you send a brief email to support+tradein@1Password.com, with a link to this discussion? They should be able to advise on the best solution, given the current state of your data.

And while 1Password 8 doesn't currently have a duplicate removal feature, I have put in a request for this with our development team and will be happy to add a vote on your behalf to that issue.

I hope this is helpful - and we'll look forward to resolving this for you! 👍

Where is the tool to resolve duplicates in v 8?

There is no Help > Tools any more. In fact I don't see Tools anywhere or any command to help resolve duplicates. Somehow in the move to v8 many of my 1000+ entries duplicated.

1Password Version: 8.7.0
Extension Version: Not Provided
OS Version: Not Provided

Just wanted to say thanks for the information on your use cases here, folks. This is an area we hope to improve and we appreciate the chance to understand the scenarios you're running into!

ref: IDEA-I-615

Hey WaltDittrich — that makes sense but is a bit impractical given that I've got 6000+ items (with the dupes. That said, I have created a few new vaults (for Work and Family sharing), and those are indeed much cleaner!

All in all, I can search and generally get to the items I need... the real bother is when I go to update a password and I have to pick the item I want to hold on to! It can be hard to sort through the recent items when all these dupes are floating around.

I came here because I, too, moved my Primary vault items to my Private folder. 850 items, all seemed to be duplicates. Fortunately, I'm still with 1Password 7 for Mac, so my removal tool took away about 550.

@"Chris Messina" , I think one method for you might be to Move everything over to a new Vault. Then, as you use items, move them back into your Private vault. This will cut out you seeing the duplicates as you slowly build your Private vault back up.
It's sort of like moving everything from your e-mail Inbox to a separate folder. Then work towards keeping your Inbox emptied. The stuff is all still there, but not right in front of your face causing havoc.
(Gosh I hope this makes sense.)

I agree, duplications (past and present) is definitely something that we can do better at.

Part of the big change to 1Password 8 was to stop developing separate apps with different feature-sets (see duplication tool only available in 1Password for Mac) and implement a common core - this allows us to implement a feature once and have it work effortlessly on all platforms at the same time.

I'm hopeful that as we keep working along that vein a more robust duplication tool can be implemented, but as Ben mentioned we are unfortunately unable to offer any promises for the future. Know that we're also very interested in improvements in this area, and we'll keep advocating for it on our end. :smile:

One aspect of this I'd like to see us focus on is the prevention of the creation of duplicate items in the first place.

Yes, that would be helpful.

Of course that doesn't help folks that already have duplicates, and I hope we can address that as well.

But no, it wouldn't help in my case. Such it is.

I will point out that I don't recall ever "importing" entries through "the front door" as it were ... instead I dragged and dropped thousands of entries from my local vault into my 1password.com vaults — but since I couldn't tell which ones I'd saved locally vs saved in my synced vaults, I assumed that 1Password would maintain internal UUIDs for each item, and catch the conflicts automatically. That clearly didn't happen — and so when I dragged and dropped items from one vault into another, I screwed myself over in ways that I didn't anticipate.

Perhaps that's something that should be considered — and a warning or prompt added when >100 items are dragged from one vault to another... that duplicates might be created?

One aspect of this I'd like to see us focus on is the prevention of the creation of duplicate items in the first place.

Yes, that would be helpful.

Of course that doesn't help folks that already have duplicates, and I hope we can address that as well.

But no, it wouldn't help in my case. Such it is.

I will point out that I don't recall ever "importing" entries through "the front door" as it were ... instead I dragged and dropped thousands of entries from my local vault into my 1password.com vaults — but since I couldn't tell which ones I'd saved locally vs saved in my synced vaults, I assumed that 1Password would maintain internal UUIDs for each item, and catch the conflicts automatically and ask me what I wanted to do with them.

Clearly that didn't happen — so I just want to point out that I didn't "import" in any conventional way, but used drag and drop between vaults to fuck myself over.

@"Chris Messina"

That's a real bummer. I'm sorry. 😞 There are a number of different ways duplicates (or similar items) can occur, and as a result it is likely that more than one solution will be required.

1. For imports (v7), as Ana mentioned, a tag is created for the imported items. This makes it easy to identify which items were imported when, and if an import is accidentally performed twice it'd be possible to simply delete all of the items with one tag or the other. v8 does not yet support importing, but hopefully we'll do the same or similar there.
2. For migrations from standalone, we now write out a hidden "migration receipt," which tracks what has been migrated, in an attempt to prevent duplicate migrations. This does break down if that receipt, stored in each standalone vault, doesn't get synced between your devices, though.
3. The browser extension(s) used to lead to duplicate items being saved, though we've made improvements in this regard and I rarely see opportunity for duplicates since the in-line menu. It is possible though that there is still room for further improvement here.

One aspect of this I'd like to see us focus on is the prevention of the creation of duplicate items in the first place. We've made some good changes in this regard as outlined above, but it'd be great to do more. Of course that doesn't help folks that already have duplicates, and I hope we can address that as well. I don't know of anything definite planned at this time, but I will continue to push for a solution.

Ben