Skip to main content
November 27, 2021
Question

Tool for detecting and removing duplicates? [Available in 8.10.18]

  • November 27, 2021
  • 179 replies
  • 15906 views

https://1password.community/discussion/comment/697252/#Comment_697252

I have several logins that somehow have been duplicated in 1Password 8. This may have happened in different times when I've attempted to migrate my 1Password 7 data to my 1Password.com account.

In any case, I have a load of duplicates in 1Password 8 and it would be very helpful if there were an efficient tool or feature to help me merge/dedupe these entries (and ideally test them to make sure that I'm preserving the correct credentials).

Any thoughts/ideas for how to handle this situation?


1Password Version: 1Password for Mac 8.5.0 80500017, on BETA channel
Extension Version: 2.1.4
OS Version: macOS 12.0.1 (21A559)

https://1password.community/discussion/comment/662923/#Comment_662923

179 replies

September 1, 2022

I vote to bring v7 back.. V8 is a disaster.

September 1, 2022

I've got the same problem as mentioned before regarding the migration from 7 to 8. This is very, very annoying and almost unusable with thousands of duplicates.

andrew_l_1P
1Password Employee
September 2, 2022

Hi @ctphoto, @CFS, @mikefoley, @sandywiggins, @Steveo007, and @ronholledge,

Thanks for all the feedback here. I've filed votes on behalf of all those who mentioned bringing a duplicate remover tool to 1Password 8 in our internal tracker. While I don't have any updates to share currently, I understand how it would be useful and appreciate you taking the time to tell us it's important to you. 👍🏻

For anybody seeing a large volume of duplicate items after recently migrating to 1Password 8, please get in touch with us at support@1Password.com. We handle these on a case by case basis as the cause isn't always the same and we want to provide solutions that work for each individual's set up. You can include to a link to your post here in your email so we can link the two together.

Let me know if there are any questions. 🙂

ref: IDEA-I-615

September 4, 2022

Wow. I'm in the process of moving to 8 from 6, and am still on 7. I was out of sync via dropbox, so was going to import from both my home and work computer - thinking I'd get what was out of sync and eliminate duplicates.

Wow again - totally scared now. As I am still on 7 (on one computer) and not moved from 6 on the other computer - any suggestions? And where is the duplicate (identical) remover on 7 on the mac? Can't find it.

September 4, 2022

Ok, I'm an I/T guy, so I plowed in. Found eliminate duplicates in 7, but you can only run this against a single vault, not across vaults.

I'm still a bit shy on importing from computer 2, as I don't know if it will do an enmass import like it did with computer 1. I may have to do that one vault by vault. I also note that V6 was blown away during the 7 merge, so wouldn't even know how to get to the 6 backup data on that one. I did make a backup on computer 2, and copied it off to the desktop, but it is a .zip file vs. a .1pif or .csv, so have no clue if that would work.

So, yes, even if you are in the process - there are no help guides on making this conversion work properly without duplicates occurring and then, of course, you can't eliminate them in V8.

Still, any suggestions welcome.

September 4, 2022

Ok, so HERE'S a big question - let's say I abandon this entirely. How do I get back to 1password6 and just stay with what I have?
V6 seems to be gone.

September 4, 2022

You can add my vote for a "search duplicate" also.
although I'm not stuck with hundreds of duplicates, I've quite a few.

It would be nice to have a feature which allows to search for duplicates per field for example:
- search across (all) vault(s), field type : URL fields (because an item can have 1 or more URL field) for duplicate URLs
(or field name "website")
same for the fields "username" and "password" (use field name or type)

This way, I could search for example for all items which have duplicate URLs
or search all items which have both URL and password duplicate

If the "AND" / "OR" operator is too complex, a simple search for duplicates in 1 field would be nice already

September 11, 2022

+1

I'm a new user and the app/service looks great so far, but this is an important functionality that I'm surprised isn't available.

In my case, I've imported passwords from various sources (LastPass, KeePass, a couple of browsers, excel, notes, etc) and have tons of duplicate entries.

Any help the app can provide with organizing all this mess would be great.

Thank you!

spinoza
September 12, 2022

It's been 6 years we've been asking for a dedupe tool.

DeppHeard
September 21, 2022

I UNDERSTAND NOW! This is the punishment. The bug affects people who had perpetual license and upgraded to 8.0 with subscription. Those people were "freeloading" for a while using non-subscription bringing no money at all.
1Password decided deliberately not fix this bug to punish us. And maybe bug when migrating from license to subscription that creates duplicates without you knowing was deliberately ignore. I mean, how could you not catch that huge use case in testing?

To illustrate this, here's some of the features from 8.0-8.8 changelogs that were more important to spend time to develop:

  • The unlock animation has been sped up.
  • You can now search for untagged items using =untagged
  • The title of the Settings window now updates when changing the language in the app.
  • We’ve optimized and restored the menu animations to the app.
  • If collapsed, vaults and tags in the sidebar will temporarily expand if you drag an item over them.
  • You can now right-click items to permanently destroy them in the Recently Deleted list.
  • We’ve added additional animations to the lock screen.

All nice features, yes. but saving seconds of time at most, while duplicates would steal hours of your time.
Duplicates could be developed many times over. Why not? If this is not question of priorities then it's a deliberate omission of this function.

Threads of people begging for this function:

Reddit threads:

1Password developers, I will make it easier for you! No need to build any time consuming "diff" UI for this feature. Simply add search filter option, e.g. =duplicates or =redundant
Performing this search will filter all items that are redundant and safe to remove by criteria e.g.:
* There is another item with same title and fields.
* Item has older modification date than other identical items
* Same or less number of fields as other identical items

Then simply,

  1. enter =duplicates in search input,
  2. select all search results and
  3. delete/archive!

We can only dream.