Skip to main content
November 27, 2021
Question

Tool for detecting and removing duplicates? [Available in 8.10.18]

  • November 27, 2021
  • 179 replies
  • 15906 views

https://1password.community/discussion/comment/697252/#Comment_697252

I have several logins that somehow have been duplicated in 1Password 8. This may have happened in different times when I've attempted to migrate my 1Password 7 data to my 1Password.com account.

In any case, I have a load of duplicates in 1Password 8 and it would be very helpful if there were an efficient tool or feature to help me merge/dedupe these entries (and ideally test them to make sure that I'm preserving the correct credentials).

Any thoughts/ideas for how to handle this situation?


1Password Version: 1Password for Mac 8.5.0 80500017, on BETA channel
Extension Version: 2.1.4
OS Version: macOS 12.0.1 (21A559)

https://1password.community/discussion/comment/662923/#Comment_662923

179 replies

DeppHeard
December 26, 2022

OK, so 4 months later. Where's the de-duplication feature? Just moving from LastPass because they are clowns, and now find that my import generated a bunch of duplicates (over 800 pairs). How do I clean this up?

Not 4 months, more like 13 months at least https://1password.community/discussion/125331/tool-for-detecting-and-removing-duplicates/p1

andrew_l_1P
1Password Employee
December 27, 2022

Hi @et01267,

Thanks for your feedback and welcome to 1Password!

I don't have any updates regarding a duplicate tool at the moment, but if you're seeing duplicate items from a repeat import on an otherwise empty account and you still have the source file, I recommend creating a new vault and importing your data again.

If your duplicates are in a user-made vault you can replace that vault with the new one. If your duplicates are in your Private vault you can delete its contents and then move the entirety of the new vault into your Private vault.

I recognize this is only viable for new accounts where re-importing is an option though so I'll add your feedback and use case to our internal discussion.

Let me know if you have any questions. 🙂

ref: IDEA-I-615

December 29, 2022

In my case, I have noticed that the duplication is actually in the exported LastPass passwords file. I went through that file line by line to remove the duplications before uploading to 1Password.

ctphoto
December 29, 2022

Perhaps for the new year 1Password will actually fix this. We can dream......

January 4, 2023

@andrew_l_1P i have just opened a 1p account as i am considering moving from lastp... (unmentionable) i have a family account and i moved everything across and i have 3 duplicates for every entry , so over 4000 entires in my single vault , I have yet to load the data for the rest of the families accounts in light of this.
we are now in 2023 and i see the lack of a duplicate tool has been hanging around here for over 8 months now like a bad smell, is there any light at the end of these requests for a duplicate tool or should i just move on ?

andrew_l_1P
1Password Employee
January 4, 2023

Hi @RowanFrancis,

Thanks for your consideration, I'm sorry to hear your initial import didn't go as smoothly as we would hope. You can find our latest information about this feature request in this post: https://1password.community/discussion/comment/662923/#Comment_662923 but essentially we're focusing our efforts on understanding and preventing duplicates in the first place.

If you're open to sharing more about your import workflow, I'm happy to help troubleshoot.

January 4, 2023

As I indicated in May 2022, the cleanup of my many duplicates took hours. Now I see, from @RowanFrancis, that helping customers solve this problem isn't a priority for 1Password. Which means, I assume, that they won't be doing anything about it at all. Meanwhile I'm now getting notifications urging me to update my 1Password app for Android to version 8. Not a chance in hell. I'll limp along with what I have now for as long as possible.,

DeppHeard
January 5, 2023

1Password support staff are not doing their job. Yes, in modern cynical world they are not expected to be acting in the interest of customer. But what about decency and morality? When there’s such outcry on a daily basis, that negates any good being provided and you’re not being able to fulfil the “satisfaction” part of customer support. You should quit this job or at least have a serious conversation with your employer. Unless you are a support person who is also cynical and indifferent towards customer then carry on.

January 8, 2023

Hello,
I understood it is not coming into new features...
I still needed to add another message to this thread, with my problem, similar to others when upgrading / mergin... with tons of duplicates.
I wish there was better solution, to avoid going one by one...

January 11, 2023

I just switched my family over from LastPass and am running into the same trouble. LastPass had some sort of convoluted feature that was called something like "consider as the same website," (I can't see it anymore because I just nuked my account after migrating here,) and it just linked subtly different addresses, external to an individual login entry- basically the same as 1Password's feature allowing a single logon to contain multiple websites. (I think your approach is simpler and makes more sense, but it needs to be automated.) LastPass however was able to do it automatically. I didn't even know their feature existed until I stumbled on it in their settings one day. Because I didn't need to know about it because it made my experience just work.

It's a pain for me, who is tech savvy, to go through ALL my Chase Bank logins for example, (https://secure01a.chase.com/web/auth/logonbox, https://secure01b.chase.com/web/auth/, https://secure03b.chase.com/web/auth/, https://secure05a.chase.com/web/auth/, https://secure05b.chase.com/, https://secure06ea.chase.com/web/auth/logonbox, etc...) and manually perform a SEVEN step process to move EACH website to just one Chase login entry. I have precisely 50 Chase login entries in 1Password at this time. That's 350 clicks just for ONE incredibly common and mainstream website. To ask my 73 year old mother to do this is utterly impossible. It's also far from easy for her to understand that if the first Chase login offered to her by 1Password doesn't work, that another, of maybe dozens, will likely work.

Forgive me if I sound a bit snarky. I just read a dozen separate threads in this forum going back 9 YEARS with many responses from your team disingenuously suggesting that this is an edge case that almost no one encounters and therefore not likely to be prioritized. Heck, so many major websites like Facebook have many different prefixes, as in http://www.facebook.com vs m.facebook.com, etc. This is a BASIC component of how websites function, and has been for decades. It's absurd that 1Password would consider each of those a separate login and provide no way for users to combine them swiftly, let alone handle it automatically in the background. At the very least, it should be supremely simple to add a manual user-triggered tool that allows me to select all my Chase entries at once, right-click, and then select Merge Websites Into One Login Entry. If there's any conflicting usernames, passwords, or more, just dump it all into the Notes field as appended data.

Please prioritize this entire problem.