Skip to main content
November 27, 2021
Question

Tool for detecting and removing duplicates? [Available in 8.10.18]

  • November 27, 2021
  • 179 replies
  • 15906 views

https://1password.community/discussion/comment/697252/#Comment_697252

I have several logins that somehow have been duplicated in 1Password 8. This may have happened in different times when I've attempted to migrate my 1Password 7 data to my 1Password.com account.

In any case, I have a load of duplicates in 1Password 8 and it would be very helpful if there were an efficient tool or feature to help me merge/dedupe these entries (and ideally test them to make sure that I'm preserving the correct credentials).

Any thoughts/ideas for how to handle this situation?


1Password Version: 1Password for Mac 8.5.0 80500017, on BETA channel
Extension Version: 2.1.4
OS Version: macOS 12.0.1 (21A559)

https://1password.community/discussion/comment/662923/#Comment_662923

179 replies

DeppHeard
October 27, 2022

In today's news "Features that were more important to develop than Duplicate Removal" :

We’ve added a tooltip to the delete buttons in the item editor.
We’ve fixed an issue that caused the scrollbar to display in dialogues where it should be hidden.
We’ve fixed an issue that caused signing in to accounts to be slow.
...

November 1, 2022

Dear 1Password team, please give this feature a higher priority. The chaos in my vault is unbearable. :-( In short: +1 from me.

1Password Employee
November 1, 2022

I wish I had more encouraging news to share, but at this time this is not something that is on our roadmap. I'll continue to advocate for it, but as it stands I don't think a duplicate cleanup tool is something we'll see in 1Password in the foreseeable future.

What I do think we'll make efforts toward is preventing as many duplicates from being created in the first place. These efforts will likely focus around the import process and the in-browser experience.

As for what is currently available to help clean up duplicates:

  • Watchtower's Reused Passwords checker
  • Sort options: sort by title to spot similarly named items (e.g. multiple "Google" items)
  • Creation and modification timestamps on item details

We'll continue to gather feedback on the situation. With that feedback if you can please include:

  • Any guesses as to how you ended up with duplicate items e.g. from import, migration, or saving multiple times from the browser extension
  • Any brainstorming you might have about how 1Password can help you find duplicates, beyond what I've mentioned above
  • What 1Password can do / help you do once a duplicate is identified
  • For your items that are "duplicates"... are they exact duplicates, or just similar items? In what ways are they different?

Having a better understanding of the answers to those questions may help with getting forward momentum here.

Ben

ctphoto
November 1, 2022

"but at this time this is not something that is on our roadmap." WTF? Do you folks have any idea how frustrating this is to your customers? LastPass is starting to look pretty good!

DeppHeard
November 1, 2022

If not this, then what is on your roadmap that is more important?
From last release changelog -

We’ve added a tooltip to the delete buttons in the item editor.

We’ve fixed an issue that caused the scrollbar to display in dialogues where it should be hidden.

We’ve fixed an issue that caused signing in to accounts to be slow.

This is more important? Are you developing 1Password for your own pleasure it seems? Picking those random cosmetic issues to fix that nobody asked for. How about something people asking you about daily for a year?

We all who has this issue upgraded form 7 to 8 (that's what caused the duplication it seems), we paid you expecting at least same level of functionality as in 7. Not worse. And we put up for almost a year now not only with duplicates but way worse performance comparing to 7. Slow unlock was fixed just last week! But duplicates issue is way worse and should have been fixed first.

It seems that forum support being the messengers is not working. Perhaps actual manager of 1Password project has no idea about severity of our requests. Because if any sane product manager had this level of angst they would be fixing this top priority.


Obviously the forum support staff is not passing requests as they are made and not explaining to product manager what is actually happening here.

I am requesting to escalate this to your product manager please. Directly, not as you passing the message. we need them to see this.

November 13, 2022

Hi, I imported my passwords from Chrome and Apple Keychain so I could use 1password as my main, but now I've got hundreds of duplicates. Please make this feature happen! Even just a merge tool, for now, would be perfection!

November 17, 2022

Super inconvenient -- I upgraded to 1password8 and now have hundreds of duplicates. Please bring back the duplicate removal tool! This is very painful for people that have been using 1password for a long time. Please help us early adopters!

November 17, 2022

@ben Catching up on this thread, Its pretty bad. This is a complete fail.

Even worse, the lack of support for this is a sign the company is obviously making some bad choices. Is this what we get for being long term loyal customers? Yikes. Seems like time to move on.

More specifically this may be what moves me to one of the many many other solutions out there. Its hard to believe this has not been addressed yet. As a software developer this should be a simple fix: Allow the user to identify duplicate content, and remove it.

Duplicate content for me looks like:
- identical username + password + create/update dates.

A diff of the content would provide an exact match minus any internal IDs. Duplicate content. Why is this so difficult?

Allow the user to "remove duplicates" - and the discarded items could go in the trash (incase some accident). This should not take more than a day to fix, and will save your customers exponentially more time. As for how I got the duplicates, all I did was update to the latest version (a bad decision obviously).

If this isnt fixed soon I'm out -- along with my faith with the product, and my suggestion to anyone I know.

November 21, 2022

My Duplicates occurred when I upgraded from V7 standalone on my least used machine to V8. I was already using V8 on two other Macs an iPhone and two iPads. That upgrade process was terrible. It wanted me to create a new 1Password membership (I already have a membership which there was no obvious way to connect to.). I ended up downloading V8 and installing it. It said I had to convert my V7 data to V8. It was not at all clear that I could have just skipped that step. Now I've got about 800 duplicates. The upgrade process needs to be more clear so duplicates are not created in the first place. We also need a duplicate finder/remover tool.

1Password Employee
November 22, 2022

Hi folks,

Thank you for the feedback on how you ended up with duplicate entries. This feedback helps us understand how we can help prevent such situations in the future. We also understand how useful a deduplication feature would be as it would also solve future issues.

As Ben said in a previous reply, we'll continue to advocate for the feature to be created in the future. I also want to note that for anyone who hasn't previously had a vote filed, I've gone ahead and added your votes.

IDEA-I-615