Protect what matters – even after you're gone. Make a plan for your digital legacy today.
Forum Discussion
Anonymous
3 years ago1pux export data will be wrong or old (and uncomplete)
Hi,
I am using the 1password 8 app for windows, Iphone Ipad. They all are updated to last version (8,9,10).
I need to export the data I stored in 1Password, but I encounter many problems:
1) both the csv and the 1pux methods export only a very little subrange of the data I stored (with csv being the least complete one);
2) the data stored in the 1pux file (I am referring to the text file you get once you unzip the 1pux file) are very messed up:
- it reports also the entries I deleted in the past, which is very confusing (many times I deleted an item just to re-entry it in a different, better way)
- worse than all, some of the data are WRONG: they show the OLD passwords and username instead of the updated ones (updated by me when, for example, I change the password of an account). Just to give you an example, the username and password of my NAS are the ones I used more than 2 years ago.
I have been using 1Password for years, and this problem of the partial extraction (ref. point 1, I never really checked point 2 before today) has always been there (ref. all the tickets opened on this community and the complaints you can find by googling a bit).
Honestly and clearly speaking, it is not possible and I do not (and can not) believe that your software engineers haven't found a way to extract ALL the data customers insert in your software.
These partial extractions appear to be a clumsy and clear attempt to keep your customers renewing their licence every year.
Unfortunately, I have been unemployed for more than 2 years now, so I need to cut all the possible costs. Therefore I also would like not to renew my 1Password licence. But with this kind of "export" you make it impossible (unless I copy and paste every single line/entry, which would need hours and hours of work).
Can you help me? Have you planned to implement a FULL export soon?
Regards,
Domenico
1Password Version: 8.9.10
Extension Version: Not Provided
OS Version: windows 11
Browser:_ Chrome
Referrer: forum-search:https://1password.community/search?Search=export
28 Replies
- 1P_Ben
1Password Team
And such list should be, like common sense suggests, made by ONE ROW for each item of the vault,and one column for each of the metadata in the item itself.
Where we run into problems with this is the fact that we support custom sections and fields. Exporting those into CSV is unmanageable for large datasets that have taken advantage of the feature. We also have custom categories in beta for 1Password Business customers, which further compounds the situation. Every item could have hundreds of irrelevant columns, times thousands of items... At a minimum it would be incredibly inefficient and difficult to parse.
1PUX is a modern format that was built with these challenges in mind.
Ben
- MrCSuper Contributor
@Domenico
If you want to review the contents of the 1PUX more easily, you can use the onepux converter from the https://1password.community/discussion/101693/moving-to-1password-from-another-password-manager. It can create a monolithic CSV or one per-category. See the README included in the suite, and you might have a look at the files in the suite's download location under Extra Help > Examples > 1PUX to CSV. There are also videos that show various conversions under Extra Help > Videos.
The
1pux_tool.pltool won't be more help to you, since it just presents what you've already seen (plus a few more details about the vaults). The method mentioned above is what you want. - Anonymous
Opening the json file with a text editor works, but it is really really uncomfortable to read... even if the structure is clear.
Just coming back to what @Happybird wrote above, what a customer would like is a simple csv file. And, I add, a one-row-per-vault-item one (the metadata being in columns).
I am right now importing with Excel the json file.
It works, but the result is terrible:
- many rows per vault item instead than only one;
- funny enough, despite the fact that the metadata columns are 50 or more, username and password (the real basic reason for which apps like 1Password exist) are in the SAME COLUMN (!!!), in two rows. I mean, from 50 to 51 column doesn't change much, right? so why not making at least two separated columns for the two most important metadata?
After working for almost an hour on it, deleting non necessary metadata columns and moving metadata columns in an easier to read order, I got an excel file that is very far from user friendly; I would say still hardly comprehensible. The most annoying thing is the fact that one single vault item is split in dozen of rows (the columns are not the problem, they are necessary having multiple metadata, but the multiple rows makes no sense).Probably and hopefully I am so fresh to json files that there is a better way to convert them.
Therefore the big question is: have 1Passord created a "json to csv" converter?
Without such a tool I can't reach my goal: i.e. having a simple, easy and quick to use list of all items I input in the vault.
And such list should be, like common sense suggests, made by ONE ROW for each item of the vault,and one column for each of the metadata in the item itself.In one of your messages above, you wrote:
I use my 1pux_tool.pl to dump the contents of the 1PUX in an easy to read textual format and send that content to the grep tool...Is it possible to have this tools? Where can I find them?
Maybe they do what I am dreaming for... - MrCSuper Contributor
@Domenico
The export.data file is a nicely formatted JSON data file. It contains a structured formatting of your account information, the vaults contained in the account, the records in each vault, and the fields in each record. These are bracketed with curly and square braces. This is roughly, but not entirely accurately, described here:
https://support.1password.com/1pux-format/
You can open this file with a text editor and search for items. The structure is explained in the document I reference with the link above.
- Anonymous
Former Member
opppps
Looking forward to look at the json data.But... errr... how can I open "export.data" to make it readable?
I tried with a text editor weeks ago, but the result is something almost unreadable.
That's why I wrongly assumed the export file is the one you see in the video.I am looking in internet right now, but it doesn't look to exist a "json file" app...
I
- MrCSuper Contributor
@Domenico
It appears you have confidential information being exposed in the videos. I've removed the links, and you should securely delete these files from Dropbox.
- Anonymous
@Domenico I looked into your "2-extracting-data-from-1pux" video. What you selected from the "files" subfolder is some attached file you attached to some item, probably a "secure notes" item. Probably some old file with some export from some other password manager. It cannot be your real 1Password export, because it isn't json format. The "files" folder contains custom icons you set and file attaches. You were probably mislead by the fact the word "password" is in that name, but that's only the name of the attached file.
Your actual current 1Password data is the file "export.data", which is in json format. Load this and you will find all current data.
- Anonymous
MrC
I thought also the information that I have only one vault could be useful to you.
Here is the link:[ link removed - video contains confidential information ]
- Anonymous
Hi MrC,
thanks for the reply.
I understand very well that you need the exact sequence of instructions to reproduce.
I hope the 6 videos linked below will give you enough info.
If not, please let me know what you need more and I'll provide it to you.[ links removed - videos contain confidential information ]
- MrCSuper Contributor
Hi @Domenico
No problem with the language issues, and certainly I can understand you're likely frustrated with the problem you're trying to understand and overcome.
I've created likely over a million items, deleted them, exported, and converted several hundred thousand times - without exaggeration. I've done this over the past 10 years using version 4 through 8. So I have a fairly good understanding of the exports.
Here's a Dropbox link to a movie (2.9Mb) I created that demonstrates what I'm understanding you are describing:
https://www.dropbox.com/s/iy01zadqmfxftdg/deletion-video.mp4?dl=0
The following description explains what is occurring in the video:
- In 1Password 7 (7.9.8) a Login item titled "foobar" is shown in a vault, and it has a username "mailto:user@example.com".
- The Login item is Deleted, and this deletion is confirmed.
- The deleted Login item is shown to not be in Archive.
- Jumping to 1Password 8 (8.9.12 beta), the Recently Deleted section is selected in the sidebar. The "foobar" item with username "mailto:user@example.com" appears there.
- The account is exported to 1PUX, saved to the Desktop.
- I use my
1pux_tool.plto dump the contents of the 1PUX in an easy to read textual format, and send that content to thegreptool to look for the string "mailto:user@example.com". It does not appear in the text stream, so there is no output from that command sequence.
This confirms that the deleted item "foobar" with username "mailto:user@example.com" does not appear in the 1PUX.
I'm not doubting you are experiencing something that doesn't seem right to you. I just need an exact sequence of instructions to reproduce it to follow-up.