How do I use the 1password ssh agent without installing the 1password gui?

I have a headless machine (VM) that I would like to use 1password ssh agent on (I've got the 1password-cli installed), but it doesn't appear to be possible to setup the ssh agent without the gui. ...