1Password chrome extension does not work correctly when the mac app is closed

When I click on 1Password icon from the extension bar, the unlock screen appears. I enter my password, 1Password momentarily unlocks and then immediately locks and the extension window closes itself. When I click the extension icon again, it's locked.

This is when the mac app is closed. If I do it with mac app is unlocked, I can use the extension without using my password. Obviously I don't want to keep the app unlocked all the time so I need to solve this problem.

1Password Version: 8.10.33
Extension Version: 2.24.2
OS Version: macOS 14.4.1
Browser: Chrome