SSH Agent : Connection refused

Not sure if it's related to an update, everything was working fine so far. I can't get the agent to load the keys on git requests anymore. The problem : git fetch git@github.com: Permission...