[Exim] relay blocking not working?

I have:

host_auth_accept_relay = localhost
host_accept_relay = localhost

in my config file but people in outside systems are able to set their
outgoing smtp host to my server and send mail through me. Isn't this
"realying"? Shouldnt this be blocked by the above configuration?

Thankyou