No. Well, yes. Or maybe. It depends on where you're getting your "IP address" data from, and whether you trust them.
If you're taking the address from the IP packets themselves, then you can trust that whoever sent the packets has access to packets sent to that IP address. That may mean that it's a legitimate user of that IP address (for appropriately limited values of the word "legitimate", in this age of botnets, open proxies, and Tor), or that whoever sent the packets has access to an intermediate system and can see the packets you're sending as they go past.
However, with the wide prevalence of reverse proxies, the IP packet can often misrepresent the source of the connection, and so various HTTP headers have been introduced to allow the "actual" origin IP address to be provided by the proxy. The problem here is that you have to trust whoever's sending the header to provide accurate information. Also, default (or misguided copy-pasta'd) configs can easily leave you open to spoofing of those headers. Hence, you have to identify whether any reverse proxies are legitimately involved in your requests, and ensure they (and your webserver) are properly configured and secured.