The short answer is no, you can't. At least, not with any standard solution. The manufacturer of your WiFi card might offer a custom connection manager that offers this functionality, but I've never seen it.
Windows will generally select the strongest signal among access points with the same SSID in the same band. On some WiFi cards, you can tune the "roaming agressiveness" from the device manager. This essentially decides how much better a signal has to be for Windows to switch access points with the same SSID. (You can turn it down if frequent AP changes are disrupting connectivity, and you can turn it up if you're getting stuck on a poor AP.)
One common irritation is that the strongest signal may not yield the fastest transfers. I have this issue myself with one access point that uses a 20MHz bandwidth and one that uses a 40MHz bandwidth. Windows will choose the 20MHz signal if it's stronger even if it yields a lower transfer rate.
However, my advice to you would be to focus on what's causing your issue rather than trying to patch around it. Is Windows choosing the stronger signal? If so, why isn't that working for you?
Possible duplicate of Choose specific access point in a multiple access point WIFI network sharing SSID
– mgutt – 2016-01-25T11:09:37.277My impression is the correct term is BSSID (Basic SSID) and not MAC address. Though BSSID has the same format (3 byte manufacturer + 3 byte device) as an Ethernet MAC address. – Axel Bregnsbo – 2019-10-25T20:15:16.793