Mazal tov on the birth of your son! We appreciate your concerns.
Based on consultations with medical professionals, our understanding is that the waters of mikva’ot that adhere to health guidelines are safe for immersion.
You should prepare at home, even taking a shower right before leaving for mikveh in order to minimize time there. Bring your own towel, and a bag for your clothing, look in the mirror to inspect yourself, and immerse.
If it becomes dangerous for the general population to immerse in the mikveh, then the halachic guideline will be to delay immersion. Thankfully, we are not there at this time.
For more information, please see here.