Your Optometrist will discuss this with you. Firstly, the contact lens could be washed out of your eye. Secondly, a swimming pool is full of bacteria and chemicals that will be absorbed by the contact lens. These will then remain in contact with your eyes until you remove the contact lenses, which can cause discomfort and possibly infection. It is much better to wear prescription swimming goggles.