Me too, but the current models can't really do that. If you try, it often has problems where the iris is malformed or missing entirely. Even with these staring-into-the-distance shots, I had to manually retouch the eyes on most of them.
Have you tried any SDXL models yet? They're much smarter at interpreting prompts, and just generally output higher quality images. May solve your "looking down" issue. I've been using this one for nearly everything: https://civitai.com/models/288584/autismmix-sdxl
