hitting set-smooth did the trick. (Weird, I thought I'd tried that before...)
The envmap looks weird in ortho mode too, but it's a different weirdness. In ortho mode it looks kind of distorted, not disco-ball-like
Thank you for your help everybody, I really appreciate it
