I did the whole thing along the waterfront, but I'm definitely gonna investigate Dianelund. Looks cool!
I swam in Långholmen in May - it was so nice (although absolutely freezing). I like the smaller 'beach' the other side where you can swim with a view of City Hall.
I might try and swim in Sicklasjön next weekend...slowly working my way out of the city!