I think both fan bases are saying the same thing, and I'm not coming here to be confrontational. I hope a deal gets done for both sides. I've seen Kevin Love for a bunch of years now. Awesome, awesome player, but he got screwed by former GM David Kahn. 26/12 guy who hit 190 3 pointers last year, that has NEVER happened. You guys would be instant title contenders and he's only 25, so you could be for 5+ years.
Why do people keep saying this?  Let's say Cavs trade Wiggins + TT + (i think they still need some salary filler here) for Love.  People say they just need to sign a defensive center to play next to Love, which is true, but it's almost impossible to find a defensive center that can play starter minutes.  With only minimum contracts to offer, 
it is completely impossible for the Cavs to sign a defensive center that can play starter minutes this offseason.  They also would be hard pressed to add more quality wing depth at this point.  
Given all that, how exactly does the Cavs defense work?  Imagine this potential finals match up:
T. Parker v K Irving
Manu v Waiters
Kawhi v Bron
Duncan v Love
Splitter v AV (or Haywood/Bennett if AV injured)
Bron can't guard all three of those perimeter guys by himself.  What if they went small?
T. Parker v K Irving
Manu v Waiters
Green v Miller
Leonard v Bron
Duncan v Love
The Cavs wouldn't have any quality depth on the wing that would allow them to go small for extended periods.  SA would score at will with either of those line ups.
I just don't see a Wiggins + another rotation player for Love trade making the Cavs serious contenders in year 1.  In fact, I could see way more scenarios for the Cavs winning titles in the next 5 years without the Wiggins/Love trade than with it, and beyond that time horizon even the wolves fans have to admit it would be better to keep the young talent.  As a somewhat optimistic scenario, the Cavs could use their MLE next offseason to sign a defensive center, and then the MLE the year after (it would probably only be the taxpayer MLE at that point) to sign a defensive wing.  That means year 3, if all falls into place, they could field a legit, title contending defense.
If K Love was 2007 KG and could anchor a defense, then trading for him makes the Cavs instant title contenders, but he is not.