Yes, would be a huge mistake by the Magic if they throw a large long term contract at Klay. He is not making them a dramatically better team. Just eats up their cap space when they need to sign their own players.
Fred’s deal was structured essentially as a 2 year deal so they are free of his contract when they need to sign their young players.