Unfair?
To expand on TH, there is often no underlying. There is no obligation for the CFD provider to buy the actual share when you take a long position, and they'd only do that to hedge against your win, depending on how many of their customers are long or short a stock and how much risk they're willing to take on.
Think of a CFD as a bet. You bet the CFD provider that a share price will change. They take the other side of that bet. No actual shares have to be bought by anyone. No shares are being loaned to anyone.
Dividends are only included at all to balance out the change in share price when it goes ex (since, again, a CFD (in this case) is a bet about the share price).