Sorry, Jurn, the interest will no longer be tax deductable.
On the plus side though, you won't have to pay any tax on fully franked dividends (though you don't get franking credits either) and tax on unfranked dividends will only be at 15%. Some companies can also declare the unfranked dividends they pay to non residents "foreign conduit dividends" and they are then tax free too.
Also you don't pay CGT on any gains for shares bought as a non resident while you are a non-resident. You will pay CGT if you sell them after again becoming resident, but the cost base will be the value on the day you again become resident.
You can also declare that you have disposed of your shares on becoming non resident, without actually selling them. This stops CGT liability acruing while you are non resident, but you will have to pay CGT on any CG based on the shares value on the day you became non resident (the day you notionally disposed of the shares). You need to decide if this is worth doing for you. If you won't have too big a current CGT liability and you plan on being non resident for a long time, then it probably is.
Check out the Guide to Capital Gains Tax thatyou can download from the ATO web site.
Ferret