Hello Staggerlee
Sorry but that's not true. Stamp duty forms part of the cost base and only comes into play for the purpose of calculating the CG on a property if it's applicable.
Perhaps you can read the info on this site to understand about tax deductions for an investment property.
http://www.propertyinvestment.net.au/tax-deduction.htm
You might like to look into doing it the other way round if you're not emotionally attached to living in your own property.
First live in the home for lets say 6 months and then move and rent it out for up to 6 years. This way many expenses, the biggest being interest on your loan, become tax deductible without ruining the capital gains tax free status of your home.
Your accountant will be able to explain this and help you crunch the numbers to see if it's worth while for you.
Hope this helps
Elka