What do I need to keep track of regarding tax?

The Australian Government has really great resources about tax here.

Remember, GST is usually only compulsory if your business has a GST turnover of $75,000 or more (see all cases here).