So I've just worked it out...
If you want to edit a list in Datasheet View - an insanely useful feature - you must not have Office Basic or Office Small Business versions.
You have to have the Pro version of Office and make sure the
"Microsoft Office List Datasheet Component" is installed in the "Office Tools\Windows SharePoint Services Support" option in selected as Installed under Office setup.