In his essay Real and Apparent, Srila Bhaktisiddhanta Saraswati Thakur makes the following cogent remarks on the hypocrisy of impersonalist who denounce Deity worship:

‘The worship practised by avowed or covert impersonalists and abstractionists is in principle indistinguishable from oppostion to worship itself under a hypothetical concern for the preservation of its purity. The fury against idolatry often masks this sentiment of inveterate hostility to the very principle of worship’

He caps this off beautifully by saying:

‘The prayers of impersonalists offend the Lord more than the denunciations of His avowed enemies’