Open Internet Explorer and go to Tools > Internet Options

In Browsing History section click on Settings

In Temporary Internet Files and History Settings window click View Objects

This will normally open C:\Windows\Downloaded Program Files folder where you can find and delete all installed ActiveX objects.

Windows XP
Windows Vista
Windows 7
IE8
IE9