“Error HRESULT E_FAIL has been returned from a call to a COM component.” when adding a reference in Visual Studio 2010

Make sure the build target is compatible between importing/imported projects.

I had one of the projects set to Mixed, and another to Any CPU. Setting them both to Any CPU fixed the problem.