东西 does literally mean "east" and "west", so you are definitely right, but together they just become a noun for "things".

怪 = have a variety of meanings, but in Dracoon's context it means "blame"

Therefore, 怪东怪西 means "blaming it on this and that"

Mandarin is weird, but it's a pretty fun language ^-^