When you stand near something much colder than room temperature, the heat you’re losing in that direction isn’t balanced by any incoming heat, so that side of your body gets cold much faster. From your point of view, it feels like the object is radiating cold.