Yes.... The air conditioner needs to drain away the condensation. The unit also needs to be at a slight angle so the water runs toward the back.

Sometimes the drain holes in the back of the metal housing can become clogged.

You should be able to pull the unit out of the housing from the inside. You actually need to do that in order to make sure the unit housing is clean and the drain holes are clear and not clogged.