How to Remove Labels from Beer Bottles - Mr. Small Batch Brewer Step Two: Clean the bottles. After the bottles have had time to soak in the OxiClean solution, it is time to clean them. Remove the bottles from the bath and drain the OxiClean from the bottle. Clean both the inside and outside of the bottles with soap and water. There may be some leftover adhesive on the outside of the bottles.