Drinking tea on an empty stomach can irritate the stomach lining, potentially leading to issues like acid reflux and nausea.