In a small saucepan, heat the milk over medium heat until barely simmering. Add the chocolate and stir until melted. Remove from heat. Add the tea bags and let stand until infused, 4 to 5 minutes. Discard the tea bags.
Reheat the hot chocolate over medium heat until just simmering. Stir in the Baileys. Divide between 2 mugs. Top with marshmallows and pepper.