Blend yogurt and bananas together in a blender until smooth. Add peanut butter and blend until smooth.
Pour yogurt mixture into your ice cream maker and process according to manufacturers' instructions to solidify the mixture, 15 to 20 minutes. Add the chocolate chunks and process 2 to 3 minutes more. Transfer frozen yogurt to a container and freeze, at least 2 hours.