Bring brown sugar, evaporated milk, and butter to a boil in a large saucepan; boil mixture for exactly 10 minutes. Remove from heat and add confectioners' sugar. Beat fudge with an electric mixer on medium speed for exactly 5 minutes. Stir in walnuts. Spread fudge into the prepared pan and let cool before cutting into squares.