Beat butter in a large mixing bowl with an electric mixer on medium speed until light and fluffy. Add marshmallow fluff and beat until smooth, scraping down the sides of the bowl if needed. Beat confectioners' sugar and vanilla extract into butter mixture until frosting is light and fluffy. Beat fresh ginger, pumpkin pie spice, and ground ginger into frosting.