Stir cream cheese and mayonnaise together until smooth; add ketchup and mustard and stir until smooth.
Mix shrimp celery, onion, and garlic powder together in a separate bowl; add cream cheese mixture and mix to coat. Divide shrimp mixture between 4 bread slices and spread into an even layer; top with remaining bread slices.