Stir the rice vinegar, sugar, salt, and lemon juice together in a saucepan until the sugar and salt have dissolved; bring the mixture almost to a simmer over low heat, but not allow to boil. Remove from heat and allow to cool completely. Store in refrigerator.