For recipes with lavender, a little goes a long way, and not all culinary lavender types are the same. To make sure the lavender taste is not overpowering, start with 1 teaspoon and taste, then add more if desired.
Find a recipe for homemade vanilla sugar here