I use it on occasion but not on a regular basis.  If I am baking something special or making something for my omnivore husband who is used to way more sugar than I eat, I will use it.  I don't see any harm in using it here and there.  From what I have heard it doesnt raise blood sugar in the same way as other types of sugar.  Vegan athletes use it for fuel before workouts. 

I tend to just go with natural fruit as a sweetener in my smoothies or hot cereals etc.  Like fresh dates or blueberries or bananas etc and balance it out with lots of leafy greans, spirulina etc..  Sometimes I will use stevia.  I grew my own stevia leaf last year and used it straight from the plant.  I had a hard time cultivating it for some reason though.  I might try again.  I have nothing against using agave in moderation.  It is expensive so it helps deter using too much of it I think.  I think if you get too rigid with your diet it won't sustain you or give you a positive relationship with food in the long run.  I've had people tell me the two or three servings of fruit I eat each day is too much sugar and I just dismiss such nonsense.