Aggravate  means to heighten, intensify, or make worse. Do not use it for annoy  or provoke.

aggravate , exasperate , irritate , provoke : A fever or a misfortune may be aggravated, but not a person. The person is, perhaps, exasperated or provoked. To aggravate, from the Latin aggravo “to make heavy,” is to intensify, and applies only to conditions of fact; provoke, which calls forth anger, and exasperate, which heightens (or roughens) anger already provoked, allude to mental states. A patient may be so irritated that his condition is aggravated. Here to aggravate is to make worse; to irritate is to annoy, provoke.