brush down
To remove something from fabric by brushing. A noun or pronoun can be used between "brush" and "down." I have three dogs, so I always have to brush down my clothes before I leave the house.
brush something down
to clean and groom fur or fabric by brushing. Why don't you brush your coat down? It's very linty. I brushed down my trousers, and they looked much better.