I think it would depend on your intent. If you are moving your coat to the side with the intent to get your wallet out, it should not be considered brandishing (though arguably you should not allow it to be seen at all).
If your intent is to show somebody that you are carrying and they should back off, it
is branishing.
18.2-282