Put (someone) down as (something bad)

To judge that someone is bad or undesirable in some way.

The store clerk immediately put the young man down as someone who may steal something in the store.