Dr. Harvey highlights several red flags that may indicate a man is not trustworthy in a relationship. Some common signs include inconsistent behavior, lack of communication, dishonesty, disrespect towards boundaries, and a history of infidelity. It is important to pay attention to these warning signs and address any concerns in the relationship.