The relative pronoun establishes the relation between the main clause and the relative clause.

The friend of my brother, whom I see very often, is going to America.

The relative pronoun whom establishes the relation between the main phrase and the relative phrase. Here in this sentence it is actually not clear whether the relative clause refers to the friend or the brother.