Take The Fifth Meaning

To decline to answer, especially on grounds that it might be incriminating.

The origin of the phrase dates back to the Fifth Amendment in the Bill of Rights, which says that a person can't

"be compelled in any criminal case to be a witness against himself."

Example: If you ask me who stole the wallet, I will simply take the fifth.