Cal. ELEC § 14249

If any person challenged refuses to take the oaths tendered, or refuses to be sworn and to answer the questions concerning the matter of residence, that person shall not be allowed to vote.