Speaker Mike Johnson has refused to swear in Adelita Grijalva, who won a special election in southern Arizona four weeks ago.