The U.S. Supreme Court’s refusal to accept appeals from Virginia over the issue of same-sex marriages generated a fierce debate on “Fox News Sunday.”

Tony Perkins, the President of the Family Research Council, blames what he calls rogue lower court judges. The jurists he’s criticized include a U.S. District Court judge in Norfolk and two judges from the Richmond-based Fourth U.S. Circuit Court of Appeals.

Ted Olson represents two gay Norfolk men who opposed Virginia’s 2006 constitutional amendment that kept them from getting hitched. Olson has applauded what he calls an independent judiciary.

Charlottesville is one of the localities where gay Virginians have held wedding ceremonies (pictured) this month.