Interacting selectively and non-covalently with RNA polymerase V core enzyme, a multisubunit eukaryotic nuclear RNA polymerase found in plants and involved in production of noncoding transcripts at target loci for silencing.