The aggregation, arrangement and bonding together of a set of components to form a filtration diaphragm, a specialized cell-cell junction found between the cells of the excretory system, which provides a barrier for filtration of blood or hemolymph.