Any process that modulates the frequency, rate or extent of activity of any TGF-beta receptor signaling pathway that is involved in the determination of organismal asymmetry with regard to its left and right halves.