Formation of a protein complex between proteins of the AP-3 adaptor complex and proteins that are going to be transported by a clathrin-coated vesicle. In some cases, The AP-3 complex is a heterotetrameric AP-type membrane coat adaptor complex that, in some organisms, links clathrin to the membrane surface of a vesicle.