A process that is carried out at the cellular level which results in the assembly, arrangement of constituent parts, or disassembly of the spectrosome, a germline specific spherical organelle that is the precursor to the fusome.