The aggregation, arrangement and bonding together of a set of components to form an axonemal dynein inner arm, an inner arm structure present on the outer doublet microtubules of ciliary and flagellar axonemes.