Abstract For a tracking system consisting of heterogeneous sensors such as radar and IRST, the combinatorial assignment is applied to solve the multitarget data association which is formulated as a partition of the multiple dimension data set including the measurements and predicted tracks from targets.