If the interest rate is the same for all loans and they are all amortized loans then it is better to pay off new debt first. The interest portion of your payment will be greater on your new loans. By paying it off earlier you will end up paying less interest in the long run.
If your situation is different (different interest rates), then the answer depends on your rates, terms, and loan amounts.