A new judge in a nine-year-old securities case has followed a federal appeals court mandate and ordered a defunct capital investment firm to pay $5.2 million in disgorgement penalties and $3 million in accumulated interest.