The former head of obstetrics at Bacchus Marsh Hospital, Surinder Parhar, says he has been "unfairly targeted" over a spate of baby deaths.

The doctor embroiled in a scandal surrounding a spate of baby deaths at a Victorian hospital has reportedly defended himself and other doctors who worked for him.

The former head of obstetrics and gynaecology at Bacchus Marsh Hospital, Surinder Parhar, told Fairfax Media he had been "unfairly targeted and that he wanted to move on".

A review of 10 neo-natal deaths at Djerriwarrh Health Service between 2013 and 2014 found seven could have been avoided.

More families have since come forward about the deaths of their children.

"Nobody wants to harm anybody," Dr Parhar is quoted as saying.

"That goes against the grain for everybody in the profession. You do your best in the circumstances."

Dr Parhar said he had provided a service to the community for 35 years and the doctors who reported to him had been competent.

Despite questions raised about the care delivered under his watch, Dr Parhar said he and his team frequently reviewed things that went wrong to improve their practice and tried to manage high-risk women appropriately.

Victorian Health Minister Jill Hennessy last year sacked the Djerriwarrh board, replacing it with an administrator.