Centrelink overpaid $2.84 billion to welfare recipients last financial year but the Turnbull government only recouped half the cash.
The new Human Services Minister Michael Keenan blamed human error and fraud for the overpayments.
"It is important that system operates with integrity, that people are not overpaid more than they are entitled to," he told reporters in Perth.
"If you have been defrauding the system, you can expect us to come down on you like a tonne of bricks."
The Human Services department has only recovered $1.64 billion in overpayments.