Business secretary Vince Cable plans to target the red tape 'deluge' which he says is "stifling" enterprise in the UK.
Cable will review the introduction of 200 regulations which have yet to come in force and will cost £19bn to implement.
The regulations, approved by the previous Government, include elements of the Equalities Bill covering equal pay rights, the agency workers' directive and rights for fathers to claim up to six months of a mother's maternity leave.
He will also chair a newly created Cabinet committee to establish a "one-in, one-out", approach to law-making. This has the aim of reducing the number of regulations the Government said are "stifling small businesses".
The Business secretary said: "The deluge of new regulations has been choking off enterprise for too long.
"We must move away from the view that the only way to solve problems is to regulate. The Government has wide-ranging social and ecological goals including protecting consumers and protecting the environment.
"This requires increased social responsibility on the part of businesses and individuals."
Cable is due to give further details of his plans in a speech later today.
Prime Minister David Cameron has also appointed an advisory role to US economist Richard Thaler. He is co-author of bestseller Nudge; a book seen as required reading for aspiring Conservative MPs.
Professor Thaler will advise a second "challenge group" that will suggest ways to achieve policy goals without regulation. Cass Sunstein, Nudge's other co-author, is President Barack Obama's regulatory tsar.
String of Neptune exits
Brexit three years on
Equality and inclusion
Managers fear for sector's reputation