Separately, ministers will say on Wednesday that towns and villages across England could get a share of £1billion a year to build bypasses and protect beauty spots from the “misery of lorries and thundering traffic”.
Mr Javid used a speech to council leaders to set out the Government’s plans to deal with the housing crisis and have “a much more frank, open discussion with local residents and communities” about housing.
This means wealthy communities living in areas “where housing is particularly unaffordable” have to accept that more homes needed to be built nearby.
He told council leaders at the Local Government Association’s annual conference: “Nothing is more corrosive to trust than the idea that some areas are being treated better than others.
“Where housing is particularly unaffordable, local leaders need to take a long, hard, honest look to see if they are planning for the right number of homes.”
One source at the department said part of the problem was that “you see more active groups locally contesting against decisions” in wealthy areas.
It comes six years after the Government clashed with rural campaigners over plans to make it easier to build on green belt land by relaxing planning laws in favour of developers.
Mr Javid directly criticised Theresa May, the Prime Minister, along with her predecessors in Downing Street, for not doing more to provide enough homes for young families.
He said: “Since the 1970s – under Wilson, Callaghan, Thatcher, Major, Blair, Brown, Cameron and now May – we’ve supplied an average of 160,000 new homes each year. That’s far below what’s needed.”
A new Government consultation paper published this month will provide a “new way for councils to assess their local housing requirements”, Mr Javid said.
Councils are expected to be asked to commission an assessment of how much and what kind of housing is needed in their area. Councils will then use it to inform the housing target in the local plan which sets out where new homes can be built. The target will be reassessed every five years.