There are 24 A&Es on a list drawn up by researchers at the Health Service Journal (HSJ).
The report comes weeks after warnings that the health service was in the grip of a "humanitarian crisis", with some emergency departments facing such high demand they had to turn patients away.
NHS officials said some changes to A&Es had been planned and statistics showed treatment could be improved with "concentration" of specialist services.
- Foreign doctors milking NHS to fly families in for treatment – claims
- NHS TOURISTS TO PAY: Free treatment crackdown will save us £500m
The NHS is suffering from overcrowding and closures across many departments
However the health service said it does not expect significant changes to A&Es in the years ahead.
The HSJ analysis said 15 per cent of emergency departments could be "closed or downgraded" in the next four years.
Dr Chris Moulton, the vice president of the Royal College of Emergency Medicine, warned the NHS does not have enough capacity for a growing and ageing population.
The Red Cross warned the NHS is going through a humanitarian crisis
"Any A&E closures must be very carefully considered for patient safety, patient convenience and the effects on neighbouring departments that would have to absorb the extra patient attendances," he said.
Liberal Democrat health spokesman Norman Lamb raised concerns that the plans were going ahead without the public being consulted.
"People won't put up with the destruction of local services imposed from on high," he said.
As many as 15 per cent of emergency departments could be shut down in the next four years
In January the Red Cross warned the NHS was facing a "humanitarian crisis", with elderly and vulnerable patients stranded in desperately needed beds in A&Es due to a lack of social care.
Two people died after spending hours in the corridor of one A&E department, while other hospitals were forced to send patients elsewhere because they had no space.
The NHS said the range of services available to patients is expected to expand as the number of people seeking urgent care increases over the coming years.
Hospital viewers slam Jeremy Hunt Thu, January 12, 2017
Viewers tuning in to new BBC series Hospital, which focusses on the pressures faced by the NHS, have hit out at Health Secretary Jeremy Hunt.
BBC•Getty 1 of 11
Hospital viewers slam Jeremy Hunt as cancer patient is denied surgery ‘This is your fault'
Any A&E closures must be very carefully considered for patient safety, patient convenience and the effects on neighbouring departments
Dr Chris Moulton, Royal College of Emergency Medicine
A spokesman said: "Within that overall expansion, it may be possible to improve care and save lives with some concentration of specialist urgent services.
"This approach has increased the chances of surviving a major trauma in this country by 50 per cent, and only today the Stroke Association have called for more concentration of stroke units to improve outcomes."
"However we do not expect significant numbers of A&E changes in the years ahead."
- Ferrari rages against health tourism as bill hits tens of millions
- NHS AMBULANCE CRISIS: Shock as two OAPs left waiting for hours
- NHS cancels operations for 102 days to save £3.2million