The incident took place on Thorpeness beach in Suffolk
Police and the UK Coastguard received multiple 999 calls at about 1pm on Saturday, after the cliff fall at Thorpeness Beach in Suffolk.
Rescue helicopters, as well as fire and lifeboat crews were deployed to the scene after reports a man had been trapped.
One witness, who did not want to be named, told the Ipswich Star "The emergency service response was tremendous.
"There were 50 or 60 people who were desperately trying to dig the man free."
Police later confirmed that the man, in his 50s, had died at the scene. Bev Allen, Maritime Operations Controller for the UK Coastguard said "This was a large scale search and rescue effort.
"We ask people to please stay away from this particular area while the emergency services are at work."
He later added "We would remind people to be mindful when out walking on the coast.
"Standing on cliff edges and at the base of a cliff are dangerous places to be as it is impossible to predict when the next piece might fall or how big it will be."