Fears have been raised that a second home tax levy that could raise millions from 'cash cow' villages on the coast could push people away.
Stuart Dark, Conservative group leader at West Norfolk Council, worries that the measures may upset those with holiday homes in places like Brancaster and Burnham Market.
It comes as the authority's cabinet members voted to push forward with the plans to introduce a 100pc premium on second homes next year, which could raise £6.5m a year.
READ MORE: The 'cash cow villages' where second home tax could raise more than £6.5m
Mr Dark, at a meeting this week, said: "We have to be careful around how we talk about this - it is a fragile ecosystem.
"Some second homeowners have been active in their communities for years and years and contribute to local life, as well as those coming up from London who contribute to the local economy, delivering jobs and businesses that we all prosper from."
Members of the Independent-led cabinet support the policy change, which will be decided at a full council meeting on January 31.
Concerns people may sell up were dismissed, with the consensus being it would free up housing stock for locals if this does happen, although there was scepticism this would be the case.
Simon Ring, cabinet member for tourism, does not think it will affect tourism in any way and believes it may actually lead to more people visiting if second homeowners decide to rent out the property to holidaymakers to cover the increased tax.
Leader Terry Parish said there was a growing appetite to curb second home ownership in the district, and that the move would bring much-needed revenue to the cash-strapped council.
However, there are concerns much of the £6.5m that could be raised will not go directly to the areas most affected by second home ownership - it is predicted only £230,000 would be split between parish councils while WNC would see a share of £440,000.
There are plans to fight for a better deal from Norfolk County Council, which is set to be the biggest benefactor from the tax hike, receiving £4.9m.
Comments: Our rules
We want our comments to be a lively and valuable part of our community - a place where readers can debate and engage with the most important local issues. The ability to comment on our stories is a privilege, not a right, however, and that privilege may be withdrawn if it is abused or misused.
Please report any comments that break our rules.
Read the rules here