A small number of people like to have bonfires around here regardless of the impacts on their neighbours. Unfortunately you are not the only one having to put up with this environmentally unfriendly and unneighbourly behaviour.
Having a bonfire and causing a nuisance on a regular basis is illegal , at ANYTIME day or night.
A nuisance is defined as spoiling the enjoyment of one's land so a bonfire from a domestic premises where the wind blows the smoke over nobody is okay and obviously very difficult to do if in town. In the country there is a chance.
Enforcement is Environmental Health at South Norfolk /Broadland but I have chosen my words carefully
It has to be regular AND this does NOT apply to business premises building sites etc when it is not permitted