Residents of the ultra-exclusive neighborhood are said to be bracing for renewed chaos as the music mogul pushes for an early return to his $60M mansion.