This is likely because the Strength is set too high, or there is too much noise in your clip. Try to reduce the strength knob to something lower than 80%. If there is noise in the clip, you may consider adding AudioDenosie or another noise removal tool before Levelmatic. So that would be upstream of Levelmatic in your plugin chain.