Go to the Twitch tab in the Alert Box page. Click on Widget and select Chat Overlay to set up the look and feel. You can also choose to show or hide Badges for Moderator, Subscriber, and Turbo.
Once done, remember to click Save to apply your settings.