Hi Kelsey
Thanks for reaching out.
The #2 you’re seeing is your menu. If you head over to Appearance > Menus
you can create a custom menu and assign that menu to the theme’s primary menu location. For more on that please, see:
Menus
Menu Locations and Usage
Ultra doesn’t have a setting to remove the menu. If you want to do that you can go to Appearance > Menus, create a new menu but don’t add any links or pages to it. Save that menu to the theme’s primary location and you should then have a blank menu in place.
I’ll be back online tomorrow, GMT+2 and can assist with any follow-up questions you may have then 🙂