Adding the following snippets to your theme’s functions.php file will let you remove gallery settings in WordPress.

Snippet Source/Credit: mfields.org