No, the orange plastic underneath the drum is not supposed to stay in the machine. This is a protective cover that should be removed before installation. Your drum will not fit properly into your machine if you try to install the drum with the orange plastic cover still on.
Check out our video below to learn how to properly install a Brother toner cartridge that comes with a protective orange clip: