Will not having a dance or theatre credential affect my chances at getting a new job, should I want to leave my current position?

There is no way of guessing.  An HR Department may value experience over all else, or they may need to be educated that your PE or English credential allows you to teach dance or theatre.  Most California counties have a large teacher shortage now and in the foreseeable future.