No, as a protected site, camping is not allowed inside The Hermitage. However, the tranquil Inver Mill Farm Holiday Park is just outside. You can also explore different options for camping near The Hermitage on Hipcamp.