Thoughts? could pancreatitis caused by gallstones go away if the stones are removed?

Not exactly: If only the stones are removed, the gb, where they formed, would allow new stones to form and cause new trouble. This is the reason the gb and the stones are to be removed. Unfortunately, once you have suffered an inflamed pancreas from any cause, there is risk that it can re-occur in the future - whether stones are still present or not.

Yes: In fact, that is the treatment for gallstone pancreatitis. Gallstones form in the gallbladder and there may be a large number of them. Only takes one to cause problems, so the accepted treatment is to surgically remove the gallbladder.