Ilum’s Crystal Caves were the main source of crystals for the Jedi from millenia before the Cold War, all the way up to the end of the Clone Wars. However, the Adegan crystals that grow on Ilum can also be found on Dantooine (in a place also called the Crystal Cave), Halm, Mygeeto, and Ossus. The latter three planets do not have Jedi Temples, however, and the Great Jedi Library on Ossus was abandoned around 4000 BBY.
Jedha, of course, had large stores of kyber crystals before the Empire started mining them. They were guarded in the Temple of the Kyber in Jedha City.
Christophsis, while it doesn’t have any temples, was also an exporter of kyber crystals before the Empire came to power, as the crystals that grew all over its surface could be used in lightsabers.
In the First Order, the most important ships had weapons that used kyber crystals obtained from an unnamed source in the Unknown Regions.
There are many, many more planets on which other crystals grow that can and have been used in lightsabers, but these are often not classified as kyber crystals. They also tend to be very rare, and are only mentioned in Legends. If you need a place with both accessible crystals and a Jedi Temple, Jedha or Dantooine would be your best bet.
I hope that helps!
~ Jacen