The garden has a building called 淳浄館 which is an exhibition space. Buildings like this are usually not open to the public.