Temple garden, as a part of the cultural heritage in our country, is facing space differences and time changes under the background of the rapid development of modern society. Analyzing its space distribution and influencing factors are significant to the protection, inheritance planning, and utilization of temple garden heritage. This paper takes 1 772 temple gardens in Guangdong Province as the research object, uses the nearest neighbor index, kernel density estimation, and other spatial analysis methods to study their spatial distribution characteristics from the aspects of type, density, and structure, and discusses the influencing factors of their formation and development. The results showed that: (1) The spatial distribution of temple gardens was unbalanced, with apparent local agglomeration characteristics, and the spatial distribution pattern was “high at both ends and low in the middle”. The temples and gardens in prefecture-level cities showed a spatial distribution pattern of concentrated distribution and uniform distribution. (2) The nuclear density distribution of temple gardens showed a trend of spreading from the east and west poles to the central and northern parts, which had a certain reverse trend with the economic structure of Guangdong Province. (3) The diversity of the natural environment, the heterogeneity of population and economic development, the development history of different regions, and the distribution of ethnic groups provided the conditions for the differentiation of temple gardens in Guangdong Province, which are the main factors affecting the spatial distribution of temple gardens in Guangdong Province.