Japanese gardens’ heritage enjoys a high reputation in the world and has rich experience in conservation and management systems and management measures of garden elements. As a representative garden in modern Japan, Murin-an garden focuses on daily conservation and management, especially on the original artistic conception of the garden and the specific management measures of the garden elements, which are based on the meticulous management plan for the inheritance and integration of historical culture, and highlight the importance to the public participation and education of the Japanese garden heritage. Based on the background of the conservation and management experience of gardens in Japan, this paper analyzes the historical development and heritage value of Murin-an garden and summarizes the conservation and management experience of Murin-an garden from the aspects of “artistic conception” and “technology”, focusing on the authenticity, routine, systemization, and delicacy. This case study will provide us with a reference for the conservation and management of garden heritage in the current life context in China.