Tianyi Pavilion library built in the middle of the Ming Dynasty. After the Qing Dynasty and the Republic of China, it gradually formed the current pattern of the South and North Garden. According to the  ve steps of stone selection: mountain building, stone stacking, water management, and stone lighting, this paper analyzes the construction methods of stone landscape in the South and north of Tianyi Pavilion, to explore the unique ingenuity of garden building. The stone landscape art of the South and North Garden highly combined with the local natural environment and cultural traits, which has unique connotations in the artistic conception of modeling, color selection, environmental construction, and cultural heritage. The stone landscape art in the South and North Garden embodies the tradition of "the Tao follows only itself" and "see the whole world from a grain of sand". Moreover, it represents the idea of "form follows function" around the book collection function, which is in anextremeunity of art and practice.