Historical and cultural space is the key element of shaping urban characteristics and highlighting urban culture. At present, China’s urbanization has entered a new stage of transformation and development focusing on improving the quality. Urban development faces both challenges and opportunities, and it is urgent to change the mode of urban development. The 20th National Congress of the Communist Party of China (CPC) proposed that “adhere to the people’s city by the people, the people’s city for the people, improve the level of urban planning, construction and governance, implement urban renewal actions, strengthen urban infrastructure construction, and build livable, resilient and smart cities”, which pointed out the basic direction for the new people centered urbanization in the new era. Among them, historical and cultural space as an important support of urban cultural strategy has been paid attention to. Its protection and cognition is one of the basic conditions for the continuation and inheritance of history and culture. However, rapid urbanization has also brought impacts and challenges to many historical and cultural regions. With the change of production and life style, many historical and cultural features and their spatial carriers have been destroyed and homogenized. The “historical information material space network” based on the historical layer dimension and the “population cognitive map network” based on the cognition of different populations were constructed. Social network analysis (SNA) was used to establish a feedback model for the comparison of two kinds of networks under the three levels of “network group-node” index system. Firstly, through theoretical research and field investigation, this paper studies cultural space and cultural space network, analyzes the layered attributes and perceptual attributes of the cultural space network of ancient towns, and considers the social network analysis method as the analysis. Combining with the layered property of historical and cultural space, the paper researches and stacks historical information to lay the foundation for constructing “historical information material space network”. According to the perception attribute of historical and cultural space, the cognitive map survey of the crowd is carried out, so as to build the “cognitive map network of the crowd”. Combining with social network theory, this paper analyzes the superiority of social network analysis (SNA) and lays a foundation for the feedback process of cognitive feedback model. Secondly, this paper carries on the model building and quantitative analysis. Combined with the research in the above part, the “historical information material space network” and “population cognitive map network” of Tangjiawan Ancient Town are constructed respectively. The social network analysis method is innovatively used to establish and construct the “cognitive feedback model” of cultural space from three levels: network, group and node. Compare the cognitive completeness of the overall scale of the network among different groups; at the group level, the number and status of “memory islands” are analyzed by comparing the intermediate points with “blocks” and “tangential points”. At the node level, the imageability and attractiveness of individual nodes are analyzed by weighted results of cognitive frequency and intermediate centrality. The final research results interpret the imageability of the cultural space of Tangjiawan Ancient Town in Zhuhai from different angles through the constructed cognitive feedback model of cultural space. The research shows that: 1) the historical and cultural space either exists or can be recognized; 2) people have a clear cognition of the network structure, but there are differences in scale and scope of cognition; 3) residents and tourists are more likely to appear memory islands and have poor connection; 4) the cognition of nodes shows a trend of high concentration of network nodes. The article further discusses that the city image is not only a symbol or symbol of the city, but also plays an important role in daily life. The superposition of urban images from different perspectives in urban space reveals that urban planning should not only build a spatial pattern highlighting urban characteristics from the top down, but also systematically sort out daily spaces that meet the needs of different groups from the bottom up, enhance urban vitality, and shape a people-oriented city. Exploring the difference mechanism through cognitive feedback model can help build a human-centered historical and cultural space. At the same time, this cognitive feedback model also builds a quantitative and visual research angle for the quantitative research on the memory inheritance of historical and cultural space.