基于網頁采集的校園新聞移動網站設計與實現
發布時間:2019-05-10 09:03
【摘要】:隨著互聯網技術和計算機技術的發展,特別是第三代移動通信技術的應用和推廣,人們的閱讀習慣也發生了改變,大家迫切地希望能在任何時間地點場合通過無線網絡使用移動設備方便地瀏覽web獲取信息。校園中更是如此,擁有大量移動設備使用人群的學校里,這種無線上網的需要更是迫切。而移動設備有著很多PC機等完全不同的特點,使得原來的HTML網頁無法在移動設備上良好地運作,這給移動網站的開發帶來了機遇。 基于以上問題,本文從分析校園網站移動現狀開始,提出了基于新聞采集的校園新聞網站移動化的解決方案。本文主要研究和解決兩個問題,一個是如何從現有學校新聞網站提取信息,存儲到數據庫中,另外一個則是如何把這些信息方便有效的展現在用戶的移動設備上。 本系統采用基于規則的方式來實現采集,通過http協議獲得網頁信息,然后通過DOM樹利用系統和用戶定制好的規則萃取頁面的有效信息到服務器并儲存在數據庫。另外編寫一個數據處理的模塊處理采集回來的數據,該模塊統一了訪問控制,并通過json和web頁面兩種形式傳給客戶端原生應用程序及手機瀏覽器,其中web頁面會根據客戶端的不同而使用不同的頁面模板。這兩種形式可以滿足不同客戶對系統的不同要求。目前該系統已經作為移動校園的其中一部分應用到廣東第二師范學院的移動應用中。 本系統的主要特色在于:其一,使用采集方式獲取舊網站系統數據,不同于其他的移動網站直接在舊系統上進行改造的開發方式,能更夠快速廣泛的與舊系統結合;其二,同時提供web app頁面和原生應用系統使用的接口,,更廣泛的支持各種設備,也能夠最大限度的滿足部分客戶對性能的要求;其三,系統采用中間件的形式,能夠和舊系統分開部署,能夠使得服務器部署更加靈活。
[Abstract]:With the development of Internet technology and computer technology, especially the application and promotion of the third generation mobile communication technology, people's reading habits have also changed. People are eager to browse web to get information conveniently through wireless network at any time and place. This is especially true on campus, where there is a large number of mobile device users, the need for this kind of wireless Internet access is even more urgent. However, mobile devices have many completely different characteristics, such as PCs, which makes the original HTML page can not work well on mobile devices, which brings opportunities to the development of mobile websites. Based on the above problems, this paper starts with the analysis of the current situation of campus website mobility, and puts forward a solution of campus news website mobility based on news collection. This paper mainly studies and solves two problems, one is how to extract information from the existing school news website and store it in the database, the other is how to display this information on the user's mobile device conveniently and effectively. The system adopts the rule-based method to realize the collection, obtains the web page information through the http protocol, and then uses the system and the user-customized rules to extract the effective information of the page to the server and store it in the database through the DOM tree. In addition, a data processing module is written to process the collected data. The module unifies the access control and transmits it to the client native application and mobile browser through json and web pages. Web pages use different page templates depending on the client. These two forms can meet the different requirements of different customers for the system. At present, the system has been applied to the mobile application of Guangdong second normal University as part of the mobile campus. The main characteristics of this system are as follows: first, the use of collection to obtain the data of the old website system, different from other mobile websites directly in the old system of the development of the way, can be more rapid and extensive combination with the old system; Second, at the same time, it provides the interface used by web app page and native application system, which supports a variety of devices more widely, and can also meet the performance requirements of some customers to the maximum extent. Third, the system adopts the form of middleware, which can be deployed separately from the old system, which can make the server deployment more flexible.
【學位授予單位】:華南理工大學
【學位級別】:碩士
【學位授予年份】:2014
【分類號】:TP393.092
本文編號:2473526
[Abstract]:With the development of Internet technology and computer technology, especially the application and promotion of the third generation mobile communication technology, people's reading habits have also changed. People are eager to browse web to get information conveniently through wireless network at any time and place. This is especially true on campus, where there is a large number of mobile device users, the need for this kind of wireless Internet access is even more urgent. However, mobile devices have many completely different characteristics, such as PCs, which makes the original HTML page can not work well on mobile devices, which brings opportunities to the development of mobile websites. Based on the above problems, this paper starts with the analysis of the current situation of campus website mobility, and puts forward a solution of campus news website mobility based on news collection. This paper mainly studies and solves two problems, one is how to extract information from the existing school news website and store it in the database, the other is how to display this information on the user's mobile device conveniently and effectively. The system adopts the rule-based method to realize the collection, obtains the web page information through the http protocol, and then uses the system and the user-customized rules to extract the effective information of the page to the server and store it in the database through the DOM tree. In addition, a data processing module is written to process the collected data. The module unifies the access control and transmits it to the client native application and mobile browser through json and web pages. Web pages use different page templates depending on the client. These two forms can meet the different requirements of different customers for the system. At present, the system has been applied to the mobile application of Guangdong second normal University as part of the mobile campus. The main characteristics of this system are as follows: first, the use of collection to obtain the data of the old website system, different from other mobile websites directly in the old system of the development of the way, can be more rapid and extensive combination with the old system; Second, at the same time, it provides the interface used by web app page and native application system, which supports a variety of devices more widely, and can also meet the performance requirements of some customers to the maximum extent. Third, the system adopts the form of middleware, which can be deployed separately from the old system, which can make the server deployment more flexible.
【學位授予單位】:華南理工大學
【學位級別】:碩士
【學位授予年份】:2014
【分類號】:TP393.092
【參考文獻】
相關期刊論文 前6條
1 張逸;賈金璽;;新聞網站的移動化之路[J];重慶工商大學學報(社會科學版);2013年02期
2 譚翔緯;;利用JSON實現Android客戶端與Web服務器間的數據交互[J];福建電腦;2013年02期
3 付亮;于立娟;陳幽君;秦雯;;2012-2013年移動互聯網發展趨勢綜述[J];互聯網天地;2013年02期
4 劉文;甘志春;李文;王更輝;;基于XML和JSON的格式化網絡參數文件研究[J];計算機與網絡;2013年24期
5 王左利;;校園移動平臺:未來的主角[J];中國教育網絡;2012年11期
6 ;移動校園 下一個競技場[J];中國教育網絡;2012年11期
本文編號:2473526
本文鏈接:http://www.malleg.cn/guanlilunwen/ydhl/2473526.html

