Keywords

Agricultural science and technology website is an important window of agricultural science and technology departments and relevant units on the Internet to show their own image, also a concentrated expression of service ability and service level and service features, At the same time also as a important carrier of serviceing “three rural” and promoting agricultural informationization. From the current point of view, although the agricultural science and technology website is rich in resources, but the quality is uneven, how to better improve the website construction is a problem urgent need to solve. A Scientific evaluation method, can make the website administrator to complete understanding of the operation of the site, consummate the existing problems, improve the quality of the website. On the basis of the research of the peer, the principal component analysis method is used, exploring a new method of comprehensive evaluating websites.

1 Overview of Website Evaluation Method

At present, there are no unified standards and methods for the evaluation of the website. The author consulted a large number of literature data, summarized the following two kinds methods of the evaluation of the website:

  1. (1)

    web link analysis

At present, Link analysis and web impact factor measure related to it are widely used to evaluate the websites. Link analysis through the number of sites are linked to reflect the quality of the site. The evaluation is on the basis that a web site is linked another website is approval and use of this website, and the content of two website is related; the more number of external links of a web site, Explain Its influence is greater. The network impact factor measure is based on the link analysis, reflect the influence of the web site by the size of web impact factor.

Although this method is applied to a wide range of applications, but it also has shortcomings: it only start from the link analysis of the website, not comprehensive evaluation of a website, the authority is to be verified. At the same time, the data used to analysis mostly get from Alta Vista or Google and other search engines, which makes the results depends too much on the search engine, but due to the drawbacks of itself, search engine may not included all external links and internal links of a website.

  1. (2)

    analytic hierarchy process

Analytic hierarchy process divide the decision problem according to total target, sub target, evaluation criteria until the specific input sequential scheme is decomposed into different levels of the hierarchy and layer by layer analysis, ultimately, get the importance weights that the lowest level factor for the highest level factor.

Analytic hierarchy process can be used to evaluate the site, but the relative importance of each factor in the same level must be evaluated in the construction of evaluation matrix. This will have error inevitably due to the subjective behavior.

Based on the above research, In this paper, we give the evaluation index and calculation method of agricultural science and technology website, and use the principal component analysis method to analyze the evaluation index. Finally, the model is used to obtain the comprehensive ranking of 18 agricultural science and technology websites, and the relevant suggestions are given according to the evaluation results.

2 Principal Component Analysis Method for the Comprehensive Evaluation of the Principles and Methods

Principal component analysis is also called the principal weight analysis, which is an important method to study how to transform the multi index problem into a less comprehensive index. Because there is a certain degree of correlation between multiple variables, people naturally want to extract information from these indicators as quickly as possible through linear combination. Principal component analysis can change the problem of high dimensional space into a low dimensional space to deal with, make the problem become more simple, intuitive, and the comprehensive index of these less interaction and provide most of the information of the original index.

In practical application, the specific steps of principal component analysis are:

  1. (1)

    standardization of raw data

  2. (2)

    set up the correlation coefficient matrix of variable

  3. (3)

    obtain the eigenvalues and eigenvectors of the correlation matrix.

  4. (4)

    the number of principal components is determined by the cumulative variance contribution rate, and the principal components are extracted.

  5. (5)

    weighted synthesis of principal components, get comprehensive evaluation

.

3 Evaluation Index and Method of Agricultural Science and Technology Website

The evaluation of agricultural science and technology website mainly investigation from the content of the website, website design and user operation three major aspects. Each of the major aspects of the index selection consider of agricultural science and technology website features. The evaluation model is shown in Fig. 1:

Fig. 1.
figure 1

Evaluation index model of agricultural science and technology website

The evaluation method of the index is too dependent on the subjective score, so the evaluation of the importance of the indicators in the evaluation of the importance of a strong subjectivity. At the same time, simply rely on the objective data can not be a comprehensive reflection of agricultural science and technology website. So we make full use of the advantages of existing systems and professional personnel, the index can be described with the objective data as an objective data, can only rely on artificial score index scoring more than re synthesis method is implemented. The index data is more scientific. Specific practices are as follows:

  1. (1)

    website content

    Web content is good or bad is a valuable key of a agricultural science and technology website. For the content of the site we were from the following four aspects to Investigate:

    • Comprehensiveness. Comprehensiveness is the breadth of agricultural science and technology website contains content. Web site can be used to quantitatively expressed by the number of web pages. The number of sites webpages can be estimated approximately using the search engine included page numbers.

    • Practical application. Whether the choice of the content of the site is in line with the “three rural” needs, whether it is suitable for the specific user base, which is suitable for the “three rural” information. This indicator cannot be described by objective data, and it is determined by expert scoring method.

    • Authority. Authority is the impact of agricultural science and technology sites and the extent of the popularity of the site. This index can be described by using the website of agricultural science and technology anti link number, which the number of links from other sites to this site. The more the number of a website’s anti link, the greater the influence, the greater the authority.

    • The quality of Webpage. Web quality evaluation can be from the user point of view. Bounce Bounce RateBounce RateBounce RaterBounce Rateate is an important index to measure the quality of web pages. The Bounce rate is the percentage of the total number of visits from a particular portal to visit a site, which only access to one page on the number of visits to the total number of visits. When the site’s bounce rate is high, the quality of the page is very poor, do not attract users.

  2. (2)

    website design

    Good website design should have reasonable structure, the page is simple and beautiful, easy to use. For the website design we investigate from the following three aspects:

    • Navigation function. Navigation function for the user to use the entire site is essential. Design good navigation function can make the user more convenient, more quick browse information. This indicator is determined by expert scoring method.

    • Page design. Mainly to examine the page of friendship, include that, the structure is clear, the layout is reasonable, Logo is beautiful, etc. This indicator is determined by expert scoring method.

    • Connectivity. Effective connectivity mainly investigate the link to the page, if the webpage have broken link or dead link. This indicator can be used to described with broken link rate, broken link rate is the number of all the broken links of the website divided by the number of all links of the website.

  3. (3)

    user operation

    User operation is to measure the website good or bad from the users. For the user operation we investigate from the following three aspects:

    1. Friendly degree. Here is not to examine the degree of friendship from web design, but examine the entire web server response time, and page download time. Obviously, the response time of the server and the web page download times shorter, the higher the site the user-friendliness. Therefore, there are two indicators measure friendliness: server response time, page download time.

    2. User visits. User visits Is the number of user visits the site. We can use the average daily IP traffic number to describe user visits, visitors every page view can be described by Daily average page views.

    3. Search function. Search function for users to find resources is very important, well-designed site should have a comprehensive in-station search function, which should have advanced search and fuzzy queries. The index score is determined by experts. Detailed indicators and evaluation of the site’s content as shown in Table 1:

Table 1. Evaluation System of agricultural science and technology website

4 Examples of Application and Analysis

4.1 Evaluation Object

The evaluation object of this paper is 18 agricultural science and technology information website, which has 7 national agricultural science and technology website, 11 provincial agricultural science and technology website, as shown in Table 2:

Table 2. 18 evaluation objects

4.2 Data Sources

Data sources of this paper are the following four:

  1. (1)

    network technology resource monitoring, analysis, evaluation system.

The system long-term monitoring 18 agricultural science and technology website in Table 2, the system provided data included the number of pages, the number of anti-link, download time and the response time four indicators.

  1. (2)

    artificial: This paper invited 5 of the author’s colleagues, 5 ordinary users to form a group of experts. 5 of the author’s colleagues engage in agricultural science and Technology Information Research for many years, while the other 5 are ordinary users that often used agricultural science and technology website.

Respectively, usability, navigation, page layout and search functions independently scoring four indicators, score interval [0,1], 1 on behalf of full marks, 0 on behalf of 0. For each item of data to remove one of the highest and lowest scores, then averaging the remaining data is the index score.

  1. (3)

    Alexa: Alexa is a site that specialized publishing website ranking. Alexa every day collect more than 1000 GB of the information, not only give billions of web site links, but also rank for each of the sites. It can be said, Alexa is currently has the largest number of URL, released ranking information the most detailed site.

Alexa provides the data for: average daily IP access, the average daily amount of page view browsing and bounce rate.

  1. (4)

    Chinaz (Chinese webmaster station): is a specializes in providing information for Chinese site, technology, resources and services of the website, website existing millions of users.

Chinaz provides data for the number of broken links of the site and the total number of links to the site.

4.3 Data Extraction

Extracting data from the four data sources mentioned in Sect. 4.2, after finishing get the relevant index data of 18 agricultural science and technology site as shown in Table 3:

Table 3. Index data of 18 agricultural science and technology website

4.4 Comprehensive Ranking of Agricultural Science and Technology Website Based on Principal Component Analysis

In this paper, using SPSS13.0 execute the principal component analysis, and the specific steps are:

  1. (1)

    standardization of raw data

In principle component analysis method, the standard method is Normal standardization, and for the practical application, according to the difference of the index, divided the bigger the better and the smaller the better. So we take the following standard method:

With m evaluation object, n evaluation index. All data constitute a m*n order matrix X = (X1, X2,… Xn). Where Xi is a m*1 dimensional vector. Let max (Xi) is the maximum value of Xi, min (Xi) is the minimum value of Xi. Max (Xi) = (max (Xi), max (Xi),… Max (Xi)) T is a m*1 dimension vector, Min (Xi) = (min (Xi), min (Xi),… Min (Xi)) T is the m*1 dimension vector, For the bigger the better type index, the formula is:

$$ \text{X}_{\text{i}}^{\text{*}} = \frac{{\text{X}_{\text{i}} \text{ - Min(X}_{\text{i}} \text{)}}}{{\hbox{max} \left( {X_{i} } \right) - \hbox{max} \left( {X_{i} } \right)}} $$
(4.1)

For the smaller the better type index, the formula is:

$$ \text{X}_{\text{i}}^{\text{*}} = \frac{{\text{Max(X}_{\text{i}} \text{) - X}_{\text{i}} }}{{\hbox{max} \left( {X_{i} } \right) - \hbox{max} \left( {X_{i} } \right)}} $$
(4.2)

In this paper, n = 12, m = 18. The bigger the better type included web number, practical, the number of anti link, navigation, page design, average daily IP access, the average daily amount of page view browsing and search functions eight indexs. The smaller the better type included bounce rate, broken link rate, download time and response time four.

  1. (2)

    Use SPSS 13.0 for factor analysis

Get the standardized data input SPSS data editing window, the 12 indicators were named X1 ~ X12. Select Analyze->Data Reduction->Factor menu item in the SPSS windows, Tune out factor analysis main interface and move the variable X1 ~ X12 into the variables box, click the OK button, execute factor analysis process. Get the characteristic roots and variance contribution rate table shown in Fig. 4 and factor loading matrix as shown in Table 5:

In Table 4 in total column is each factor corresponding characteristic root, In this case extract five common factors; % of Variance column is the variance contribution of each factor; Cumulative % column is the cumulative variance contribution rate of each factor, As can be seen, the first five factors can explain 75.177 % of the variance.

Table 4. Characteristic root and variance contribution rate table
  1. (3)

    using factor analysis result execute principal component analysis

Get Table 5’s data input SPSS Data Editor window, Column named a1 ~ a5. Then click on the menu item Transform->Compute, Recall Compute variable dialog, Enter z1 = a1 / SQRT (3.008) in the dialog box, Click the OK button, you can get a first feature vector. Similarly, it can be calculated for all the feature vectors, which results are shown in Table 6:

Table 5. Factor load matrix
Table 6. Feature vector matrix

By multiplying the matrix of the original data with the eigenvector matrix, can obtained the 5 principal components Y1–Y5. Then the 5 main components weighted comprehensive, you can get the comprehensive score of the agricultural science and technology website, Specific data shown in Table 7.

Table 7. Agricultural Science and Technology site principal component scores and order

The formula for calculating the comprehensive score is

$$ \text{Y} = \frac{{\lambda_{1} }}{{\sum\limits_{i = 1}^{5} {\lambda_{i} } }}Y_{1} + \frac{{\lambda_{2} }}{{\sum\limits_{i = 1}^{5} {\lambda_{i} } }}Y_{2} + \cdots + \frac{{\lambda_{5} }}{{\sum\limits_{i = 1}^{5} {\lambda_{i} } }}Y_{5} $$
(4.3)

Y is a composite score, \( Yi \) is the main component i, \( \lambda i \) is the characteristic root of the main components i.

4.5 Analysis and Suggestion

We compare the ranking of this paper with the Alexa ranking, and the results are shown in Table 8:

Table 8. Comparison of the ranking of this paper with Alexa

From Table 8 we can get the following results:

  1. (1)

    We can see, in this paper the first top seven sites is consistent with Alexa ranking, but the first and the second ranking is not consistent. This is because in Alexa ranking, its information flow rank is predominant factor, the impact of other parameters is very small. At the same time also can be seen, when the site information flow reach a certain degree, the greater the information flow, the better the site of the index to maintain, the higher the overall ranking.

  2. (2)

    The websites ranked in 8–18, this article ranking and Alexa have a larger discrepancy, so we can see, Alexa for the websites comprehensive ranking is not high not has a very high reference value.

  3. (3)

    Overall, the ranking of the national agricultural science and technology websites is higher than the local agricultural science and technology websites. But there are exceptions, such as nine hundred million network, so the nine hundred million network need to be further improved. Single from the national agricultural science and technology websites: Golden agriculture network, nong bo network and Chinese Academy of Agricultural Sciences network, the comprehensive ranking is higher, the utilization of its website is also higher. From the local agricultural science and technology websites: Beijing, Shandong, Hunan stay ahead, It explained that the Ranking of Agricultural Science and Technology websites are relevant with the local information level and agriculture level. Guangdong, Zhejiang although the level of economic development is higher, the level of agricultural information needs to be further improved.

In this paper, through construction agricultural science and technology websites evaluation model, Using principal component analysis to analysis, For 18 agricultural science and technology site ranking, And based on ranking results comparison with Alexa ranking, giving agricultural science and technology websites analysis and evaluation. Through this type of evaluation, can play an important promote role to agricultural science and technology websites healthy development and agricultural Information Development.