Jump:
Ordnance Survey – Great Britain's national mapping agency
This section reviews the role of the UK government and its agencies in information collection and provision. It includes:
Much information is collected by government departments for their own purposes. The market for information collected by government is, however, developing. This market can be broadly divided into:
Each segment is considered briefly below with special reference to geospatial information markets.
As indicated earlier, governments collect, generate, use and disseminate many types of information. Again as we saw in Section II, much of this information falls into the following broad categories:
In addition to this, governments collect and provide information on the business of government itself, on policies and on the institutions of governments.
In the UK, government information is mainly provided by central government departments and Executive Agencies. Information supplied directly by central government departments usually concerns the activities of these departments and these cover a wide spectrum. The Department of the Environment, for example, collects land use change statistics (via a contract with Ordnance Survey). Our focus in this section is, nonetheless, primarily on Executive Agencies which collect information. Many of these Agencies are defined as government departments in their own right. We have not considered in depth the resource costs associated with collecting some types of information for government which are sometimes borne by the private sector such as, for example, Companies House returns.
We distinguish four primary reasons for information collection by these Agencies:
These reasons for information collection are used to segment and group information providers later in this section.
Many government agencies supply data both directly to end-users and to resellers including:
Publishers range from operations that focus on a single product to those that provide a wide range of products and services. They often operate in specialist fields and take significant commercial risks. In the market for geospatial data, most resellers are agents or consultants providing services on demand.
Government information providers and their resellers often compete with other organisations that have developed products based on their own data, or on out-of-copyright data that has been up-dated (for example, EDX).
In geospatial data markets, many of these organisations are UK-based and provide one or a small range of products which compete with only part of Ordnance Survey's portfolio of geospatial data products and services. There are, however, some signs that suppliers from other countries are now beginning to enter the UK market with products based, for example, on satellite imagery, but they are not competing directly with Ordnance Survey data.
Government-produced information is used very widely. To illustrate the scope of applications, consider just three examples:
There are many different users of geospatial information including:
Historically, the largest British users of geospatial data have been local authorities and the utilities In the local government sector, prices for Ordnance Survey mapping are governed by a service level agreement established between the Ordnance Survey and the Local Government Management Board. This has stimulated the local authority market. In 1993, only 20% of LAs used Ordnance Survey digital data but this had risen to 80% by 1995..
Utilities are also large users of basic scale mapping; for example, it is common to find in excess of 70000 map sheets in a Regional Electricity Company. Ordnance Survey has recently agreed a service level agreement with the utilities, but there is some evidence of price sensitivity. Some of the RECs have decided, for example, to base their Geographic Information Systems on scanned images of old maps.
The remainder of the geospatial information market:
This mix and profile of users of geospatial data is a relevant consideration when segmenting and grouping key government information providers.
In practice, there are significant differences in the pricing policy, funding and commercial activities of the government information providers. In the area of commercial activities, several agencies would seem at first sight to be operating in a way not entirely consistent with the government guidelines highlighted in Section III. Before summarising this situation, however, we review the rationale for data collection by Executive Agencies.
Earlier in this section, we highlighted four primary reasons for Executive Agencies to collect data on behalf of government. These were:
In addition, government may, on occasions, be more effective as a data collector because businesses will provide data to government which they would not provide to a commercial data collector.
In our view, the key test for the first reason is whether central government would collect and maintain the same datasets to the same quality level even if these datasets had no value and no applications outside government. Where this is true, the agencies concerned may understandably attach a relatively lower priority to dissemination of data beyond government.
Key issues underlying the second primary reason are:
The third primary reason is concerned with government's regulatory role in supporting the operation of efficient and competitive markets and with standard setting, licensing and testing roles. Often, in this area, the burden of collection is placed on independent economic agents in the private sector because they have to comply with regulations (eg annual returns to Companies House).
The fourth primary reason is where there are many commercial users and applications, but where government takes a role in collection and dissemination because of perceived "external" benefits.
Classifying information providers against these primary reasons inevitably involves some judgement. Nevertheless, we think it is important to try and distinguish primary and secondary reasons for data collection because this should be a key determinant of the policy stance towards the Agency, especially on pricing and the related cost recovery issues.
On the basis of this segmentation, we have grouped the main Agencies involved currently with data collection as follows:
We note that this will change when the CSO merges with the Office of Population Censuses and Surveys to form the Office of National Statistics in April 1996. OPCS gets a significant proportion of its revenue from running surveys for government departments and other customers and from sales, in addition to its vote. We have excluded HMSO from our analysis; this body currently plays an important role in publishing government information but is much less involved in data collection.
On this basis, none of these organisations exists primarily to provide data for commercial users. This is not surprising given that policy has only recently changed to allow additional data collection on the back of primary collection (see Section III). As noted above, this is a matter of judgement though and, in practice, policy-makers may be influenced by factors such as the value of the information to potential commercial users.
This issue is particularly complex for Ordnance Survey and similar bodies which do not make policy-related use of their information internally and, in addition to meeting "national interest" requirements, serve a variety of end-users. These factors influence what information should be collected and, hence, the total level of resources allocated to national mapping and comparable activities.
In addition to the primary reason for data collection, the underlying cost structure of the information providers is a key determinant of cost recovery levels.
Figure 4.1 compares, on a highly illustrative basis, the cost structures of a sample of government information providers. We distinguish between the costs of:
The figure presents a schematic view of the relative importance of each process in the overall cost structure of the Agency. We note that, on occasions, information providers have to bear major data conversion costs, especially when technologies move forward. The now-completed digitisation process at Ordnance Survey provides an excellent example.
Figure 4.1 shows that economic and population statistics produced by, for example, CSO and OPCS are characterised by high costs of collection and low costs of maintenance and dissemination. This is because the data are always collected anew each time, albeit often on a sample basis, and are relatively simple compared with other geospatial data.
| Organisation | Initial data collection |
Maintenance of databases |
Data dissemination |
Data packaging |
Value added services |
| OPCS | XXX | X | X | X | X |
| CSO | XXX | X | X | X | X |
| OS | X | XXX | X | X | X |
| Met. Office | XX | XX | X | X | X |
| Companies House | X | X | X | X | X |
In contrast, data required for regulatory purposes will tend to have low collection costs as much of the burden of collection tends to be placed on the individuals or companies supplying the information.
Once an underlying dataset exists, topographic, hydrographic and geologic data tend to have low costs of initial collection but high costs of maintenance because of the need to keep the database up-to-date. The costs of dissemination and packaging data will tend to be higher given the complexity of the data, although these costs have fallen over time with improvements in technology.
Against this background, we now consider the funding of these information providers.
Figure 4.2 summaries the financial position of the main government information providers and shows significant variation in the extent of public funding. Some are largely government financed, such as the CSO which recovers less than 4% of costs from commercial sales. In other cases, however:
NB Not all revenues are from sales of information
| £ million | Expenditure | Revenue | Net cash Costs |
% Cost recovery |
| CSO* | 49.5 | 1.9 | 47.6 | 4% |
| OPCS* (includes research revenue) |
70.0 | 38.0 | 32.0 | 54% |
| Meteorological Office (includes research revenue) |
141.1 | 57.0 | 84.1 | 40% |
| British Geological Survey (includes research revenue) |
40.0 | 24.0 | 16.0 | 60% |
| Hydrographic Office | 37.9 | 22.0 | 15.9 | 70% |
| Ordnance Survey | 74.8 | 58.6 | 16.2 | 78% |
| Central Office of Information (mainly advertising expenditure for departments) |
113.2 | 112.9 | (0.3) | 100% |
| Registers of Scotland | 29.7 | 31.5 | (1.8) | 106% |
| HM Land Registry | 197.4 | 235.6 | (38.2) | 119% |
| HMSO† | 351.0 | 351.4 | (0.4) | 101% |
| Companies House | 33.5 | 36.8 | (3.1) | 110% |
*CSO and OPCS merged on 1 April 1996
† The total figure covers four divisions: Business Supplies, Print, Publications and Corporate Services. Most of the first and part of the second division is not concerned with information provision, reducing the relevant income and expenditure figures by about half.
Figure 4.3 shows cost recovery levels against our four primary reasons for collecting information. This shows that:
For CSO, this perhaps reflects a previous policy stance that the data collected are essential to and driven very largely by the needs of central government. More recently, there has been an objective of making data as widely available as possible to all users. Charging for data is seen to be consistent with this latter objective, given funding constraints.
The Registers of Scotland, HM Land Registry and Companies House all have the advantage that their data are by-products of regulatory functions where much of the burden of collecting the information is placed on the private individuals or organisations providing the information. This contrasts sharply with other information providers where the cost of creating the information has to be funded either directly by government or by revenue from sales. Furthermore, often those submitting information to the Agency can be charged a cost-related collection and processing fee as well as users being charged for access to the information.
Revenues reported by the information providers include both sales to the private sector and to the public sector. They also include research and consultancy fees as well as information sales. Services to government departments may also be vote funded. The cost recovery recorded by an agency will, therefore, depend on the relationship it has with its government customers. For example, if CSO was to have a contract with its main customer, HM Treasury, it would show a very high rate of cost recovery. On the same rationale, the move of the Meteorological Office on to a Trading Fund could be considered to classify it as 'high cost recovery'.
| Low cost recovery | Medium cost recovery | High cost recovery | |
| Business of government |
Central Statistical Office Government departments |
Ordnance Survey Met. Office Hydrographic Office British Geological Survey |
|
| 'National interest' and public benefit |
Ordnance Survey Met. Office Hydrographic Office British Geological Survey |
||
| Commercial services |
Ordnance Survey Met. Office Hydrographic Office British Geological Survey |
HMSO Central Office of Information |
|
| Regulatory requirement |
Companies House HM Land Registry Registers of Scotland |
The pricing policies of any Agency are obviously strongly influenced by its strategic objectives, its financial targets and, hence, its agreed funding.
For information providers, pricing policies range between dissemination cost, marginal cost, full cost recovery and market-based prices. Some interesting examples are as follows:
For most central government departments, the general policy is to recovery additional costs associated with dealing with requests for information and not to exploit commercial opportunities. The pricing scheme usually involves some time dealing with requests at no charge, but thereafter a charge based on the marginal cost for time and copying. There is, however, significant variation in the charging schemes and a lack of transparency in how charges are set.
Price and product differentiation is a widespread practice. It is often not clear to what extent differences in prices reflect true differences in the costs of supplying the different products and users. There is, for example, a general practice through the National Environmental Research Council, which part-funds the British Geological Survey, of providing discounts to academics and discounts are also provided to local authorities. Other examples include the following:
CSO often discounts products for schools, libraries and academic institutions provided the data is not used commercially. Where possible it also seeks sponsorship of publications from businesses to enhance dissemination; and Ordnance Survey has a very sophisticated pricing structure that involves a combination of volume discounts and two-part tariffs.
The resellers we interviewed generally accepted that government information providers are seeking to exploit the commercial value of data and recognised that prices provide a useful signal to providers on the value of their data. In particular, some interviewees said that reasonable prices for data give an incentive to providers to meet the needs of users and give the users an opportunity to influence what and how information is collected. But interviewees were critical of the lack of transparency in pricing and said government providers should not "interfere" with the market place. By this they mean that providers should not:
As explained in Section III, central government information providers also work closely with the private sector:
Examples of partnerships with the private sector in production activities include contracting out:
In addition, Ordnance Survey has worked closely with the private sector in the digitisation of its data, through the franchising of Superplan and in most aspects of its sale of maps in paper and computer form other than bulk supply under service level agreements.
There are also examples of partnerships with the private sector focused on the development and provision of value-added services and products. Current UK government policy, however, is that it is the role of the private sector to develop value added services and that the public sector should not seek to compete with the private sector, (Note 1) where value added services are seen to include (Note 2):
Our interviews suggest that government information providers see the skills in marketing and packaging that the private sector can bring as very important to realising the commercial value of data, particularly in immature markets. But these providers also believed that in immature markets they cannot rely solely on the private sector to develop products.
Some examples of partnerships are as follows:
Practices do, however, vary and there is some debate about the extent to which providers should be involved in the supply of value-added services and the extent to which they use intellectual property rights to protect their position in this market. Underpinning this are the conflicting pressures on information providers, highlighted in Section III, both to raise cost recovery levels and not to compete with the value added resellers.
Companies House and the Registers of Scotland do not consider the provision of value-added services to be their responsibility.
Other government information providers are involved in value added services, but recognise the potential competition issues and have taken steps not to distort competition. Some examples are:
HMSO believes that there might be incentives for information providers to use intellectual property rights to restrict access to data for commercial reasons. It accepts that this could have adverse implications for competition in downstream markets, but believes the problem is easily addressed by the objectives that the providers are set.
These examples contrast with:
Improvements in technology have made it much easier to add value by integrating datasets. This requires consistency of the underlying databases. The Central Statistical Office, which has a central position in the government statistical service, has an aim to "maximise the use and value of statistics by prompting the possibilities for integration of data by improving the co-ordination of government statistics and helping to develop common standards, classifications and definitions." CSO see this co-ordinating role to be essential as individual departments will be resistant to changes in standards that interfere with time series data.
One reason for the merger of CSO with the Office of Population Censuses and Surveys and with the statistics branch of the former Department of Employment to create the Office of National Statistics (ONS) has been to encourage consistency and to create a larger single database.
Ordnance Survey has the task of fostering a National Geospatial Database to be achieved through the integration of national topographic data and other geospatial data held by government departments and agencies. This will certainly require collaboration between Ordnance Survey and ONS since the UK is unusual because of the very wide disparity of geographical units used for the collection and aggregation of official statistics: this problem will have to be addressed if the production of integrated, country-wide geospatial data is to be achieved. This organisational challenge is probably greater than the technical challenge.
We note there are various existing initiatives between agencies and government departments to promote data integration. For example:
An issue raised frequently during our interview programme was the meaning of the term "integrated database". The conclusion interviewees reached was that this should not imply one large physical national geospatial database, in one place, owned by one organisation, but:
A key finding from the interviews was that there is expected to be increasing demand for data integration, but that the efforts of government information providers should be focused on meeting demand for specific applications rather than on schemes to draw together all possible providers to support one large, totally integrated database.
Developments in computer technology and the digitisation of data have already had a major impact on the information market. Some examples of improvements in services include:
Digitisation has led to:
The result has been an increase in demand for data and associated products, particularly in the market for geospatial data, where the complexity of the data has in the past been a major constraint. Despite this, however, the market for geospatial data is generally regarded as immature. The reasons for this are said to include:
There is, however, considered to be significant scope for growth given:
From our interview programme, key trends in geospatial information in the future are expected to be:
Interviewees also noted:
These trends indicate that the underlying business economics of geospatial information provision are changing rapidly which, in turn, will have implications for the most effective method of ensuring and financing base data provision in future.
Government-produced information, especially geospatial information, is widely consumed by many different groups of users. The market is diverse and includes some segments which are not price-sensitive, for example 'professional' users of economic data. Key existing users of geospatial information include the local authorities, the military and the utilities. Much of the remainder of this market is highly fragmented and price sensitive. This user profile is important when grouping key government information providers.
There are four primary reasons for Executive Agencies to collect information on behalf of government. These are:
Cost recovery levels are lowest for the CSO and highest for the information providers required for regulatory purposes. The key conclusions we note on the practices of government information providers are that:
Key issues identified by both government information providers and users in our interviews include:
The market for geospatial data is generally regarded as immature and there is considered to be significant scope for future growth. Technological trends are changing the underlying business economics of information provision which will have major implications for future provision of data.
1. Treasury, The Fees and Charges Guide.
2. Held Tradeable Information, Guidelines for Government Departments in Dealing with the Private Sector, Department of Trade and Industry.