As result of the CSSP China partnership, a great deal of data rescue work has been undertaken by the CMA and BCC, who are recovering observations from the mainland of China. The datasets produced as a result of this project will help improve regional data density and add value when integrated into global baseline data productions after quality control and homogenization (e.g., Yang et al., 2016; Xu et al., 2017). Digitization of daily air pressure, temperature and precipitation has been completed so far for 19 stations in China [Beijing, Shanghai, Qingdao, Guangzhou (Shantou), Harbin, Wuhan, Shenyang, Dalian, Tianjin, Jinan, Nanjing, Fuzhou, Chongqing, Kunming, Taiyuan, Hohhot (Jining), Lanzhou, Wulumuqi, Nanning]. Hourly surface air pressure data have also been digitized for Beijing (1841-1953), Shanghai (1877-1953), Qingdao (1902-53), Guangzhou (1915-53), Harbin (1900-53), and Wuhan (1880-1953). For Northeast China, pre-1950s daily temperature and precipitation records have been digitized for 68 stations, along with a daily climate dataset for Shenyang Station (1905-2014) developed by combining the digitized records with the post-1951 data. For Shanxi Province, yearly data from 105 county stations and monthly data from eight climate observatories (1921-27) were recovered. More work is ongoing, including the digitization of observations made by Father Joseph Marie Amiot, a French Jesuit missionary stationed in Beijing between 1757-62. Hourly surface air pressure data recovered from Beijing, Shanghai, Qingdao, Guangzhou, Harbin, and Wuhan have been sent to the International Surface Pressure Databank (ISPD).
ACRE China also collaborates with other regional partners——relationships that work in parallel with, and complimentary to, the efforts under CSSP China. The Hong Kong Observatory (HKO), for example, has recently become a collaborator, sharing information on its wealth of historic observations and past/extant recovery projects. In Hong Kong, before the establishment of the HKO in 1883, regular meteorological observations were conducted at the Seamen's Hospital, Government Civil Hospital, Government Lock Hospital, Victoria Peak and the Harbour Master's Office. Historical records of these meteorological measurements (such as pressure, temperature, rainfall and weather remarks) have been recovered back to the 1850s.
In 1883, Dr. W. DOBERCK, the first director of the HKO (called the Government Astronomer at the time), set out instructions for making meteorological observations in various treaty ports, customs stations and lighthouses in China (Doberck, 1883). Thus, starting in 1884, HKO regularly conducted meteorological observations (such as dry and wet bulb temperatures, rainfall, pressure, wind speed/direction, cloud amount, duration of bright sunshine, state of weather, etc.) at its headquarters in Tsimshatsui, apart from a break during 1940 to 1946 owing to World War II (Lee, 2016). It is one of the World Meteorological Organization's recognized Centennial Observing Stations (WMO station code: 45005) with over a century of continuous observations of essential surface meteorological observations. Information on the meteorological observations were regularly included in the Observatory's annual data publications (e.g., "Meteorological results part I——surface observations" from 1884 to 1939 and from 1947 to 1986). As part of the HKO's wide range of climate services, it has made available more than 130 years of climate data together with a whole range of other climate information and statistics on its Climatological Information Services website (http://www.hko.gov.hk/cis/climat_e.htm), for easy access by the public and users in different sectors.
Since the 1970s, the HKO has digitized most of the available hourly observations at its headquarters from 1884 to 1970——apart from the hourly relative humidity (RH) data, of which records in "Meteorological results part I" were only available since 1961. With a view to reconstructing the hourly RH data at the HKO back to 1884, a project has recently been carried out to digitize all RH records from the HKO weather log books between 1947 and 1960 and the wet bulb temperatures in "Meteorological results part I" from 1884 to 1939. For the archiving of pre-WWII historical weather charts, the HKO has commenced a project to scan all available historical weather charts before 1939 into digital image formats.
Besides meteorological observations at the HKO, efforts have been made to recover the daily rainfall data at the Botanic Gardens between 1892 and 1926 from the annual report of the Botanical and Afforestation Department and the weather observations from the weather log books of Gap Rock Lighthouse (a small island about 43 km to the southwest of Hong Kong) from 1919 to 1938. With a view to narrowing the gap of missing data between 1940 and 1946, some of the daily and monthly temperature and rainfall records in Hong Kong were recovered from historical government reports and newspapers in 1940, 1941 and 1946. Wartime meteorological records observed and prepared by HKO officers and other volunteers in the internment camp at Stanley in 1942-45 have also been recovered (Ho, 2003; PRO). Furthermore, the HKO has been liaising with overseas researchers in searching and recovering meteorological records measured by the Japanese military stationed in Hong Kong during the war.
Scholars working under the umbrella of ACRE Japan (http://www.met-acre.net/chapters.htm) have been active in contributing to the historical data for China. A Japanese weather station was constructed in the Taiwan region in November 1896, and operations expanded to the mainland of China in 1904. By the early 1940s, the Japanese held more than 100 weather stations in the region (Yamamoto, 2014). Observational data were recorded in the Meteorological Monthly Bulletin of the Central Meteorological Observatory of Japan, Northern China and Northeast China, and the rainfall, surface pressure and temperature data were recently digitized (Kubota et al., 2016). Twice-daily observations published in the China Coast Meteorological Register (CCMR) from 1873 to 1932 have also been collected and digitized in the ACRE China DARE effort. This includes previously "missing" data from the CCMR for 1882, 1884, 1886, and 1888-91, all of which were located in the Japan Meteorological Agency library and digitized. Additional observations from the Shanghai Observatory were found by ACRE from 1906 to 1941, with the 1933 to 1941 portion digitized to extend the CCMR coverage, and records from the WWII years are being sorted by ACRE Japan. These digitized data were provided to the ISPD. ACRE Japan has also recovered Chinese data from other sources——most notably, 19th century temperature data from Beijing, 1840s-1880s (Zaiki et al., 2008), and observational data from Canton, Hong Kong and Shanghai, found in English newspapers from the 1830s to 1860s (Tsukahara, 2013). Daily rainfall data at several stations, for the period 1901 to 1939, and all the daily perimeters noted at Zi-Ka-Wei Observatory (Shanghai), 1945-8, were digitized. From this information, some preliminary research on the seasonal changes of the rainy season has been conducted (Hirano and Matsumoto, 2010; Matsumoto et al., 2010).
Within the CSSP China effort, sub-daily meteorological data for Indochina were digitized for the first 40 years of the 20th century. These data were taken from the Indian Daily Weather Report (IDWR; http://browse.ceda.ac.uk/browse/badc/corral/images/metobs/indian_ocean/India/IndianDailyWeatherReports). The number of stations per reading varies between approximately 180 and 220 (about 9 307 500 observations). Sub-daily station information includes pressure, wet and dry bulb temperature, minimum and maximum temperature, wind, humidity, cloud, rainfall and general weather conditions. The data were quality controlled and different checks for homogeneity applied, and offer the possibility for different statistical analyses and the study of extreme monsoon precipitation events. The data also provide the basis for studies of monsoon variability and trends, monsoon onset and retreat on high spatial and temporal time scales for the first part of the last century, understanding key mechanisms controlling the diversity of the Indian and southeastern monsoon relationship, and the role of ENSO and the boreal summer teleconnections on daily to intraseasonal timescales. The dataset is the basis for validations of reanalyses, data/model comparisons, and the study of early 20th century typhoon activity.
ACRE China contractors and ACRE Southeast Asia activities have digitized and made available the following to the ISPD in the 2016-17 period: China and surrounding countries (9133 observations); Papua New Guinea, Port Daru, 1894-95 (1314 observations) and Port Moresby, 1892-95 (11 340 observations); Sarawak, Kuching, December 1906 to May 1907 (1820 observations); Medan, Sumatra, Indonesia, 1910-25 (591 300 observations), ongoing.
Team member Clive WILKINSON has been working on documenting and recovering instrumental observations for the China seas and coasts from records extant in British archives. Most of these observations are held in ship logbooks from British commercial and naval vessels that journeyed to China or across the China seas in the 19th and early 20th centuries. Wilkinson has compiled an inventory for the vessels——so far encompassing more than 6500 merchant and 2000 naval logbooks and meteorological forms——and has begun the process of photographing some of these. From the UK National Archives, London, for instance, 40 logbooks of moored ("stationary") harbor vessels in Hong Kong (1843-1901), with eight additional logs of vessels in Chinese waters, have been rescued and digitized. These ships made observations whilst at sea and in port. At the National Meteorological Archive in Exeter, more than 380 meteorological logbooks from British Royal Navy vessels over the period 1853-1950 have been photographed, with a scattering of earlier logs. This in fact represents the entire collection of British Royal Navy logbooks in Chinese waters from this one archive up until 1950. This photography yielded a total of 32 600 pages of meteorological data, including temperature, pressure and winds. Many of the logbooks also enclose typhoon reports and, from the 1920s, there are frequently synoptic charts, upper air observations from pilot balloons, radio reports and typhoon warnings. The 32 600 images represent data from just 420 logbooks——a tiny fraction of the 8500 identified——with a further 3000 ships/voyages whose logbooks are yet to be sourced.
In Hong Kong, under the Voluntary Observing Ships' Scheme of the then International Meteorological Organization (the predecessor of the World Meteorological Organization), the HKO started to recruit a fleet of locally based voluntary weather observing ships in 1949. Archives of their observations are available since then. Prior to 1949, limited ship observations have been recovered by the HKO (details as follows):
(1) Extracts of ship observations for the years of 1892, 1894 and 1895 were included among the descriptions for tropical cyclones in the South China Sea and western North Pacific region in the Report of the Director of the Observatory for the respective years.
(2) Hand-written ship observations were also recovered from the reverse side of the pages of weather maps published by the HKO for the period 1 January 1934 -to 1 July 1937, and 1 January 1938 -to 1 July 1939.
(3) Some more ship observations for 1931 have also been recovered from the publication on "Weather Observations from Ships" (Jeffries, 1932).
In 1887, based on meteorological data received from the telegraph companies, the HKO published the CCMR booklet (also addressed by ACRE China, as noted previously) to report on the daily weather conditions of the South China Sea (Ho, 2003). By 1890, this booklet provided information on 16 cities or regions including Vladivostok, Tokyo, Nagasaki, Shanghai, Fuzhou, Xiamen, Kaiping, Shantou, Victoria Peak, Guangzhou, Macau, Haikou, Kaifeng, Borneo, Manila and Cape Saint James. Archives of the CCMR for the period 1894-1912 have also been recovered. The number of stations included in the Register have increased to 43 towards the end of 1912, including the reports for Hong Kong, Victoria Peak and Gap Rock. This was superseded by the Monthly Meteorological Bulletin from 1913 to 1932. From 1933 to 1940, these bulletins were published in the form of Daily Weather Reports. Scanning of the documents mentioned above have been conducted, but digitization of any observations not done by ACRE China (such as of the CCMR) has not yet been carried out. In the United States, Kevin WOOD and Mark MOLLAN identified more than 200 CSSP China-relevant naval vessel logbook series in the holdings of the U.S. National Archives (NARA), representing many thousands of pages of weather data and operational remarks. These logbooks span the period from 1830 to 1946. All these ships were stationed in China and elsewhere in the western Pacific for years——some for their entire commission. Of these, the logbooks of 15 ships have been photographed to archival standards (full color; resolution ≥300 dpi) and posted on the National Archives Catalogue website (https://www.archives.gov/research). This set includes 471 volumes totaling 235 000 pages. The logbooks of an additional nine ships that spent a significant period of time in the region were imaged incidentally as part of an earlier project. This set includes 454 volumes totaling 145 000 pages, and spans 1844-1946. Of these, 1 300 000 hourly weather records have been extracted by the citizen-scientists under Old Weather (https://www.oldweather.org) and are in the process of integration into the International Comprehensive Ocean Atmosphere Data Set (ICOADS) and the ISPD. A further 80 volumes (63 000 pages) of the IDWR from the holdings of the NOAA Central Library were also photographed and provided to the UK Met Office in order to reconstruct a complete set of volumes of this resource in digital format; the weather data in them are slowly being digitized.
Using high-resolution digital photography to facilitate DARE from logbooks and other primary sources can have several important benefits. In the US case, the objectives of project partners align well with the output of the joint imaging program of NARA, satisfying equal but distinct objectives consistent with free and open global access to data and other digital products, in addition to weather DARE. This opens the door for all kinds of research otherwise hindered by the need to find and access unique documents that exist only in one place, including options to use citizen-science or other distributed approaches for the second essential step in DARE: manual transcription. However, the effort required to carry out a comprehensive digital imaging campaign is not insignificant considering the massive scale of the potential data resources. For example, NARA holds 98 979 Navy and Coast Guard logbooks, of which roughly 25 000 cover the particularly interesting period of 1801-1940. These contain many millions of unutilized weather records, and often these are the only existing source of instrumental data for an entire region. Hence, it is necessary to focus strategically on periods and regions where the impact of new observations is likely to be greatest, and the scope is consistent with imaging and transcription capacity, and the means to carry out required quality-control and database integration tasks.
ACRE China contractors have digitized and made available the following to ICOADS in the 2016/17 period: Hong Kong seven "stationary" and moving ships 1857-74 (53 916 observations); voyages and surveys HMS Providence 1796/97 (340 observations), L'Erigone 1840-44 (78 000 observations), Doudart de Lagrèe 1866-68 (4182 observations); Thetis and Esperance 1824-26 (10 008 observations); HMS Samarang 1843-47 (19 692 observations).