The Department of Science and Technology’s directive that no agency other than the IMD can make public the annual long-range monsoon forecast could set a dangerous precedent.
EARLY THIS month, the Department of Science and Technology (DST) took an unacceptable step. It stated that only the India Meteorological Department (IMD), an agency under the DST, had the mandate to make public the annual long-range monsoon forecast and no other agency or institution could do so, even in the research mode. Accordingly, it issued a directive to the Bangalore-based Centre for Mathematical Modelling and Computer Simulation (CMMACS), an institution under the Council for Industrial and Scientific Research (CSIR), not to make public the forecasts that its scientists have been coming out with every year.
The problem lay in the fact that, since CMMACS began its research exercise a few years ago, these forecasts have been at variance with the official operational forecasts issued by the IMD. In DST’s perception, such divergent forecasts by different agencies caused "confusion" in the public mind (read market).
It must be emphasised that, unlike the IMD forecasts, the CMMACS results are only posted on the institution’s website, and not publicised through press conferences and the like. The media, however, have been picking up these forecasts from the website and putting out stories. The directive from the DST implies that CMMACS, or any other Indian institution for that matter, cannot post such research results even on the website. As long as CMMACS or the parent body CSIR does not go to town with the forecasts, there can be no valid objection to dissemination of results of research electronically or otherwise.
Indeed, in physical sciences, it has been a long-standing tradition of disseminating research findings much before they are published in the form of `preprints’. The preprint tradition is very healthy. Circulation of preprints serves to validate research findings by a scrutiny within the scientific community, a sort of informal peer review.
The DST has argued that since the forecasts are not published in any peer-reviewed journal, they should not be publicised. This goes against the spirit of the preprint and e-preprint tradition. The implication of the DST move, therefore, is that any research that may serve public interest should not be disseminated in advance of publication. If today the directive is against monsoon research findings, tomorrow it could be against, say, earthquake predictions. Therefore, irrespective of the merits of the CMMACS model, which uses neural networks as against the statistical approach of IMD, and the predictions based on it, the DST move sets a dangerous precedent.
More pertinently, forecasts put out by the IMD are also not peer-reviewed. The IMD’s journal Mausam, in which its forecasts are sometimes published, can hardly qualify to be called a peer-reviewed journal. Further, while the DST may exercise its authority over Indian researchers and institutions, it cannot stop research institutions abroad from making monsoon forecasts, which, in this electronic age, become instantly available on the web. Such forecasts, more often than not, are at variance with the IMD’s and the media have been carrying stories based on these as well.
Moreover since 1988, when the IMD forecast was made operational, the predictions have had a high failure rate (of nearly 65 per cent). Therefore, the IMD can hardly lay any claim to the primacy or supremacy of its forecasts based on the multi-parameter `power regression’ statistical model that it has devised. Indeed, there has been widespread criticism of the IMD’s statistical model from the standpoint of its scientific soundness; and this notwithstanding the modifications made recently in the wake of the gross failure of its forecast during the 2002 drought year. Indeed, at a recent conference on monsoon forecasts, J. Shukla, a well-known U.S.-based atmospheric scientist, asked why the IMD does not take the help of statisticians from the Indian Statistical Institute (ISI), who are held in high esteem worldwide. A moot question really.
June 29 marks the birth anniversary of the great Indian statistician, planner and visionary, Prasanta Chandra Mahalanobis, who founded the ISI at the Presidency College, Calcutta, in 1931. And it is likely to be declared by the Government as the National Statistics Day. Mahalanobis’ approach to the subject of statistics is summed up in this remark: "Statistics must have a clearly defined purpose, one aspect of which is scientific advance and the other, human welfare and national development." His 50 years of work in statistics up to the late 1960s grew from this perspective of statistics as a tool for real life applications, particularly vital national problems.
One of the early areas of research that Mahalanobis undertook was meteorology. In the early 1920s, his statistical studies in anthropological measurements of people in Bengal attracted the attention of Sir Gilbert Walker, the then Director-General of the IMD. Sir Gilbert asked Mahalanobis to look at certain meteorological problems involving upper air variables. One such problem that Mahalanobis solved completely in 1923 was that at a height of about 4 km is the real seat of origin of meteorological changes. This was rediscovered much later by German scientist Franz Bauer from physical considerations.
If he were alive, Mahalanobis would have been appalled by the present DST move. In the context of the need for cross-validation of data, he once said: "Anything which is supplied or published by a Government office is accepted as reliable. To have any doubt would be a challenge to established authority. The very idea of having cross-checks is frightening as conflicting results arising from independent checks would be `confusing’ and must be resisted ... A meeting of statisticians, not so long ago, recommended that statistics of one type of information must be collected by only one single government agency so that `confusing’ discrepancies could never arise. In this situation, the statistical servicing is bound to be weak in spite of a great deal of knowledge in theoretical statistics."
Today’s statisticians at ISI, despite their extensive knowledge of theoretical statistics, seem to be least interested in such mundane problems as weather forecasting. With a problem so crucial to the country’s economy and IMD’s operational statistical forecasts being the basis of agricultural estimates, economic projections and the market behaviour, it is strange that the ISI has not considered it important enough to look at the problem and correct the basic flaws in the IMD model. In fact, as it became evident during a conversation with this correspondent, the Director of ISI, Kalyan B. Sinha, was not even aware of the fact that IMD predictions are based on a statistical model. He thought that the forecasts were based on dynamical models, which depend on actual numerical solutions of complex non-linear equations of atmospheric dynamics using high-performance computers.
Glaring disconnect
Indeed, this disconnect is more glaring in the case of technical inputs needed by the national statistical system which comprises, in the main, the Central Statistical Organisation (CSO), the National Sample Survey Organisation (NSSO) and, the main user of the data generated by these, the Planning Commission. Considering that Mahalanobis established the national sample survey and was also the architect of the country’s five-year plans based on quantitative economic models, and in his vision of things, ISI was an integral component of this system of applying statistical techniques to address national issues, this disconnect is an irony.
"These institutions have moved away from issues of direct interest to the government to issues driven by research per se," points out Pronab Sen, Adviser (Perspective Planning) in the Planning Commission. "And meeting of minds has become more difficult than we thought," he adds. "We have moved away from routine problems but we are seeking more challenging problems," says Dr. Sinha, however.
"Even in the so-called routine survey data, there are many challenging problems, provided you are willing to look at [the] data and work with it. But most of them are just high on algebra," says B. S. Minhas, former professor of ISI and former chairman of the NSSO Council. He believes the separation of national sample survey from the ISI in 1972 (shortly before Mahalanobis’ death) is the cause for declining interest in applications at the ISI.
"Statistics at present is going through a very rapid phase of growth in diverse areas that involve quite intricate theoretical concepts and techniques and these are becoming more and more popular because they get you immediate papers and recognition in the academic world," says Suresh Tendulkar, the present chairman of NSSO Council and professor emeritus at the Delhi School of Economics.
More than the mere declaring of National Statistics Day to mark the great professor’s birth date, a great deal needs to be done to bring back to centre-stage Mahalanobis’ vision of "statistics as a key technology" to solve national problems.
RSS 2.0