The U.S-China Security and Economic Review Commission (USCC) recently published a staff research paper entitled “Indigenous Weapons Development in China’s Military Modernization” that generated a great deal of media attention. One story noted that the report showed how the United States had “missed the emergence of significant military developments” and was “blinded by Beijing.” Another report concluded from the paper that “the United States has underestimated the growth of China's military.”
What did the paper actually say? It examined the development of four weapons systems: the Yuan-class (Type 041) diesel-powered submarine, the SC-19 anti-satellite missile, the DF-21D anti-ship ballistic missile, and the J-20 aircraft. Reviewing U.S. analysis of these development of these systems, the paper concluded that “there are no universal trends in publicly reported U.S. government analysis on the development of indigenous Chinese weapon systems.” According to the paper, only the emergence of the Yuan-class submarine was unexpected. As for the other systems, the paper’s main contention is that analysts miscalculated the speed or rate of the development of these systems, but not their emergence.
The actual claims of the USCC paper are much more modest and mixed than media coverage would indicate. Most importantly, as the USCC notes but doesn’t emphasize, the degree to which the appearance of the Yuan-class submarine in 2004 was a surprise remains contested. The USCC paper suggests that the U.S. missed this program because it wasn’t mentioned in the Pentagon’s 2003 annual report on Chinese military power. However, the 2002 version of this same Pentagon report clearly stated that “A new advanced version of the SONG-class conventional submarine is expected to incorporate advanced air-independent propulsion.” The Pentagon may not have provided the name of the class as we now know it, but it didn’t miss the development of a new submarine with the characteristics of the Yuan boats (which shares some design similarities with the Song). Thus, the strongest example supporting the USCC paper’s criticism of analysis of the Chinese military in the United States is wanting.
As for assessments of the pace of weapons development, many U.S. government analysts and military officers have stated that development of the DF-21D was faster than expected. Nevertheless, the system isn’t yet operational. Adm. Willard stated in December 2010 that the development of the DF-21D had reached something equivalent to what the U.S. military defines as “initial operational capability.” The following month, however, another senior naval official noted that although the progress that had been achieved, the PLA wasn’t yet capable of “effectively employing the system” because it had not yet conducted a test over open water or been integrated into the force.
Other claims about such miscalculations are accurate, but perhaps not as consequential as the USCC paper and subsequent media coverage indicate. To start, the USCC paper acknowledges that the U.S. government accurately assessed the development of China’s anti-satellite missile. Instead, the paper’s claim is that analysts outside of government missed the mark. Still, the U.S. government didn’t overlook the emergence of this system or its development.
As for the J-20, the paper notes that progress has been slightly faster than originally estimated. In 2009, Defense Secretary Robert Gates remarked that China wouldn’t have a fifth-generation fighter until 2020. The following year, the U.S. revised its estimate for operational deployment to 2018. The first prototype was launched a year earlier than the U.S. government expected in 2011, not 2012. Nevertheless, the U.S. government has been tracking the development of the aircraft since 1997. Over the course of two decades of development, such miscalculations are not as great or dangerous as it might seem.
To be sure, China’s unwillingness to share information about its weapons programs is a major factor affecting assessments of their development. Such unwillingness is par for the course in any competitive relationship.
Yet, other reasons for the miscalculations cited by the paper are probably exaggerated. The paper claims that analysts have underestimated “the extent of changes in the Chinese defense industry in the 1990s and early 2000s.” But back in 2005, analysts at RAND published a report using open sources that noted the progress that China had achieved in reforming its defense-industrial base precisely during this period. Similarly, noted PLA expert Tai Ming Cheung documented these reforms in a 2009 book, Fortifying China. (Read this summary of Cheung’s findings.) Neither publication, however, was cited by the USCC paper.
In addition, the paper claims that China’s threat perceptions have been systematically underestimated. In particular, the paper notes that analysts “may have failed to fully appreciate the extent to which the Chinese leadership views the United States as a fundamental threat to China’s security.” Yet the 2005 RAND report made exactly this point, noting in a subheading that “the PLA Leadership Perceives United States as Greatest Threat.” Drawing on open sources, Larry Wortzel (a USCC commissioner) came to a similar conclusion in a 2007 study: “China’s leaders and military thinkers see the United States as a major potential threat to the PLA and China’s interests.”
Finally, the severity of analytical failures can only be determined by understanding the degree of success. Apart from the anti-satellite missile, the paper doesn’t examine any indigenously systems whose development was accurately assessed. On this score, the U.S. government appears to have some important successes, especially regarding strategic weapons.
Take, for example, the DF-31 series of intercontinental ballistic missiles. The Pentagon noted in 2000 that “China…is designing a new generation of solid-fuel, road-mobile ICBMs,” and in 2002 that “deployment of the DF-31 should begin before mid-decade.” The Pentagon reported in 2006 that the missile had reached “initial threat availability” and in 2008 that it had been deployed to operational units.
Similarly, the Pentagon appears to have predicted quite accurately the development of China’s short and medium-range ballistic missiles. In a 1997 report on China’s military capabilities, the Pentagon estimated that China would have “the industrial capacity” to “as many as a thousand” such missiles. In its 2008 report to Congress, the Pentagon stated that the PLA had deployed “between 990 and 1,070” short-range ballistic missiles. In short, they nailed it.
The USCC staff research paper usefully draws attention to the challenges that analysts face when seeking track weapons development in China, a country that doesn’t seek to share such information. Further exploitation of Chinese-language open sources will certainly help improve future analysis. Nevertheless, the conclusions drawn in the media can’t be sustained by the paper, which itself deserves close scrutiny.
M. Taylor Fravel is an Associate Professor of Political Science and member of the Security Studies Program at the Massachusetts Institute of Technology. He can be followed @fravel.