Ed schools Educational Research

Educational Researchers: Living with a Lesser Form of Knowledge

This post is a paper I published in Educational Researcher in 1998.  Here’s a link to a PDF of the original.

This is an overview of the story I’m telling:

In this article, I argue that key characteristics of educational knowl­edge both constrain and enable the work of educational researchers, as producers of this knowledge, in distinctive ways. Educational knowledge is soft (vs. hard), applied (vs. pure), and provides use value (vs. exchange value). As a result, knowledge production in education is organized in a manner that is structurally egalitarian and substantively divergent. Some consequences of this are negative:  For example, educational researchers find themselves unable to speak authoritatively about  their field and feel pressure to imi­tate unproductive forms of intellectual practice. Other consequences are positive: For example, they have the potential for speak­ing to a wide lay  audience and for participating in a relatively open and unregulated mode of scholarly production.

My favorite line from the article:  “If Sisyphus were a scholar, his field would be education.”

I think the analysis still holds up.  See what you think.

Educational Researchers:

Living with a Lesser Form of Knowledge

David F. Labaree

Education schools make easy targets. This is especially true in the United States, where education-school bashing has been a favorite sport for a wide range of participants over a long period of time.[1] There are a number of characteristics of this institution that make it vulnerable to attack. Its origins are seen to be lowly (the nineteenth century normal school), as is the social standing of its primary clientele (disproportionately drawn from the ranks of women and the working class), and it prepares students for one of the lesser professions. Its curriculum and academic standards are generally considered weak and its faculty and students less able than their counterparts elsewhere in the university.

All of these elements make the education school easy to pick on and difficult to defend. My aim in this paper, however, is not to explore these familiar components of the education-school saga but to analyze the role of one particular element that has received less scrutiny than the others. The focus here will be on the kind of knowledge that education schools produce and the impact of this kind of knowledge, for better and worse, on the character of their institutional effort and the public perception of this effort. In speaking of the knowledge they produce, I mean the body of scholarly work that is generated by researchers within educational schools — as distinct from the knowledge about teaching practice that experienced teachers have and that education schools may or may not transmit to prospective teachers. The issue under study, in short, is research knowledge rather than practitioner knowledge.

My argument is this: The nature of education as a field of study leads to a form of  research production that both constrains and enables educational researchers in distinctive ways. On the one hand, the result is (for example) that these researchers find themselves unable to speak authoritatively about their field and feel pressure to imitate unproductive forms of intellectual practice. At the same time, they enjoy a number of advantages over researchers in contrasting fields, including a potential for speaking to a wider lay audience and for participating in a more egalitarian structure of scholarly production.

In what follows I first examine the nature of the knowledge produced by educational researchers and compare it with other forms of knowledge generated within the university. Then I consider the implications of these forms of knowledge production for the ways in which educational and other researchers organize themselves to carry out their work. Next I review a series of ways in which the nature of research-based educational knowledge and its organizational form produce consequences that are negative for education schools. Finally, I review some of the ways in which these same characteristics produce consequences that are positive for education schools.

The Kinds of Knowledge Produced by Education Schools

Tony Becher has written a richly suggestive book about the nature of the knowledge produced by the different academic disciplines and departments within the British and American university. In this work — with the wonderfully evocative title, Academic Tribes and Territories (Becher, 1989) — he considers the impact of these knowledge differences on both the nature of the intellectual work carried on by academic practitioners and the form of organization employed to sustain this work. He starts with a familiar pair of distinctions — between hard and soft knowledge and between pure and applied knowledge — and builds his analysis from there. Although he mentions education schools and other professional schools only in passing, his argument provides lovely insights into many of the most familiar and significant characteristics of educational research.

Hard vs. Soft Knowledge

Disciplines seen as producing hard knowledge are those that are most successful in establishing the rhetorical claim that their research findings are verifiable, definitive, and cumulative. The natural sciences are the leading examples in this arena. Practitioners in the natural sciences have developed scientific methodologies, procedures, and verification rules that allow them to produce findings that can be reproduced by others, defended against challenges, and thereby gradually validated to the point where the claims come to be accepted as definitive – seen as an accurate depiction of “what we know” about a particular component of the natural world. Once this kind of finding is established as functionally definitive, at least temporarily, within a scientific discourse community, then others can build upon it, pushing the pursuit of knowledge in that field to the next level.

Disciplines that produce soft knowledge, by contrast, find themselves working an intellectual terrain that is considerably less clearly defined. The humanities and most of the social sciences are the leading examples of this kind of intellectual endeavor. Research practitioners in these areas pursue forms of inquiry in which it is much more difficult to establish findings that are reproducible and whose validity can be successfully defended against challenges by others. Supporting causal claims is particular difficult in these fields, so the producers of soft knowledge necessarily focus the bulk of their attention on the problems of description and interpretation: how to portray and make sense of the texts or events under study, in the absence of clear decision rules and validating methodologies. And practitioners in these fields never have the luxury of being able to build upon a solid foundation of previous findings, because these findings are always subject to challenge by researchers who adopt a different interpretive approach. As a result, producers of soft knowledge find themselves constantly rebuilding the foundations of their disciplines, as they continually reinterpret the most fundamental issues in their fields.

I am not arguing that hard knowledge is foundational and soft knowledge is not, only that hard knowledge producers are in a stronger position rhetorically to make the claim that their work is definitive and therefore cumulative. After all, interpretation and intent are irreducible components of all inquiry. The claims of hard science are limited by community norms and purposes, and they are subject to revision and rejection by future researchers whose community norms and purposes are different (Kuhn, 1970). As a result, the validity claims of the hard disciplines are still only claims — difficult to contest but still contestable, durable in the short term but vulnerable over time. The advantage of hard over soft knowledge may be short-lived and largely rhetorical, but that doesn’t make it any less substantial for practical purposes in the contest for contemporary credibility.

Two characteristics in particular make it difficult for researchers in soft knowledge fields to establish durable and cumulative causal claims. One is that it, unlike workers in hard knowledge fields, they must generally deal with some aspect of human behavior. This means that cause only becomes effect through the medium of willful human action, which introduces a large and unruly error term into any predictive equation. These billiard balls are likely to change direction between the cue ball and the corner pocket. The other is that research projects in behavioral fields have embedded within them the values and the purposes not only of the researchers (like hard fields) but also of the actors under study. The result is a messy interaction of the researcher and the research subject.

From this perspective, education emerges as the softest of the soft fields of inquiry. Problems of teaching and learning, curriculum and governance, educational organization and educational reform — all of these resist efforts by researchers to establish causal claims about them that are verifiable, definitive, and cumulative in anything like the way that researchers in hard-knowledge disciplines can accomplish these things. For one thing, of course, education is the social product of actors — teachers, students, administrators, parents, and policymakers — whose actions both shape this institution and are shaped by it. In addition, educational processes are fundamentally political, reflecting social purposes — such as democratic equality, social efficiency, and individual opportunity — that embed contradictory pressures within education and provide conflicting criteria for evaluating educational success (Labaree, 1997a; 1997b). As a result, educational researchers are able at best to make tentative and highly contingent claims that are difficult to sustain in the face of alternative claims by other researchers.

In spite of these difficulties, educational researchers have not been willing to abandon the effort to make their soft knowledge harder. Like knowledge producers in other fields that are grounded in human behavior, they have sought to establish ways of conceptualizing educational processes (such as behaviorism) and methodologies for analyzing these processes (such as statistics) that promise to enhance the claims they can make for the validity and reliability of the resulting educational knowledge. Within limits, this effort has been quite successful. An empirical science of education emerged at the start of the twentieth century and grew into a position of dominance in the field within a few decades, and it is still a strong presence in spite of the recent rise to prominence of an explicitly interpretive approach to educational research (Shulman, 1986). The science of education, however, has encountered severe limitations for its claim to produce hard knowledge. It has been much more successful at describing the ways that education works and identifying loose relationships between educational variables than at explaining educational outcomes in light of educational causes. These limitations have kept have confined educational number crunching to the soft side of the knowledge spectrum, since the hardness of the hard sciences is expressed most distinctively in the ability to predict the effects arising from particular causes. But the only causal claims educational research can make are constricted by a mass of qualifying clauses, which show that these claims are only valid within the artificial restrictions of a particular experimental setting or the complex peculiarities of a particular natural context. Why?  Because the impact of curriculum on teaching or of  teaching on learning is radically indirect, since it relies on the cooperation of teachers and students whose individual goals, urges, and capacities play a large and indeterminate role in shaping the outcome. And at the same time, education as an area of inquiry is more a public policy field than an intellectual discipline, whose central orientation is irreducibly normative – to improve education – and whose research practitioners are less united by a common technical orientation than they are divided by the different educational goals they espouse (Toulmin, 1972; Donmoyer, 1985).

As a result, despite their best efforts there is little that researchers can do to construct towers of knowledge on the foundations of the work of others. Within a particular research group (defined by shared values and interpretive approaches), it is possible at best to construct Quonset huts of knowledge through a short-term effort of intellectual accumulation; but these huts are seen as structurally unsound by researchers who do not share the values and interpretive approaches of those within that group’s intellectual compound.

Pure vs. Applied Knowledge

Disciplines that produce pure knowledge are primarily oriented around the construction of theory. Practitioners in these fields work a terrain that is abstracted from particular contexts, focusing on establishing claims of a more universal and generalizable sort than one could make if trapped within a local setting. There is an echo here of Robert Merton’s distinction between cosmopolitans and locals, which is grounded in the scope of the cultural group to which people see themselves belonging (Merton, 1968). In this sense, pure knowledge researchers are the cosmopolitans of intellectual inquiry, seeking to gain distance from the local scene in order to establish a sense of the larger pattern that is hidden in the clutter of detail within the close-up view. Much of the work in the natural sciences fits in this domain, but the latter also encompasses the most theoretical work that goes on in a wide range of disciplines, from philosophy to sociology and from literary criticism to mathematics.

Disciplines that produce applied knowledge, in contrast, focus primarily on the practical issues that arise from specific contexts. The aim here is not to establish general patterns but to solve particular problems. Success is measured in relatively modest ways, according to whether or not a particular approach works in a particular setting better than alternatives that are available at the time in question. Professional schools in general have an applied orientation to knowledge, and so do a wide array of disciplines — e.g., geology, psychology, and English — when they focus their attention on problem solving more than theory building.

From this perspective, educational knowledge production is overwhelmingly applied in character. For one thing, as noted above, education is not a discipline in the sense that cultural anthropology and physics are — defined by a distinctive theoretical perspective for viewing the world (culture and motion) and by a distinctive research methodology (field work and time-lapse observation). Instead, it is a public policy field focusing on a particular institutional sector. As a result, educational researchers are under pressure to focus their intellectual energies on the most vexing problems that arise within their institutional purview, rather than enjoying the intellectual freedom of pure knowledge researchers who can follow the chain of thought embedded within their own intellectual constructs. And for educational researchers, confinement to the educational arena is combined with necessity of following a normative mandate in exploring this arena. It is not enough to study what is interesting about education; the researcher is under pressure to improve it. Fields like education are sites of public policy, which means they are shaped by public goals for this sector of society and are responsible in part for the powerful consequences of this institution – for good or ill – in the lives of children and the health of society (Toulmin, 1972; Donmoyer, 1985). Students are not learning what they need to know, race and gender skew educational outcomes, teachers are not being adequately prepared, school resources are not equally distributed — these are the kinds of context-based and time-sensitive problems of practice that dictate the direction taken by researchers in the relentlessly applied field of education.

Exchange Value vs. Use Value

In addition to the hard-soft and pure-applied distinctions, there is another difference, not mentioned by Becher, which divides university researchers from each other based on the way in which knowledge production within the various fields affects the value of the education that a particular department or program provides for its students. On the one hand, a university education can provide students with exchange value, by giving them a credential that can then be exchanged for something that is intrinsically valuable to the students, such as a good job and a nice standard of living. From this perspective, the content of the curriculum they pursue and the actual learning that they accomplish at the university is less important than the reputation of the university (or the program within it) and the perception of its worth among employers and others in the community. On the other hand, a university education can provide students with use value, by giving them a set of skills and an accumulation of knowledge that will prove useful to them in carrying out their varied roles in later life. From this perspective, the content of the knowledge acquired is the most important element of the educational process, quite independent of the university’s (or program’s) reputation. Consider how this plays out in a high school setting, where the upper curriculum tracks provide abstract academic knowledge that can be exchanged for college admission and eventually a well-paid job (low use value, high exchange value), whereas the lower tracks provide vocational knowledge that can be exchanged for a lower-level job (high use value, low exchange value).[2]

A distinctive characteristic of the knowledge produced by educational researchers and the education offered by education schools is that they have low exchange value and high use value. Education is marked by a variety of stigmas that undermine its ability to provide credentials with high exchange value — for example, an association with women, the lower classes, public employment, and a “semi-profession,” along with its weak academic standards and modest institutional origins. In addition, the broadly confirmed general perception of both the research and the instructional programs of education schools is that they are weak, which further undercuts their exchange value. In part this is because of the hierarchy within academic knowledge pursuits, which dictates that hard knowledge production outranks soft and pure knowledge production outranks applied. Education is located firmly at the bottom of both of these rank orders.

Of course, the high use-value of the knowledge in a field is not necessarily a threat to the prestige of that field. Medicine is an applied field whose knowledge provides high use-value for its graduates, while at the same time occupying an extraordinarily high status within the university. Likewise, a number of hard-pure fields with high social standing, such as mathematics or biochemistry, gain in status when their efforts lead to useful social applications, such as computers and genetic testing. The key seems to be that high exchange value and hard knowledge together immunize a field from the potentially demeaning perception of being “merely useful.” Medical schools are inextricably linked with the highest paid and most prestigious profession in the American occupational status order, and the demonstrable effectiveness of the hard knowledge they produce reinforces this elevated status. As a result, the exchange value they offer is unassailable. But education schools are bonded to one of the more lowly paid and more ordinary professions (closer to nurses than doctors in the professional hierarchy), and the visible weakness of their soft knowledge base to produce predictable and desirable educational outcomes only reinforces this subordinate position. Cursed with weak exchange value, education schools are doubly cursed by having to justify themselves only on the basis of the use value of the knowledge they produce, even though that knowledge is not very useful.[3] As we will see below, the strong association between education and soft use-value has consequences that are both negative and positive for the field.

Organizational Consequences

Becher (1989) argues that the kind of knowledge that provides the central intellectual focus for a discipline or an area within a discipline brings with it its own distinctive form of organization. Hard-pure knowledge production calls for a social organization of intellectual practice that he calls urban and convergent. The nature of hard knowledge is that, for practical purposes in a particular intellectual context, it can be treated as cumulative. This means that at a given stage in the development of a discipline, everyone is focused on solving the same intellectual problems. The intellectual structure has been raised to a particular level, and all of the thought-workers are clustered at that level. The result is that the work takes on a distinctly urban feel. At the same time, this intellectual convergence makes for a social structure that is quite hierarchical. It takes novices a long time to learn the full body of knowledge in the field from the bottom all the way up to the point where the definitive knowledge ends and the real work of intellectual inquiry begins. This means that senior people occupy a highly authoritative position, since only they can direct the work at the very edge of understanding. It also means that the field needs to develop its own shorthand way of communicating within itself, one that necessarily assumes the reader or listener is informed about all the issues that are already resolved. As a result, writers and speakers in such a field can focus on the interesting material at the top of the structure of knowledge without having to bring the nonexpert up to speed.

By contrast, soft-applied knowledge production calls for a social organization of intellectual practice that Becher calls rural and divergent. Researchers cannot build towers on the foundations laid by others because these foundations are always being reconstructed. As a result, research work is spread thinly over a wide area, as individuals and groups continually work at rethinking the most basic issues in the field and as they each pursue their own interpretive approaches. The resulting terrain is laid out in a series of rural dwellings and hamlets rather than in the kind of urban high-rises erected by researchers in a field like physics. Novices in this setting find themselves inducted quickly, since the field is wide open and no issues are considered closed off from reconsideration. Senior people have less control over the work of intellectual production, because their own work is so easily subject to challenge. And the field is less turned in on itself, since its boundaries are permeable, its body of knowledge nonesoteric, and its discourse diffused among a variety of divergent research communities.

The organization of knowledge production within education schools fits the pattern of other soft-applied fields by being thoroughly rural and divergent. Intellectual work within this field is spread all over the terrain. Researchers feel free to charge off in all different directions without a great deal of concern about what stage the development of the field has attained at the moment or what directions senior scholars want to set for the field. They constantly re-examine old questions and reconstruct existing theories. What clusters develop — for example, around teacher preparation in one place and subject matter standards in another — are the result of practical needs generated from within the institution of education or from society’s concerns about the state of this institution rather than from the internal logic of the research effort itself. And these needs and concerns are so numerous at any given time and so likely to change with changing conditions that they provide only temporary and limited incentives to concentrate resources in the classic urban manner that characterizes the hard-pure realm.

Gary Rhoades (1990) provides an insightful and influential analysis of the organizational peculiarities of American colleges of education, which makes particular sense in light of the preceding discussion about the kind of knowledge that is produced in these institutions. One assertion he makes about these institutions is the following:

Colleges of education are marked by greater technological ambiguity and more resource dependency on well-organized, vocal constituencies in an environment in flux than are colleges of letters and science. As a result, colleges of education have more diversified organizational structures across colleges and are more unstable both within and across colleges than is the case with letters and sciences colleges. (Rhoades, 1990, p. 197)

Another assertion is this:

Colleges of education faculty are more likely than letters and science faculty to expect and accede to managerial control and are also more divided and thus less likely than letters and science faculty to assert faculty influence, forming coalitions to defend and advance the collective interests of the college faculty. Thus, education deans have potentially more impact than letters and science deans. (Rhoades, 1990, p. 203)

This argument by Rhoades follows naturally from the argument that I have been developing about the role of knowledge in shaping the organization of knowledge production in education. As a soft-applied field, education is characterized by high “technological ambiguity” (a diffused intellectual focus) and high “resource dependency” on “an environment in flux” (that is, a need to respond to practical issues arising from school and society rather than from the theoretical logic of the research effort itself). This means that faculty members in colleges of education do not have natural intellectual communities to draw on for political strength, at least not in the way that psychologists or astronomers, for example, can draw on their national and international disciplinary communities for support. The intellectual labor of education-school faculty members is in service to diffuse demands from the environment rather than to their own colleagues within the field of educational research. The result is that they do not fall into intellectually distinctive social groupings within or across colleges (education schools do not have a standard departmental structure), and therefore they have few social resources for asserting faculty power or for countering the managerial authority of the dean.           

Negative Consequences for Education Schools

This analysis of the nature and social organization of knowledge production in education schools has significant implications for the way in which these institutions function and the way they are seen. Consider first some of the negative consequences for education schools and then some of the positive consequences.

Low Status within the University

There is no doubt that education schools are located at the bottom of the academic hierarchy within the American university. An important source of this low status is the nature of the knowledge produced by faculty members in education. One characteristic of educational knowledge that hurts it in the status race is its relentlessly soft and applied character. The pinnacles of the academic status order are reserved for the hardest and purest of intellectual pursuits. It is not difficult to see why this would be so. Hard-knowledge disciplines are able to maintain general respect because their claims to validity are so difficult to refute, while the softer disciplines suffer from having to qualify, temporize, and particularize their claims. Whereas the former seem to be standing on a firm empirical platform and speaking with a clear loud voice, the latter wallow around in a swamp of uncertainty and speak in a whisper. There is little doubt which of these will win greater attention and higher esteem. Likewise pure-knowledge fields, by addressing questions of broad theoretical scope, gain a decided status advantage over applied fields, whose scope of address is sharply restricted by time and place.

In addition, educational knowledge suffers from its low exchange value. After all, exchange value is the coin of the realm in the market-based environment of the American university. These universities are unique in their extreme sensitivity to market considerations in comparison to their counterparts elsewhere in the world (Trow, 1988). Dependent heavily on tuition and forced to compete for customers in a buyer’s market for higher-education services, American universities have to give education consumers what they are looking for — credentials that can be exchanged for good jobs and attractive social positions (Brown, 1995). In this kind of environment, exchange value counts more than use value. And the root of exchange value is the employers’ and public’s general perception of the reputation of an institution and of the programs within that institution. This leaves education holding, as usual, the short end of the stick. What education offers is soft use-value — usable knowledge of marginal validity — which is not a commodity that can compete effectively with the credentials from the more prestigious realms of the university, which offer hard and pure exchange value.

Weak Authority within Education and Educational Policymaking

It follows from the preceding analysis that the nature of the knowledge produced within education schools also makes it so that the authority of these institutions to speak is relatively weak, even within their own world of schools and educational policy. As Cohen, Garet, and Lindblom have pointed out, the impact of social science research on social policy is indirect at best (Cohen & Garet, 1975; Lindblom & Cohen, 1979), because of the difficulty it has in representing complex social policy consequences. The more widely researchers throw their net around a complex array of variables, the less valid and reliable their conclusions become; but the more narrowly and rigorously they construct their studies methodologically, the more likely it is that they are leaving out important variables and the more incomprehensible their findings are going to be to policymakers. Educational researchers suffer from this syndrome at least as much as other social scientists. These problems are particular acute for the empiricists within the field who are trying to create hard knowledge through educational research. The findings of educational studies that have the greatest claim to validity and reliability – e.g., those that zero in on the effects of a particular experimental treatment by tightly controlling for other variables – are also likely to be the most trivial, since real education takes places in extraordinarily complex settings where variables are inextricably intermingled.

Educational researchers have an additional burden, however, which derives from their low academic status, their weak platform, and their whispery voice. The knowledge base of educational researchers leaves them in a position of marginal credibility with the educators and educational policymakers for whom their research findings should be of the greatest utility. As low-status purveyors of educational knowledge that is soft, highly contingent, and largely ungeneralizable, they are not able to speak in tones that are likely to command respect and to shape educational policy. In short, they can easily be ignored. And with the credibility of the institutional experts on education called into question like this, it leaves the field of educational reform and educational policy wide open to the influence of a wide range of others whose voices are granted at least equal standing.

Pressure to Transform Education into a Hard Science

One natural consequence of all this is that educational researchers would seek to transform the nature of their knowledge production from soft to hard and applied to pure. This has been the mission of the American Educational Research Association over the past 40 years. All one has to do is examine the burgeoning production of scientific research on education that has arisen this organization — as evidenced by the explosion in papers presented at its annual meetings and by the compilations of scientific research about teaching and teacher education that have emerged from its membership.[4]

This movement to make educational research harder and purer came to a head with the issuance of the first Holmes Group report in 1986 (Tomorrow’s Teachers). In this report, the deans of the leading research-oriented education schools in the U.S. proclaimed that the research efforts in their institutions over the preceding decades had produce a true science of teaching — with rock-solid validity and sweeping theoretical scope — which could now serve as the knowledge base for the professionalization of teaching. In a recent article in Educational Researcher, Former AERA president N. L. Gage restated this faith:

In the last 20 years…meta-analysis has yielded knowledge concerning the impressive magnitude, consistency, and validity across contexts of many generalizations in the behavioral sciences and promising methods for quantifying and analyzing the generalizability of research results. These arguments, findings, and methods justify…continuing the effort to build sciences of behavior. (Gage, 1996, p. 5)

There is a value in the effort to make educational knowledge more quantifiable and generalizable, since it pushes researchers not to settle for the softest and most equivocal of findings. It is not very helpful if researchers answer every important question in the field by saying, “It all depends.” Thus striving to establish and support harder claims is a valuable goal, but there is only so far that we can realistically move in that direction, and that is well short of the condition Gage calls a science of educational behavior. In order to create a solid ground for making hard claims about education, you can try to drain the swamp of human action and political purpose that makes this institution what it is, but the result is a science of something other than education as it is experienced by teachers and students. As I have argued elsewhere, such an effort may have more positive impact on the status of researchers (for whom hard science is the holy grail) than the quality of learning in schools, and it may lead us to reshape education in the image of our own hyper-rationalized and disembodied constructs rather than our visions of the good school (Labaree, 1997b, chapter 6).[5]

Another sign of the effort to move education into something like a hard science is the construction in recent years of large federally-funded centers for educational research. These centers mimic the urban-style organization of knowledge production in the hard knowledge fields, which is particularly striking in a field as traditionally rural in research practice as education has been. But these centers arise more from the government’s desire to increase the efficiency of its research funding and oversight (and the university’s desire for large infusions of soft money) than from any discovery that educational knowledge has suddenly begun to accumulate into a rising epistemological structure. If anything, the centers are an effort to compensate for the lack of an accumulation of educational knowledge across studies — by organizing large loosely-integrated research projects as a proxy for this kind of accumulation. The production coming out of a research center gives the impression of systematic construction, but on close analysis this structure quickly disaggregates into an eclectic array of disparate studies operating under the center’s umbrella. In this way, an educational research center is no more urban than the shanty-town on the outskirts of a third-world city. Each is a collection of villages rather than a true urban community.

Pressure to Transform Education Schools into Pure Research Institutions

The distinctive nature of educational knowledge has produced another related form of negative impact on education schools by putting pressure on them to change their focus from teacher preparation to a more prestigious mission. Trying to mimic those disciplinary departments on the university campus with the highest academic standing, education schools — especially in the most elite universities — have frequently sought to change themselves into graduate schools of educational studies (Judge, 1982).

Geraldine Clifford and James Guthrie (1988) tell the story of this quixotic quest in withering detail in their book, Ed School. The idea has been to back away from too close an identification with teaching and with the production of useful knowledge for schools and to focus instead on developing a body of research that is purer than the education school norm, focusing on general theoretical exploration rather than responding to particular educational problems of practice. In addition, this new research direction would yield a higher exchange value, because of its affinities with the decontextualized and theory-driven (rather than environment-driven) explorations of the more prestigious fields in the academy. As Clifford and Guthrie point out, however, these efforts have not been successful. For one thing, the rest of the university has not accorded the desired higher academic standing to the faculty of these graduate schools of educational studies. For another, these efforts have served to wrench researchers away from real educational knowledge production without changing the soft, applied, political, behavioral, and environment-driven character of the field itself.

A Sense that the Field is Never Getting Anywhere

One last problem that the form of educational knowledge poses for those who seek to produce it is that it often leaves them feeling as though they are perpetually struggling to move ahead but getting nowhere. If Sisyphus were a scholar, his field would be education. At the end of long and distinguished careers, senior educational researchers are likely to find that they are still working on the same questions that confronted them at the beginning. And the new generation of researchers they have trained will be taking up these questions as well, reconstructing the very foundations of the field over which their mentors labored during their entire careers.

This poses a problem not only for the researcher’s sense of professional accomplishment and self esteem. It also leaves the entire field open to ridicule and kibitzing from those who stand outside. If these people can’t get to first base in their own field of expertise, then they must not be very good. So maybe they ought to step aside and let a talented outsider stand in and swing for the fences. Could these outsiders do worse than the so-called professionals? Since educational researchers are unable to be definitive and to demonstrate that they are making progress, they leave the field wide open to amateur educationists who feel little reason to be reticent about making their own contribution to educational discourse.

Positive Consequences for Education Schools

Having laid out a variety of negative consequences for education schools that arise from the peculiar characteristics of educational knowledge, I now turn to some of the positive outcomes that arise from the same source.

Producing Useful Knowledge Is Not a Bad Thing

The close identification of education with use value and its alienation from exchange value has the potential to work to its long-term advantage socially and politically. After all, the university’s practice of selling credentials that are based on appearance and reputation more than substance and real learning is one that is quite vulnerable to public challenge. This practice has all the characteristics of a confidence game, since it rests on an interlocking set of beliefs that are quite shaky. The chain goes something like this: it makes sense for consumers to invest in the credentials of a respected university because the prestigious research carried out there produces capable graduates who then deserve preferential access to jobs. Yet each part of this chain of reasoning depends more on faith than fact, and the whole system can collapse if challenged to prove itself. After all, the value of the credentials has more to do with the prestige of the institution than with the knowledge that students acquire there. In addition, the rising fiscal pressures at all levels of American government puts higher education increasingly in the position of justifying the enormous public investment in terms of verifiable outcomes rather than tradition or belief. This problem is exacerbated by a related issue: the gross social inefficiency of providing a public subsidy for an education system that is grounded more in individual social mobility (helping me get the job I want) than in substantial public benefit (providing us with the capacities we need) (Labaree, 1997b).

In this setting, the strong connection between education and usable knowledge can be a valuable asset. For the most part, educational research arises in response to clear current problems within a preeminently important institutional arena. This timeliness, responsiveness, and potential usefulness makes it much easier to justify — in the emerging era of outcomes measurement and cost-effective public investment — than much of the university’s more prestigious but less relevant research efforts. Of course, there are several limitations to this pursuit of applied knowledge. One, discussed earlier, is that the findings of educational research are so soft that this applied knowledge is of limited usefulness. Unlike fields that are comfortably buffered by high exchange value, educational research is eager to help improve the practice of education, but its toolkit does not contain the kind of powerful cures that can be found in the medical doctor’s black bag. Another is the relentlessly — even proudly — atheoretical quality of much of this research. Theoretical significance (like empirical validation) is something that educational research should aspire to, in spite of the enormous difficulties that this work poses for such efforts. In the absence of theoretical aspiration, educational research often seems rather pinched and pedestrian. But this failing arises more from intellectual laziness than from the characteristics of educational knowledge. The kind of practical knowledge that educational researchers produce can be theoretically provocative even if it is somewhat restricted in theoretical scope, and in this context its potential social usefulness can be both politically advantageous and vocationally gratifying for the producers in ways that are not available to researchers in less applied fields.

Freedom from Consumer Pressures

A related benefit for education that derives from the kind of knowledge it produces is that it is relatively free from the consumer pressures that have shaped the rest of the university. In general, the American university has been compelled to bend to the demand from consumers for programs and credentials that will serve individual ambition in the pursuit of social position. But the close identification of education schools with the vocational preparation of teachers and with the production of research to meet practical educational needs means that these schools are constructed around the accomplishment of social rather than individual ends. Their primary concern is social efficiency rather than individual mobility. This certainly puts constraints on both research and programs, since both must be responsive to the most urgent and current societal concerns. As a result, educational researchers do not enjoy the luxury of pursuing pure inquiry in whatever direction theory might lead them – or pursuing idiosyncratic inquiry in whatever direction personal preference might propel them. But at the same time they are liberated from involvement in a market-dominated instructional process that requires them to provide fickle educational consumers with whatever courses and programs the latter demand. And they have the satisfaction of knowing that they are working on issues that matter, both for the individual actors within education (like teachers and students) and for the larger society.

Freedom from Disciplinary Boundaries

Another advantage that accrues to educational researchers from the nature of the knowledge they produce is that they are free to deal with educational questions from whatever disciplinary perspective or methodological approach they find appropriate. This, as in the previous example, involves several tradeoffs. One is that they give up freedom of institutional focus — since educational researchers are compelled to focus on education — in return for considerable freedom in the way they choose to explore this subject. Researchers in the disciplines are often subject to a test of disciplinary correctness that can be quite confining. “Is this really political science?” they are asked (or history or philosophy or biology). If not, it doesn’t count in the internal status order as measured by merit pay, promotion in rank, and professional recognition. But educational researchers are free to be as eclectic as they wish in the way they choose to intermingle disciplinary perspectives or methodological orthodoxies. There is an attractive pragmatism within educational research, which prefers to reward approaches that work rather than those that are canonical within a particular theoretical subculture. The downside here is that, at the same time that educational researchers cut loose from unnecessary disciplinary constraints, they also frequently lose some of the methodological rigor that comes from working within a clearly defined disciplinary research tradition. The result is a tolerance for poor research design and sloppy thinking. However, there is nothing in the nature of educational knowledge to prevent researchers in education from creating their own standards of rigor and from policing their own ranks in light of these standards.

Freedom from Hierarchical Constraints

The thoroughly rural and divergent character of educational research makes for a social organization of research effort that is relatively egalitarian. Senior researchers are not in a strong position to control the research process because their authority rests on shaky foundations. The noncumulative character of educational knowledge makes entry into the field easy and leaves newcomers in a position to make contributions that are arguably as valuable as those by the old hands. The same characteristics of educational research that allow policymakers to ignore it and other academics to ridicule it — namely its structural underdevelopment and its vulnerability to challenge — make it a field that is remarkably open and endlessly fascinating in the variety of its voices. There is nothing like confusion to create opportunity. The rural landscape of educational research produces endless possibilities for intellectual homesteaders to stake a claim and start developing their own little piece of the terrain. Of course, large federally-funded centers for educational research represent an important counter-trend to this pattern, since they resemble urban enclaves in a largely rural field and inevitably establish a kind of status order within them. But what is different about these centers in education compared with large projects in hard knowledge fields is that they are best understood as collaborations among loosely-related independent research projects, pulled together for the effort to obtain funding but not integrated into a strong social or epistemological hierarchy.

Producing Soft Knowledge is Now the “In Thing”

In the past decade or two, there has been a strong and highly effective series of attacks on positivism and on the validity of quantitative research.[6] This process has been played out in a wide range of fields, beginning with the philosophy of science and moving eventually into education. All of this is thoroughly familiar to the members of the American Educational Research Association, who have seen the argument played out at great length in the pages of Educational Researcher over the past 15 years. As a result of this epistemological effort, the consensus has shifted toward a position that asserts the essential softness of hard knowledge and the essential uncertainty at the core of the validity claims made by the hard sciences. This means that soft-knowledge fields such as education can now breathe a sigh of relief, since softness is now a generalized condition and not an affliction only affecting educational researchers.

Unfortunately, the newly relaxed philosophical position toward the softness of educational knowledge — combined with its freedom from disciplinary constraints and its openness to newcomers — can (and frequently does) lead to rather cavalier attitudes by educational researchers toward methodological rigor in their work. As confirmation, all one has to do is read a cross section of dissertations in the field or of papers presented at educational conferences. For many educational researchers, apparently, the successful attack on the validity of the hard sciences in recent years has led to the position that softness is not a problem to be dealt with but a virtue to be celebrated.. Frequently the result is that qualitative methods are treated less as a cluster of alternative methodologies than as a license to say what one wants without regard to rules of evidence or forms of validation.

I bring up this point about the dangers of soft knowledge (paralleling earlier point about the dangers of applied knowledge and of non-discipline-based research) as a caution to educational researchers against embracing too warmly the necessity imposed on them by the kind of knowledge they produce. For in looking for the silver lining in the cloud of problems surrounding the production of educational knowledge, we should not ignore the significance of the cloud itself. The characteristics of educational knowledge present researchers with both advantages and disadvantages. These elements do not cancel each other out, but instead in combination they define a universe of working possibilities and enduring dilemmas within which educational researchers have to forge their way.

An Ability to Speak to a General Audience

From the perspective of someone in the harder and purer disciplines, educational researchers speak with a voice that is laughably amateurish. Their lack of professionalism is apparent in a discourse that does not have the esoteric language and verbal shorthand of a truly advanced field of study. A paper that is truly interesting in a field such as math or biochemistry — that is, at the leading edge of theoretical development — is one that should be completely incomprehensible to an apprentice in the field, much less a layperson. By comparison, the discourse within education is transparent in language and widely accessible in meaning. All the complaints about “educatorese” only serve to prove the point, since they tend to come from those completely outside the educational research community who are looking at its literature. They are not saying they cannot understand what the researchers are saying, only that they themselves could say it better. But none of these critics would think of trying to read the cutting-edge research in math or biochemistry or to complain about math- or biochemist-speak, because these fields are supposed to be esoteric and beyond the reach of the layperson. Education, however, is largely accessible to outsiders and therefore vulnerable to discursive critique from nonexperts.

This situation puts educational researchers in a position to become public intellectuals in a way that is not possible for scholars in fields whose knowledge development makes them incomprehensible to the ordinary citizen. It is easy for outsiders to look into education — to contribute, criticize, and kibitz. But at the same time, this makes it easy for educational insiders to reach out directly to members of the public and make a case to them about the problems facing education and the ways we can deal with these problems. In this sense, educational researchers may not have the kind of authority that comes with hard-pure science, but they have a ready rhetorical access to the public that is lacking in more authoritative fields. As a result, the lesser form of knowledge produced by educational researchers may in fact offer them a political and social opportunity that is largely closed to the more prestigious realms of the university.

[1] Examples include: Bestor (1953), Koerner (1963), Kramer (1991), Goodlad (1990), Clifford & Guthrie (1988), Holmes Group (1995), and Hirsch (1996).

[2] For more on the impact of this distinction between exchange value and use value, see Collins (1979) and Berg (1971). I have developed this argument a greater length in Labaree (1997a & 1997b).

[3] For a more detailed discussion of implications of  the low exchange value and high use value of education as a field of knowledge production, see Labaree (1997b, chapter 9).

[4]  For example, see AERA (1997), Gage (1963), Travers (1973), Wittrock (1986), Houston (1990), Sikula (1996).

[5]  Without acknowledging this, the Holmes Group began to back away from its early embrace of the natural science model for educational research in its second report (Holmes Group, 1990) and dropped it entirely in its third report (Holmes Group, 1995). See Labaree (1995) for a discussion of the sharp changes in argument and rhetoric that characterizes these three reports.

[6]  For example, see Howe (1985).

[For references, see the PDF of the original article.]

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

%d bloggers like this: