RESEARCH QUESTION: How is race portrayed in news coverage regarding violence in the National Post?

KEY REMINDERS: You will choose articles that discuss violence from Aug.2014- Jan.2015 and please read through ALL instructions thoroughly, it tells you exactly what is expected.

SOC101Y – Quantitative Newspaper Content Analysis
Each student will be designing, conducting and writing up the results of a research project. The objectives are both to apply some of the sociological knowledge learned during the course, and to gain an appreciation for what is involved in the practice of sociology through the pursuit of an actual research project. The particular type of research project students will pursue is a quantitative newspaper content analysis. This document lays out the parameters for this year long project due at the end of March. It goes over the what, how and why of content analysis as a methodology. The content of this document offers a framework and instructions for the work students need to produce. While reading this whole document once at the beginning of the year is a very good idea, it is not expected you will understand all of its content right away. The skills and knowledge necessary will also be developed through weekly tutorials taking place between September and March, and digitally on Portal through your own TA’s Corner. Five small assignments will also be completed that represent various key aspects of the research design process. This document should be used as a reference to be consulted often, as well as the additional insights and advice from your TA and from Jenna.
This quantitative content analysis will not require students to deploy complicated statistical analysis, but it will involve conducting an analysis whose coding outcomes will be numerical values that can be represented in frequency tables or crosstabulation. Quantitative analysis, more generally, attempts to quantify data by numerically measuring the incidences of various themes of ideas in a chosen sample. While you have a broad latitude for the topic you will pursue, your content analysis ought to be a class analysis, race or ethnicity analysis, or gender analysis. It will be based on the analysis of a single or several days of publication of the Globe and Mail, National Post, and Toronto Star. Your ultimate research report you will submit for assessment at the end of March will include sections on your topic/literature review, on your designed research question and its rationale, on your operationalization/coding scheme, on data collection/sampling, on your findings, on your analysis of these findings and offering a tentative answer, on the strengths and weaknesses of your research project. Completing this project you will learn about the key role played by each of these aspects of the research design process, and how together can possibly lead to sociological
knowledge.
Your quantitative newspaper content analysis write-up in the form of a research report (ie NOT an essay) is due on March 30th. Three copies of the assignment must be submitted, through 1) Portal, 2) Turnitin.com AND 3) as a hard copy to Room 225, 725 Spadina Ave, no later than Monday, March 30th at 4pm.
The research report HAS to be between 7 and 8 double-spaced pages (not including title page, bibliography, and appendices), 12pt font (Arial or Times New Roman), with one inch margin all around. Note: turning in a longer report is not an option. Part of the difficulty associated with the research report writing process is summarizing your research in a concise way by making decisions about how to best use the space you have.
The outcome of your work needs to be written following the structure of a research report which should include the following sections, in order, and sticking to the page requirements:
1-Introduction (about 1?2 page)?2-Topic/Lit Review (about 1 page)?3-Research Question/Rationale (about 1?2 page)?4-Operationalization/Unit of Observation/Coding Scheme (about 2 pages) 5-Sampling/Data Gathering (about 1?2 page)?6-Findings/Frequency /Crosstabs (about 1 page)?7-Discussion/Data Analysis/Answer (about 1 page) 8-Reflection/Strengths/Challenges (about 1?2 page)?9-Conclusion (about 1?2 page)
Introduction (about 1?2 page)?In the introduction, you state what your research question is and offer an outline of the content of your research report. Introduction is there to frame your work. It’s there to help set expectations for your reader about what they are about to read.
Topic/Lit Review (about 1 page)?This section is to set the context of your eventual contribution. Discuss what is the broad sociological topic you are interested in, and then the more specific aspect you are proposing to investigate. You should pull from the “literature” which here means the course material. (note: you are allowed to draw from outside of course material, to clarify and add depth, but this is NOT required).
Research Question/Rationale (about 1?2 page)?This section is where you re-state the clear and specific research question you propose to investigate along with offering a rationale for the appropriateness of pursuing this particular question. Research questions are the foundations of research project, so here justify your choice. Research question, and the rationale, and variables you use. Explain to your readers why it is a good research question, how is it measurable.

Operationalization/Unit of Observation/Coding Scheme (about 2 pages)?This section is at the center of your research design efforts. Discuss what is your unit of observation. Then clearly lay out how you will measure your key variables looking at these units of observation. Do so by creating a detailed coding scheme that makes it clear how each category is constructed.
Data Gathering/Sampling (about 1?2 page)
Describe your data gathering process, including sampling. How many pieces did you gather, how did you choose them, describe the timeline over which this took place.
Findings/Frequency Tables/Crosstabs (about 1 page) Present your frequency table(s) or crosstab and describe it .
Discussion/Data Analysis/Answer (about 1 page)?Discuss the patterns and variations you are observing in your frequency table(s) or crosstab. Make sense of them to see what answer(s) they point to in regards to your research question. Note that since you will not be running the statistical calculations necessary to ascertain whether the patterns/variations you found are statistically significant, your discussion of your findings remain tentative, and not definitive. This is very important to remember.
Reflection/Strengths/Challenges (about 1?2 page)?This section is an opportunity for you to reflect on what you believe are the strengths of the research project you completed and what might be its biggest challenges.
Conclusion (about 1?2 page)?An opportunity to offer some concluding thoughts about how the research project revisiting the tentative answer to your research question. What contribution would your research project make to the “literature” once its findings have been verified?
This quantitative newspaper content analysis counts for 20% of your final grade. Beyond the “SOC101Y – Content Analysis” document you are reading right now, the principal sources of assistance are tutorials and the TA Corners on Blackboard. Please feel free to post any and all questions.
What is Content Analysis
Content analysis is the the study of recorded human communication. This includes detailed, systematic analysis of “text” to identify patterns or themes. As newspaper readers for example, we are perfectly justified in applying our individual worldviews to texts and enacting our interest in what those texts mean to us; in fact we cannot do otherwise. But as content analysis researchers, we must do our best to explicate what we are doing and describe how we derive our judgments, so that others—especially our critics—can replicate our results.
Content analysis is one of several important research techniques in the social sciences. The content analyst views data as representations not of physical events but of texts, images, and expressions that are created to be seen, read, interpreted, and acted on for their meanings, and must therefore be analyzed with such uses in mind. Analyzing texts in the contexts of their uses distinguishes content analysis from other methods of inquiry. Content analysis is essentially a coding operation. Coding is the process of transforming raw data into a standardized form. Making a judgment about an object according to a set of agreed upon dimensions (some are socially pre-determined (e.g. age) others you must create (e.g. engagement in learning). What we code for depends on our research questions, meaning what we are interested in.
Content analysis is a research technique for making replicable and valid inferences from texts to the contexts of their use. Examples of inferences:
• •
• • • • • • • •
One might date a document from the vocabulary used within it?One might infer the religious affiliations of political leaders from the metaphors used in their speeches?One might infer the readability of an essay from a measure of the complexity of its composition?One might infer the problems of a city from the concerns expressed in letters written to the city’s mayor office?One might infer the prevailing conceptualizations of writers and readers from the proximities of words in frequently used texts?One might infer editorial biases from a comparison of the editorial pages of different newspapers?One might infer the identity of the author of an unsigned document from the document’s statistical similarities to texts whose authors are known?One might infer the political affiliations of citizens from the TV shows they choose to watch?One might infer an individual’s propensity to engage in hate crime from the ethnic categories he uses in ordinary speech?One might infer the likelihood of war from the coverage of international affairs in the elite newspapers of neighboring countries
As a?from?provides new insights, increases a researcher’s understanding of particular phenomena, or informs practical actions. Content analysis is a scientific tool. Scientific research must also yield valid results, in the sense that the research effort is open for careful scrutiny and the resulting claims can be upheld in the face of independently available evidence.
technique, content analysis involves specialized procedures. It is learnable and divorceable just the personal authority of the researcher. As a research technique, content analysis
“Text” has a broad definition here that includes all sorts of social artefacts/human communications:
• Newspapers, magazines, books, journals
• Government or NGO documents/websites
• Sermons, speeches, debates
• Social media sites
• Television, radio/podcasts
• Police reports, laws, legal decisions
• Commercials, advertisements
• Paintings, logos, graffiti, murals
• Many others ?Here are six features of texts that are relevant to definition of content analysis
• €Texts have no objective—that is, no reader-independent—qualities
• €Texts do not have single meanings that could be “found”, “identified”, and “described” ?for what they are
• €The meanings invoked by texts need to be shared
• €Meanings (contents) speak to something other than the given texts, even where convention suggests that messages “contain” them or texts “have” them
• €Texts have meanings relative to particular contexts, discourses, or purposes. (Once an analyst has chosen a context for a particular body of text and clearly understands that context, certain kinds of questions become answerable and others make no sense. The same body of texts can therefore yield different findings when examined by different analysts and with reference to different groups of readers. For a content analysis to be replicable, the analysts must explicate the context that guides their inferences. Without such explicitness, anything would go)
• €The nature of text demands that content analysts draw specific inferences from a body of texts to their chosen context—from print to what that printed matter means to particular users, from how analysts regard a body of texts to how selected audiences are affected by those texts, from available data to unobserved phenomena (Content analysis infer answers to particular research questions from their texts. Their inferences are merely more systematic, explicitly informed, and ideally verifiable than what ordinary readers do with texts. Whether the analysts’ world makes sense to their scientific peers depends on how compellingly the analysts present that world) ?The crucial distinction between text and what other research methods take as their starting point is that a text means something to someone, it is produced by someone to have meanings for someone else, and these meanings therefore must not be ignored and must not violate why the text exists in the first place. Text—the reading of text, the use of text within a social context, and the analysis of text—serves as a convenient metaphor in content analysis. Most content analyses start with data that are not intended to be analyzed to answer specific questions. They are texts in the sense that they are meant to be read, interpreted, and understood by people other than the analysts. Readers may decompose what they read into meaningful units, recognize compelling structures, rearticulate their understandings sequentially or holistically, and act on them sensibly. ?So why do we analyze social artefacts? ?To gain insight into what is deemed significant and made salient in human communications, understanding that these communications both reflect and help to shape various aspects of the social world. How individuals and groups imbue meaning in social artefacts which gives us an insight into how society is organized through a meticulous study and analysis of social artefacts. With new conceptualizations and an empirical orientation, contemporary content analysts join other researchers in seeking valid knowledge or practical support for actions and critique. However, unlike researchers who employ other empirical techniques, content analysis examine data, printed matter, images, or sounds—texts—in order to understand what they mean to people, what they enable or prevent, and what the information conveyed by them does. Content analysis is particularly well suited to answering the classic question of communications research: “Who says what, to whom, why, and how”. It cannot answer all questions, questions that may require field research, interviews, or experiments. ?A form of unobtrusive research, or methods of studying social behavior without affecting it. It makes sense of what is mediated between people—textual matter, symbols, messages, information, mass-media content, and technology-supported social interactions—without perturbing or affecting those who handle textual matter. As Heisenberg’s uncertainly principle
tells us, acts of measurement interfere with the phenomena being assessed and create contaminated observations; the deeper the observer probes, the greater the severity of the contamination. For the social sciences, Webb, Campbell, Schwartz, and Sechrest (1966) have enumerated several ways in which subjects react to being involved in scientific inquiries and how these can introduce errors into the data that are analyzed:
• • • • •
•
Through the subjects’ awareness of being observed or tested?Through the artificiality of the task or the subjects’ lack of experiences with the task Through the expectations that subjects bring to the role of interviewee or respondent Through the influence of the measurement process on the subjects?Through stereotypes held by subjects and the subjects’ preferences for casting certain responses?Through experimenter/interviewer interaction effects on the subjects.
One of?is that it avoids those challenges research techniques involving human beings entails.
the strengths of unobtrusive research, such as the content analysis students will perform,
RESEARCH QUESTION/RATIONALE
Your research question is the foundation of your research project. A research question is a question which you do NOT already have the answer to, a question that is answerable through meticulous research. At its most basic, that is what a research question is. There are two reasons for content analysts to start with research questions, ideally in advance of undertaking any inquiries: efficiency and empirical grounding. Content analysts who start with a research question read texts for a purpose, not for what an author may lead them to think or what they say in the abstract. The pursuit of answers to research questions also grounds content analysis empirically. All answers to research questions entail truth claims that could be supported, if not by direct observation then at least by plausible argumentation from related observations. Formulating research questions so that the answers could be validated in principle protects content analysts from getting lost in mere abstractions or self-serving categorizations. Texts acquire significance (meanings, contents, symbolic qualities, and interpretations) in the contexts of their use. Although data enter a content analysis from outside, they become texts to the analyst within the context that the analyst has chosen to read them—that is, from within the analysis.
A research question is a clear, focused, concise, complex question around which you center your research. You should ask a question about an issue that you are genuinely curious about?Your research question should be focused. Research questions must be specific enough to be well covered in the space available. Your research question should be complex. Research questions should not be answerable with a simple “yes” or “no” or by easily-found facts. They should, instead, require both research and analysis on the part of the writer. A good research question is one that is appropriate to the space (one 7-8 page research report, not a book), time (written for a single course, not for a 4 year PhD), method (content analysis, not interview, fieldwork or experiments) and object of study (newspapers) of your research project. It also has to be a sociological research question, meaning investigating a sociological matter as defined by a research question that displays the sociological imagination. Your research question needs to

fulfill two more conditions, it must posit the variables you are intending on studying, and your research question cannot attempt to establish a causal relationship. No causality. But before we discuss causality, lets go over variables.
Variables?The idea of a system composed of variables may seem rather strange, so let’s look at an?analogy. The subject of a physician’s attention is the patient. If the patient is ill, the physician’s purpose is to help the patient get well. By contrast, a medical researcher’s subject matter is different: the variables that cause a disease, for example. The medical researcher may study the physician’s patient, but for the researcher that patient is relevant only as a carrier of the disease. That is not to say that medical researchers don’t care about real people. They certainly do. Their ultimate purpose in studying diseases is to protect people from them. But in their research, they are less interested in individual patients than they are in the patterns governing the appearance of disease—in essence, the patients are relevant only for what they reveal about the disease under study. In fact, when they can study a disease meaningfully without involving actual patients, they do so.
Social research, then, involves the study of variables and their relationships. Social theories are written in a language of variables, and people get involved only as the “carriers” of those variables. Variables, in turn, have what social researchers call attributes or values Attributes are characteristics or qualities that describe an object—in this case, a person. Examples are female, Asian, alienated, conservative, dishonest, intelligent, and farmer. Anything you might say to describe yourself or someone else involves an attribute. Variables, on the other hand, are logical groupings of attributes. Thus, for example, male and female are attributes, and sex or gender are the variables composed of these two attributes. The variable occupation is composed of attributes such as farmer, professor, and truck driver. Social class is a variable composed of a set of attributes such as upper class, middle class, and lower class. Sometimes it helps to think of attributes as the “categories” that make up a variable. For this research project, students should not seek to investigate more than two separate variables.
Example of difference between variables and attributes:?Social common social concepts: Female, young, gender, upper class, occupation, Asian, age, plumber, race/ethnicity, social class
Variables
Gender?Age Race/ethnicity Social class Occupation
Attributes
Woman, man?Young, middle-aged, old?Caucasian, Aboriginal, Asian, Latino(a) Lower class, middle class, upper class Plumber, carpenter, sociologist, lawyer
The relationship between attributes and variables lies at the heart of both description and explanation in science. For example, we might describe a university class in terms of the variable gender by reporting the observed frequencies of the attributes male and female: “The class is?60 percent men and 40 percent women.” An unemployment rate can be thought of as a description of the variable employment status of a labour force in terms of the attributes
employed and unemployed. Even the report of family income for a city is a summary of attributes composing that variable: $10,980; $35,000; $85,470; and so forth.
When studying more than one variable, you can study the relationship between them. If the researcher can establish an association between two or more variables, whereas the presence, absence or changes in one variable is linked to the presence, absence or changes in another variable, you can establish a correlation. Correlation, however, does not imply causation. Causation requires direction, it requires isolating that variable X caused the changes in variable Y. While students can certainly seek to investigate a correlation between two variables, they should NOT seek to establish a cause and effect relationship. Causality is something very difficult to establish solely through content analysis, and not suitable for this first year research project. So your research question CANNOT attempt to study the impact of one variable on another. It can, however, attempt to establish a relationship between two variables.
Advice: The best kinds of questions are clear, specific and with enough complexity or detail adequate for the assignment. Clear questions use proper grammar. They have been formulated carefully to reflect a great deal of thinking and analysis work. Specific questions go beyond the topic itself (eg. gender) and focus on the way the topic is being operationalized in the analysis of your specific (eg. gender role or stereotypes among a certain group(s) of people). When a question is too broad it says little about what you will do in your analysis. Often student research questions need to be reworded. In many instances wording is highly confusing due to using cryptic language, poor syntax, and over complicated language, it leaves one confused as to what you are asking. A well-worded research question is the best foundation to a good project. Questions appropriate for content analysis are direct and concise. They were not over complicated. These types of questions demonstrate that you understand the nature of the assignment and what exactly a content analysis can accomplish.
Advice: Your research question should not be causal. This means that you implying that X causes Y.
This could be questions such as “What type of family structure leads to more youth deviance?”, “What leads to rural people to being more
conservative than urban people?” or “What caused the Nicaraguan revolution?” These are all questions that are not appropriate to this research project, because they cannot be answered scientifically using the research steps you will undertake.
Advice: Remember that a content analysis is used to explore the content of various media (books, magazines, TV, film, newspaper etc.,) in order to discover how particular issues are depicted (or not depicted). At its most basic, content analysis is an exercise that involves categorizing aspects of the content in order to help us get a picture of patterns, if they exist. It is a good idea to compose your research question in such a way as to focus on representations/depictions in the media (ie your newspapers).
Advice: Lastly, when composing your research question keep thinking about how you will go about measuring/answering this question. If you cannot answer this research question by doing a quantitative content analysis of newspaper, you need to pick a different research question. It will also be useful to think about what parts of the newspaper you intend on analyzing, ie what will

A causal question is one which explores the effect of one thing on another and more

specifically, the effect of one variable on another.
be your unit of observation, since that will also inform which research question is most appropriate. Lets turn to this matter now.
OPERATIONALIZATION/UNIT OF OBSERVATION/CODING SCHEME
Units of observations are here which aspects of newspapers you will be analyzing. Keep in mind newspapers are composed of various types of content including headlines, stories, advertisements, listings, content promotion, comics, graphics, etc. The differences between these categories can be sometimes confusing. You ought to use only one type to be the focus of your content analysis. Conducting content analysis across several units of observation is not a good idea at this stage. It adds a lot of complexity to the research project not appropriate for a first year project.
To help identify what are stories, they are likely meet the following criteria:?1. Longer than two inches in length. On a standard-sized column it can be measured with a ruler. 2. Must be written in complete sentences with a central theme.?3. Must not be part of a paid advertisement.?4. Must be a complete story, not a promotional reference for a full story contained elsewhere. Stories are often confused with listings, which are clearly editorial in content. The reason for differentiating listings from stories is that listings often cover many different topics in one section, can have many authors etc, and most importantly, serve a very different purpose in the newspaper.
Stories Do Not Include
• Content promotion references that lead to stories elsewhere?• Sports tables?• Stand-alone photographs or graphics?• Death, birth, engagement, wedding or anniversary notices that are submitted TV and movie listings
• Stock price listings?• Weather maps?• Crosswords or comics?• Horoscopes?• Community listings or advertisement content, which must be paid for
Each of these can be analyzed separately from stories, but for this research project you should stay away from listings and content promotion as units of observation.
What does listings mean??The expression listings has been used a few times. Listings are different than stories, they are not a paid advertisement, presented as a collection of numbers and other information and is not in complete sentences, such as:?• Listings are usually in smaller type, “small tables or graphs,” and often are seen in long columns.?• Frequently-seen listings include sports scores, stock prices, entertainment listings, church directories and similar information.
• Listings can include graphics and photographs such as the weather map.?• Statistics and numbers included in the text of a story are not listings. Listings must be a stand- alone feature.?• Be careful of paid-advertisements that might appear to be listings. Examples include: classified ads, personals, paid death notices and other obviously advertisement areas.
You also should not conduct your content analysis about “content promotion”. Content promotion is very broadly defined as anything that:?• Highlights a content item contained elsewhere in the newspaper.?• Highlights a content item that will be published in a future edition or on the website. • Promotes the newspaper overall using the brand name of the paper.
• Promotes any service or feature of the newspaper including circulation sales, classified ad sales etc.
Content promotion includes (but is not limited to):?• The main flag (i.e. the title) of the newspaper.?• Refers, skyboxes, rails and many other front-page bits about inside content. • All indices, front page or otherwise.?• House advertisements of any sort.?• All contact information having to do with the newspaper itself.?• All advertisements for any of the newspaper’s subsidiary publications.
Once you have chosen your unit of observations, you will now need to turn your attention to operationalization, the single most important step of the research design process. Operationalization is the key step that links your research question and your analysis. Operationalization is how will you measure/observe/notice/identify the elements (i.e. variables) in your research question? You need to assign values to your variables. What will count as evidence? What will you be looking for? Be as precise as possible. Indicate whether you will be looking at manifest content or latent content (it is highly recommended to use manifest content for this assignment since you are required to choose a quantitative content analysis).
Manifest vs Latent?Manifest content refers to concrete things that you can point to in the text – for example how many times a certain word appears, or how many different people are quoted. Latent content doesn’t have those same concrete cues and is usually the more subtle result of many different things. Writing style is a good example of latent content. It might be difficult to point to a specific word or sentence that makes a story “positive” or “negative” coverage but it is contained in the story nevertheless. In general, manifest content is much easier to measure than latent content. Latent content analysis is more complex and requires more caution.
Operationalization is the link between your research question and your data collection. It is how you will answer your question. Your operationalization of those variables is what you will actually be looking for, it is the designing of your coding scheme, of creating the categories through which you will classify your data. A researcher will want to ensure consistency so that she is coding for exactly what she wants to code for. Developing a set of rules helps the
researcher insure that she is coding things consistently throughout the process, is the same way every time. This also ensures that the researcher is not engaging in selective observations, noticing only information that fits in the researcher’s pre-conceived ideas of what they expected to find. A researcher must be open to find inconsistent information that does not “fit” their expectations or theories. Good operationalization will help the researcher distinguish between relevant and irrelevant information. Information that ought to be ignored because it does not speak to the research question one way or the other.
Even more difficult than deciding what you want to measure is creating categories (also called operationalization).?Whole books have been devoted to the subject but here are a few guidelines for this research project:
1. Categories should be mutually exclusive. Make sure that they don’t overlap.?2. Make sure there are meaningful differences between categories. Fine distinctions between categories cause confusion and make results unreliable. A good example would be asking people to categorize stories as: not local, somewhat local, primarily local or completely local. You can bet that coders will get confused between “somewhat” and “primarily” and would sit and wonder what a “completely” local story would be.?3. Make sure