Empirical science is:
1) Logical--a rational activity based on logical reasoning
2) Deterministic--all phenomenon have antecedent causes that are subject to identification and logical understanding
3) General--scientists are concerned with being able to generalize their findings to other situations and populations
4) Parsimonious--it uses as few explanatory factors as possible, disregarding what appears to be irrelevant factors
5) Specific--it is always necessary to clearly specify both the research problem and the methods and procedures which are
used to measure the concepts under study
6) Empirically verifiable--the results must be open to evaluation and verification to others for additional study
7) Intersubjective--even though no two scientists are exactly alike with regards to subjective orientations, they still
would arrive at the same conclusion upon doing the same experiment
8) Open to modification--science must be ready to accept revision and change, since science is a process of trial and error--no
single research design will provide the "ultimate answer."
---------
The Eleven Stages of a Quantitative Research Project
1) Define a research topic
2) Intensify knowledge about the topic
3) Clarify concepts and their measurements
4) Select a data collection method
5) Consider the purpose, value, and ethics of the study
6) Operationalize concepts and design the data collection instruments
7) Select a sample
8) Collect the data
9) Process the data
10) Analyze the data
11) Write up the results.
-----------
Qualitative Reasearch. "What to look for when you read a field study:"
1- Why did the researcher choose the particular setting?
2- Does the researcher begin with a refined set of hypoteses or a set of vague orienting questions?
3- What are different meas of gaining access to a research site?
4- What is the researcher's degree of involvement or immersion in the setting?
5- What constitutes the data (the observations which the reseacher takes away from the field)?
6- How does the author begin to develop generalizations from the data?
7- How elaborate was the preplanning to determine how the study would be carried out?
8- Can you anticipate ethical problems in doing this kind of research?
-------
Evaluative research in the real-world has some troubles for you to watch out for.
It is usually the case that evaluators are employed too late to save the company, program, or campaign. This may mean you,
as the messenger, deliver a death blow of reality instead of the hoped for miracle cure. This may not greatly help your popularity
standings!
You may work for a governmental agency, like the State Legislative Auditor, and have great pay and benefits, but lack in
job security.
This may not be popular with your spouse! You may find that the people you are evaluating despise being evaluated. This
may mean little or no cooperation! But you may find the job fun and some-what "James Bondish" as you uncover "truth, justice,
and the American Way."
There are, of course, varying levels of evaluative research. In one type of study, you measure the actual behavior of the
unit against its stated goals and objectives. This is easy to imagine with regards to the Driver's License Department or some
other government agency. You have probably spent agonizing hours waiting in lines and wading through red tape yet you read
on the wall that these are public servants dedicated to serving you--the public. You might get a certain enjoyment out of
work that evaluates and changes these type of programs.
Yet another use of evaluative research, called structural evaluation, does not concern itself with goals and objectives
but in comparing units with other known programs. This type of study employs such devices as organizational charts of differing
programs to suggest changes. It works at comparisons of the actual performances against the norms in like-programs.
Cost-benefit evaluations use an economy approach as they compare increasing costs with possible increasing productivity,
as well as decreasing costs and still trying to increase productivity. Changes may or may not pay off as intended, and this
type of research tries to predict future changes as well as evaluate former changes with respect to efficiency.
Process evaluation, often employed in manufacturing, appeals to concerns about improvement of the various stages of production.
Its focus is to clearly describe what is going on (in contrast to what is thought to be going on) and how it can be improved
upon. This type of evaluative research is employed heavily in car manufacturing in Japan where a different management style
allows the floor worker to be part of the evaluation of his team's work.
Here in the US this idea is being implemented somewhat and needs the third party (you) influence to get it implemented.
Outcomes evaluation is used to focus on benefits that need to be realized by a the consumer of goods or services to keep
them satisfied. One important example of this research is the business community's viewpoint of the students graduating from
the University of Utah. It was found that the local business people who do the hiring do not perceive the U students are graduating
with real-world understanding---especially in research! One of the results of this study was to expand the undergraduates'
experience in doing research, so that the prospective employers were placated.
Impact evaluative research is broader than outcomes evaluation. It involves the entire community's viewpoint; it considers
the opinions and attitudes of even those not directly benefitted by the program under study. This is the world of PR and is
a major area that you may decide to work in.
Whatever level of evaluative research that is chosen, the personal attributes of the researcher impacts these type of studies
more than regular research projects. Working with people in an "auditor" way, in a way that is designed to "criticize" their
work or program, is usually a delicate matter.
The information obtained can be very important to an organization, yet they shy away from employing an evaluator or from
listening to the evaluation for some of the following common complaints:
1) "the evaluation is of poor quality" (usually when the findings are not favorable to the employers mind)
2) "we were not involved enough or the out come would differ"
3) "your recommendations are arguable, too vague to use, more research must be needed"
4) "your language in the presentation was too difficult for all of us to understand, let alone to implement"
5) "you were in an unreal vacuum--you missed the political and/or environmental concerns"
6) "you lack credibility"
7) "you cooperated too much with special interests"
8) "your evaluation comes too late to be of value"
To help improve the value of your evaluative study, try to:
1) Involve personnel that would do the actual implementation of your suggestions. Be careful that this does not unduly
bias your work--you are still the researcher, they should not taint findings
2) Present your findings to outsiders as well, especially those that would have an interest in the outcomes and influence
implementation
3) Get very timely information
4) Clearly admit the limitations of the study early on to reduce the number of possible objections
A Social Impact Assessment is a part of the larger Environmental Impact Assessment process. Herein lies yet another career
possibility. There are 5 types of social impact that are studied:
1) Economic: changes in business activity, jobs, employment, personal income, and in the economic "base" of the community.
2) Demographic: changes in population (not just local: regional) and in population characteristics (gender ratio, age differential)
3) Fiscal: changes in public costs (ex: school districts tax base)
4) Community Service: changes in demand, distribution and quality of public services
5) Social: changes in community organizations, perceptions, lifestyles and life satisfaction. Especially changes in specific
groups such as the elderly, minorities, or other sub groups.
As these assessments are mandated by law, jobs in these areas can be found. Yet the same regulations require the study
to be completed in a given time frame, so use of existing data is necessary.