Student Post Project Questionaire

 

This questionnaire is the final questionnaire of the Research Study on the Dynamics of the IS Development Process. As you may recall, the research study is being conducted by IS faculty in the business schools at USC and University of Texas. You are being asked to complete this questionnaire because you are finishing the IS design activity as part of Barry Boehm's Fall Computer Science class. As part of that class, students (called here the IS team) built a set of design specifications and a prototype for an Information System. Both clients and students are being asked to complete this form so we can obtain your final evaluations of the work in which you were involved. Your answers are kept strictly confidential by having the answers reported directly to the researchers. Class Teaching Assistants are informed only when a form is completed by a student (not the contents) so that students may obtain appropriate credit for form completion.

First Name: 
Last Name:


email address:

Name of Project:
Please list the roles you played on the IS team:

 


I. Complexity of the Requirements Development Process

These items measure the complexity of the work that you just completed. Using the following scale:

1=strongly disagree
2=disagree
3=neither agree nor disagree
4=agree
5=strongly agree

1.To what extent do you agree or disagree with the following statements:

a. Requirements fluctuated quite a bit towards the end of the project.

b. Requirements identified at the beginning of the project were quite different from those in place at the end.

c. Users of this software differed a great deal among themselves in their requirements.

d. A lot of effort had to be spent in reconciling the requirements of the various users of this software

e. It was difficult to customize software to one set of users without reducing support for other users.

f. There was a clearly known way to convert user needs to requirements specifications.

g. Available knowledge was of great help in converting user needs to requirements specifications.

h. Established procedures and practices could be used as a basis for requirements specifications.

i. An understandable sequence of steps could be followed in converting user needs to requirements specifications.

II. Participation in IS Development Process

These questions in this section ask about the kind of participation you experienced in the project. Please use the following scale to answer the questions:

1= not at all
2= minor extent
3= moderate extent
4= major extent
5= great extent

1. As the new IS was being developed, to what extent did you participate in each of the following activities:

a) Initiating this semester's project

b) Establishing the objectives of the project

c) Identifying user requirements for the IS

d) Assessing ways to meet user requirements

e) Outlining how information flows through the system

f) Clarifying functionality of input screens

g) Clarifying functionality of output screens

h) Determining access privileges for different user groups

i) Improving the users' work process

j) Identifying alternatives among design tradeoffs

k) Designating system architecture

2. These questions ask about how much influence you had during the IS development process this semester. To what extent were you able to:
a. Influence decisions about the delivered system

b. Have your opinions actually considered by the client

c. Successfully assert your opinion with the client

d. Personally influence the IS project overall

3. To what extent do you feel:

a. Responsible for results of this project

b. Control over the features of the final IS

c. Ownership over project results

4. During the project this semester, to what degree:

a) did you keep client informed of decisions made about the system

b) did the client formally review IS team's work

c) did the client formally approve IS team's work

d) did the client formally accept and sign-off the IS delivered by the IS team

e) did the client formally accept and sign-off the ISis delivered by the IS team

f) will people think of the IS as something client developed mostly by him/herself

g) will people think of the IS as something the IS team team developed mostly by themselves

h) will people think of the IS as something the client and the IS team developed together

5. This question does NOT use the 5-point scale used by the other questions. To answer the question, just write in a number. On average, approximately how much time, in hours per week, did you spend on this project?
hours

III. EVALUATION OF THE IS DEVELOPMENT PROCESS

1. How was communication with the client handled (check only one):
we all usually interacted with the client
whenever we had an issue to discuss with the client, the person on the team who knew the most about the issue would discuss it with the client
we designated a person on our team who handled most of the client contact

2. How much time do you feel you spent interacting with client (check only one):
every 2nd or 3rd day (or more)
once a week
once every other week
once every third week
only when deliverables were due

3. Please describe how the clients communicated with you during the project this semester. If you dealt with more than one person, concentrate on the one whom you dealt with most of the time during the semester. Think about his/her behavior in general, rather than about specific situations. Please use the following scale:

1=strongly agree
2=mildly agree
3=neutral feelings or don't know
4=mildly disagree
5=strongly disagree

The client:

a. Had good command of the language.

b. Was/were sensitive to others' needs of the moment.

c. Typically got right to the point.

d. Paid attention to what other people said.

e. Dealt with others effectively.

f. Was/were good listener(s).

g. wrote in ways that were difficult to understand.

h. Expressed ideas clearly.

i. Was/were difficult to understand when speaking.

j. Generally said the right thing at the right time.

k. Was/were easy to talk to.

l. Usually responded to messages (memos, phone calls, reports, etc.) quickly.

4. Please indicate the extent to which you believe each of the following was an enabler or inhibitor to the success of the project? Use the following scale:

1= significant enabler of success
2= enabled success to some degree
3= had no effect
4= inhibited success to some degree
5= significant inhibitor of success

a. Communication between client and team

b. Coordination among team

c. Client finding the time and resources needed

d. IS Team effectively using its time and resources

e. IS Team's knowledge of client's needs and constraints

f. Client's knowledge of the IS team's needs and constraints

g. IS Team's ability to work with client

h. Client's ability to work with IS team

i. IS Team's technical knowledge of IS options

j. Client's technical knowledge of IS options

k. The process followed by the team for developing an IS

l. Commitment of client to the project

m. Commitment of the team to the project

n. Commitment of the client's management to the project.

5. Using the following scale, please rate the experience you had in the IS development process

1= not at all
2= minor extent
3= moderate extent
4= major extent
5= great extent

a. Amount of conflict between you and the client

b. Amount of conflict between you and other IS team members

c. Amount of disagreement with the client you were directly involved in?

d. Resolving differences of opinion between IS team and client to the mutual satisfaction of conflicting parties

e. Resolving differences among team members to the mutual satisfaction of conflicting parties

f. Frequency with which mutually agreeable solutions could be reached in the disagreements between client and IS team

g. Extent to which all conflicts were resolved to your satisfaction?

h. Knowledge acquired by the client and the IS team about the application of information technologies.

i. Knowledge acquired by the client and the IS team about the use of development techniques.

j. Knowledge acquired by the client and the IS team about the functioning of the manual process.

k. The amount of effort needed by the client and IS team to complete the project.

l. Your success in making steady progress towards completion throughout the project.

m. Your success in completing all expected deliverables by the end of the project.

6. Looking back on this last semester working with client, indicate the extent to which you learned something about each area of the IS that was designed, using the scale:

1= nothing at all
2= minor extent
3= moderate extent
4= major extent
5= great extent

a. Costs & benefits of the IS

b. Features and functions required in the IS

c. Relative importance of features and functions

d. General goals of IS team in this IS development effort

e. General goals of client(s) in this IS development effort

f. How the IS team prioritized its different goals

g. How the client(s) prioritized their different goals

h. Constraints on IS development process imposed by other USC groups

i. How users will use IS

j. How client's organization will rollout & deploy the IS (e.g., transition requirements)

k. Common design norms (such as those for graphical user interface) that apply to the IS

l. Stages and standards in this IS development process

m. Structuring databases for the IS

n. Amount of time and resources it might take to fully develop the IS

o. Total cost of ownership of the IS

p. Other areas of learning (please list)

IV. EVALUATION OF THE FINAL PRODUCT

1. Using the scale:

1= extremely likely
2= likely
3= neither likely nor unlikely
4= unlikely
5= extremely unlikely

Based on the IS we delivered, I believe:

a. Using the IS will enable the users to accomplish tasks more quickly.

b. Using the IS will improve the intended users' job or school performance.

c. Using the IS will increase the users' productivity.

d. Using the IS will enhance the intended users' effectiveness in their work.

e. Using the IS will make it easier for the users to do their tasks.

f. The users will find the IS useful.

g. Learning to operate the IS will be easy for the users.

h. The users will find it easy to get the IS to do what they want it to do.

i. The users' interaction with the IS will be clear and understandable.

j. The users will find the IS to be flexible to interact with.

k. It will be easy for the users to become skillful at using the IS.

l. The users will find the IS easy to use.

3. Please circle the answer (from 1 to 7) that best describes your beliefs about the IS that was deliveredas it pertains to the work that the IS is to perform for the user community.

a. How essential will it be?
   nonessential 1     2     3     4     5     6     7    essential

b. How fundamental will it be?
   trivial 1     2     3     4     5     6     7    fundamental

c. How significant will it be?
   insignificant 1     2     3     4     5     6     7    significant

d. How important will it be?
   unimportant 1     2     3     4     5     6     7    important

e. How needed will it be?
   not needed 1     2     3     4     5     6     7    needed

f. How relevant will it be to the users?
   irrelevant to them 1     2     3     4     5     6     7    relevant to them

g. How much of concern will it be to the users?
   of no concern to them 1     2     3     4     5     6     7    of concern to them

h. How much will it matter to the users?
   won't matter to them 1     2     3     4     5     6     7    will matters a lot to them

4. Please describe any frustrating experiences with anyone -co-team members, users, clients, ISD, all others -during the project, and what you did (or did not do). Again, all your answers will be held in strict confidence.


Thank you so much for taking the time to complete the questionnaire. At the end of the semester, we will be analyzing the results and make them available to you. If you have questions about the research, please send them to

Dr. Ann Majchrzak
Professor of Information Systems
Marshall School of Business
University of Southern California
majchrza@usc.edu