Outline of Evaluation Project

My evaluation project will be a needs analysis, with a mixed mode method for data collection. I will be evaluating introducing elearning tasks into upcoming engineering courses.

Needs Assessment -·
Who users are,
type of users·
cost-effective·
where the gaps are.

Reason for a 'needs analysis'
I believe that a review of current practice can reveal that little elearning is encompassed within the teaching of engineering. At the best there are electronic notes and assignments made available to students on an electronic filing cabinet. I would like to see more dynamic use of elearning in the form of quizzes and possible group discussions.
Students that study engineering tend to be kinesthetic learners and already use computers in some engineering courses like computer aided design, so they have a familiarity with computers. I suspect that the main reason elearning instruction is not more widely used is due to those that teach engineering not having the skill or knowledge to do so.
The strategic plan of this polytechnic is to provide a state of the art facility and learning environment. That must include the use of modern techniques (such as elearning) where appropriate. And to be student focused. So there is a directive from above that encourages elearning to be developed into our courses. Since we have the job of running the courses for the first time, we have the opportunity to do this.
There is a ‘need for analysis’ to find out if what I believe could be true and if elearning would be aligned with the strategic plan.

What is to be evaluated.
It is intended that elearning be introduced slowy, as instructors get up to speed with the technology. So a pilot is proposed, one which includes the use of interactive learning material with follow up quizzes, and a site which will allow instruction form f2f for review.
I would also like to check the viability of using a discussion board, I not sure how this could be used inside of the engineering curriculum but there may well be instances where it would be appropriate.

How the evaluation will work
It will use a 'multiple methods' model to collect data and information. Methods I aim use are:
Student survey –To find student demographics and learner types.
Focus groups – Get students to trial a quiz and give their opinion. I will endeavor to test if learning outcomes can be met. I will give them a small assessment before the trial and another assessment after the trail, to try and measure effective change to learning outcomes. Both test with a range of outcome levels and should give some quantifiable results. I am hoping to have 10 to 15 students in my focus group.
A separate survey after they have completed the trial to see what their feelings were on using elearning as part of their learning. This survey would have open ended questions and the results would have to be considered with consultation of other instructors.
Expert review - Peers to trial a quiz and be interviewed on their opinion.