Authors: Professor Sarah Hitt SFHEA (NMITE) and Professor Raffaella Ocone OBE FREng FRSE (Heriot-Watt University).

Keywords: Engineering education; assessment methods and tools; ethics assessment and evaluation; AHEP; ABET; ethics learning assessment aims and outcomes.

Who is this article for?: This article should be read by educators at all levels in higher education who wish to integrate ethics into the engineering and design curriculum or module design. It will also help prepare students with the integrated skill sets that employers are looking for.

 

Premise:

Educators who integrate ethics into their activities and modules may be unsure how to assess student learning in this area. Yet assessment of ethics learning is not only crucial for evaluating learning, but also for identifying ways to improve the teaching of ethics within engineering education. This is becoming increasingly important as accreditation bodies such as the AHEP (UK) and ABET (US) have revised standards to emphasise the context of engineering practice – of which ethics is a key component. Professional and industrial organisations like the Royal Academy of Engineering and the IET are prioritising ethical principles within their activities too.

 

The challenge of assessment:

The challenges of assessing ethics learning can seem difficult to overcome. Many of these challenges are summarised by Davis and Feinerman (2012) as “practical limits on assessment”. These include demands on time, pressure from other instructors or administrators, difficulty in connecting assessment of ethics with assessment of technical content, and instructors’ unfamiliarity or lack of confidence in ethics teaching.

Furthermore, as Keefer et al. (2014, p.250-251) point out, “realistic ethical problems are what cognitive scientists refer to as ‘ill-structured problems’, because there is no clearly specified goal, usually incomplete information, and multiple possible solution paths . . . good student responses can lead in quite different directions, providing emphases on a diversity of values and issues that are difficult to predict”.

However, scholars of engineering ethics have been studying assessment methods and practices for decades, and have shown ways of overcoming these challenges. Informed by other areas of practical and professional ethics, including business or medical ethics, their work has tried to formalise evaluation and measure students’ learning after ethical interventions in the curriculum. Whether these interventions occur in the context of a single course or module on engineering ethics, as part of a defined design project, or integrated within technical lessons, scholars agree that ethics learning can, and should, be assessed as a best practice in engineering education (Benya, 2012).

 

Assessment aims and methods:

Most educational institutions promote a variety of assessment methods as good educational practice. As such, both quantitative and qualitative assessment methods can be used in ethics education; many of these are described in Watts et al.’s (2017) systematic review and analysis of best practices. These include: pre- and post-tests, experimental and control groups, interviews to elicit descriptive data, or written essays from which themes can be identified and extracted.

No matter which method is chosen, the key to assessing student progress in ethics learning is for the educator to align the content that is taught, with the outcomes that are desired (Bairaktarova and Woodcock, 2015). These outcomes can be informed by other module or programme learning outcomes and accreditation standards.

A good practice is to use outcomes informed by scholars in moral development and teaching ethics, who have described ways to identify and then measure defined elements of ethics learning. For example, the Engineering Ethics Explorer identifies pedagogical focus at different learning levels with corresponding outcomes and content.

In ethics education more generally, Davis and Feinerman (2012) describe these learning aims which can be applied to engineering ethics:

  1. Improve students’ sensitivity (the awareness and recognition of ethical dilemmas).
  2. Increase students’ knowledge (ethics resources such as codes, standards, theories, and/or decision-making tools).
  3. Enhance students’ judgement (the analysis and reasoning required to make and justify ethical choices).
  4. Reinforce students’ commitment (the motivation to act based on ethics learning).

These aims correspond to a taxonomy of moral development such as that described by James Rest (1994) which increases in complexity at different learning levels. For this reason, the Royal Academy of Engineering/Engineering Professors’ Council’s Engineering ethics case studies are designated as Beginner, Intermediate, and Advanced, where:

 

Developing assessment tools in engineering ethics:

Educators may use these ethics learning aims / outcomes as guidance for developing assessments. For example, in an intermediate case that focuses on making a decision about an ethical dilemma, students might be assessed on their ability to:

After outcomes are identified, educators can design assessment tools. In the case described above, multiple choice questions would ask students to identify stakeholders, choose among options that correctly define the problem, or identify potential courses of action.

A matching question could link stakeholders and their perspectives. Students would be asked to explain the dilemma and propose a course of action and a narrative could be evaluated against a rubric that scores students’ proficiency on a scale of Less Proficient to Expert in categories such as:

These tools could be used in formative assessments, where students are given checklists, rubrics, or scoring guides to evaluate their learning as it is happening and prior to the completion of final exams or projects. Keefer et al. (2014) show formative assessment to be effective in engineering ethics learning situations not only because of its benefit to students, but also in its ability to reveal gaps in instruction that can be used to improve teaching.

Sindelar et al. (2003) describe the use of a summative assessment tool where students provided written responses to questions about two engineering ethics scenarios and were scored using a rubric designed to evaluate their response to an ethical dilemma. Both of these examples were also used in both pre- and post-test scenarios. These could also be useful in measuring the effectiveness of ethics instruction.

Finally, Davis and Feinerman (2012) demonstrate how slight adjustments to technical questions can elicit responses that also reveal students’ ethics learning. This can be done by using the example of a question about the technical capabilities of a micro-fluidic device and its advantages or disadvantages to society.

 

Conclusion:

We should be encouraged that, as Watts et al. (2017, p.225-226) also demonstrate, “multiple meta-analyses examining the effectiveness of ethics courses in the sciences and business” show that ethics instruction does improve students’ ability to make ethical decisions, and that ethics education has “improved significantly in the last decade”. With that in mind, educators should feel confident that they can identify what aspect of ethics learning needs to be assessed, and then measure it with an appropriately designed assessment tool.

 

References:

Bairaktarova, D. and Woodcock, A. (2015). ‘Engineering ethics education: Aligning practice and outcomes’, IEEE Communications Magazine, 53(11), pp.18-22.

Benya, F.F., Fletcher, C.H. and Hollander, R.D., (2013) ‘Practical Guidance on Science and Engineering Ethics Education for Instructors and Administrators: Papers and Summary from a Workshop December 12, 2012’, Washington, DC: National Academies Press.

Davis, M. and A. Feinerman. (2012). ‘Assessing graduate student progress in engineering ethics’, Science and Engineering Ethics, 18(2), pp. 351-367.

Keefer, M.W., Wilson, S.E., Dankowicz, H. and Loui, M.C., (2014) ‘The importance of formative assessment in science and engineering ethics education: Some evidence and practical advice’, Science and Engineering Ethics, 20(1), pp. 249-260.

Rest, J. R., (1994) ‘Background: Theory and research’, in Rest, J. and Narvaez, D. (eds.), Moral Development in the Professions: Psychology and Applied Ethics. Mahwah, NJ: Lawrence Erlbaum Associates, pp. 1-26.

Sindelar, M., Shuman, L., Besterfield-Sacre, M., Miller, R., Mitcham, C., Olds, B., Pinkus, R. and Wolfe, H., (2003) ‘Assessing engineering students’ abilities to resolve ethical dilemmas’, Paper presented at the ASEE/IEEE Frontiers in Education Conference, Boulder, CO, 5-8 November 2003.

Watts, L.L., Todd, E.M., Mulhearn, T.J., Medeiros, K.E., Mumford, M.D. and Connelly, S., (2017) ‘Qualitative evaluation methods in ethics education: A systematic review and analysis of best practices’, Accountability in Research, 24(4), pp. 225-242.

 

Additional resources:

 

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Any views, thoughts, and opinions expressed herein are solely that of the author(s) and do not necessarily reflect the views, opinions, policies, or position of the Engineering Professors’ Council or the Toolkit sponsors and supporters.

Degree Apprenticeships Toolkit

We’ve pulled together a checklist of things for university departments to consider when proposing to get involved in degree apprenticeships.  It’s still evolving so please do contact us if you have experience or advice you would like to add.

 

Schedules of teaching and learning need to be agreed. These can take various forms:

There may also be periods of study on employers’ premises and at other institutions. These again have to be agreed and contracted.

Methods of grading, assessment and feedback need to be agreed and these will then be adhered to, in order to satisfy the exam board and other university regulations. The structures of assessment (presentations, experiments, lab work, practicals, as well as essays and exams) have also to be integrated throughout the programmes.

Agreeing employer-led content is vital from the above points of view. In employer led content, the university is required to have a position of ‘internal external examiner’ and in some universities this may mean that designated employer staff are given the status of adjunct employee at the university in question.

Examining employer-led content and the means by which this is done has to be agreed and contracted. It is essential to recognise that this can lead to conflicts, where for example:

University staff will therefore need to remain in close contact and regularly visiting employers’ premises in order that neither of these positions occurs. Where there are disputes over standards, there needs to be an agreed means of arbitration and reconciliation of grades and work.

Student registration is an issue because of the UK UCAS regulations that govern undergraduate admissions to programmes at this level. This may have to be agreed as a formality; if students are not to apply via UCAS then an alternative is required, that is agreed and contracted. There may be disputes also over:

 

Any views, thoughts, and opinions expressed herein are solely that of the author(s) and do not necessarily reflect the views, opinions, policies, or position of the Engineering Professors’ Council or the Toolkit sponsors and supporters.

Degree Apprenticeships Toolkit

We’ve pulled together a checklist of things for university departments to consider when proposing to get involved in degree apprenticeships.  It’s still evolving so please do contact us if you have experience or advice you would like to add.

 

The constitution of the programme is formed around the 80/20 principle and what is done and how then becomes a matter for agreement in the contract. There are two main approaches:

The “on the job” work then has to be fitted in with the requirements of the employers, and needs to be agreed and structured in ways that fit in with HEI schemes of award. This means particular attention to, and agreement on:

Interim awards may also be either offered by the university or demanded by the employers, and the issuing of certificates and diplomas at different stages of progress may be required or appropriate in some cases.

 

Any views, thoughts, and opinions expressed herein are solely that of the author(s) and do not necessarily reflect the views, opinions, policies, or position of the Engineering Professors’ Council or the Toolkit sponsors and supporters.

Our two Placements Toolkits (previously Contextual Learning Toolkits) are the result of the research conducted to address the recommendations of the Perkins Review of Engineering Skills and the Royal Academy of Engineering’s Universe of Engineering Report about engineering student’s placements in companies.

The report is part of the close work that the EPC has being doing with the NCUB on its “engineering workwith” hub of information for employers on how to work with university engineering departments to provide work experience opportunities and other forms of collaboration to enhance the work-readiness of students, and follows the outcomes of a survey conducted by the EPC during September/October 2015 on Contextual Learning in UK HE Engineering.

The report includes the main findings of the research aimed to explore engineering students’ placement experiences and case studies. Two separate, but interlinked, toolkits, were developed:

The toolkit for Students was designed to support students to get the best from their placement experience.

The toolkit for Universities and Employers was designed to support higher education institutions and employers to enhance the experience and the value of students’ placements.

Structure

The toolkits were structured to support the placement experience in three key stages: before, during and after placement.

before2during2after2

For the purpose of the toolkits:

Any views, thoughts, and opinions expressed herein are solely that of the author(s) and do not necessarily reflect the views, opinions, policies, or position of the Engineering Professors’ Council or the Toolkit sponsors and supporters.

This toolkit is designed to support you to get the best from your placement experience. It will help you to think about your placement, looking at your expectations, recognising your own responsibilities alongside those of your university and placement provider.

For the purpose of this toolkit:

  • a placement is where learning opportunities are available for you to undertake engineering practice under guidance and supervision
  • an academic supervisor is your key link at your university, during your placement (if applicable)
  • a placement supervisor is your direct manager at the company

The Toolkit is structured to follow your placement journey and will provide you useful information to consider before, during and after your placement experience.

Aligned with the Engineering Placements Toolkit, designed for education institutions and employers, this toolkit aims to support your placement experience in three key stages: before, during and after placement. Please select and click the appropriate page below to gain access to tools to help you through each stage of the placement.

Contents

Any views, thoughts, and opinions expressed herein are solely that of the author(s) and do not necessarily reflect the views, opinions, policies, or position of the Engineering Professors’ Council or the Toolkit sponsors and supporters.

The Engineering Placements Toolkit is designed to support higher education institutions and employers to enhance the experience and the value of students’ placements. Aligned with the Your Placement Journey Toolkit, designed for students, this toolkit aims to support the placement experience in three key stages: before, during and after placement. Please select and click the appropriate page below to gain access to tools to help you through each stage of the placement.

Contents

 

Any views, thoughts, and opinions expressed herein are solely that of the author(s) and do not necessarily reflect the views, opinions, policies, or position of the Engineering Professors’ Council or the Toolkit sponsors and supporters.

Your Placement Journey Toolkit is designed to support you to get the best from your placement experience. It will help you to think about your placement, looking at your expectations, recognising your own responsibilities alongside those of your university and placement provider.

Aligned with the Engineering Placements Toolkit, designed for education institutions and employers, this toolkit aims to support your placement experience in three key stages: before, during and after placement.

 

Placement experiences

“I am getting industrial experience in the area I am really passionate about, so when I’ll graduate and will look for jobs I’ll be so much better prepared and it’s definitely a plus to my CV.” – from University of Leicester

Oishi Deb is a software and electronics engineering undergraduate at University of Leicester. She has finished her second year and is currently doing a yearlong placement at Rolls Royce where she is enjoying the opportunity to apply her knowledge in real world projects and also learn new skills that will benefit her future professional career.

“I think the best part was that I was seen as a team member in the department (
) I was very welcomed there, they appreciated the work I was doing and the feedback was very constructive all the time.” – from University of Salford

Cristian Balan is an aeronautical engineering undergraduate at University of Salford. He had an exciting one-year placement in Airbus, working both in Germany (Bremen) and France (Toulouse). In his placement Cristian felt he was part of the team and worked in fast-paced projects where he had the opportunity to work not only in research and development departments, but also in production and quality management.

“I couldn’t recommend doing a placement enough to anyone. I think this was one of the best decisions I have made. I wasn’t originally signed up to do it but I changed my mind and I am so delighted, because I think it’s really invaluable to have real world experience throughout a year. It puts what you learned in university in such a good perspective, and I found that really helpful.” – from University of Bath

Emily Jones is a civil engineering undergraduate at University of Bath. She did a one-year placement in industry where she had the opportunity to work in different projects and have a real world experience of what a civil engineer does. Emily describes her placement as being an invaluable experience, and recommends every student to be proactive and embrace all the opportunities been offered during their placement.

“I enjoyed the freedom of being able to help in any way that I could, and just being useful. I really did enjoy it, and it was a really good break from university, which was exactly what I wanted.” – from Imperial College London

Tobi Danmole is a mechanical engineering undergraduate at Imperial College London. Last year he did a one-year placement, not only to gain experience and increase his chances of getting a good job, but also to have a break from university and explore the world of work. He has been offered a job in Rolls-Royce, after doing his placement in the company.

“I think it’s really important if you are given the opportunity to enter a company for a short period of time to see as much as the company as possible, and not just the little sector where you are working, so that you can have a better feel of how companies, in general, work.” – from University of Cambridge

Madeleine Steer is an engineering undergraduate at University of Cambridge. In Cambridge, all engineering undergraduate students are required to complete a total of 8 weeks of internship experience during summer. However, although being compulsory for her degree, Madeleine also wanted to do internships in order to explore which field of engineering she wanted to specialise in the future. These internships allowed Madeleine to actually experience the work of different companies, and gain a wider perspective of what to expect in different engineering sectors.

“I think I’ve become more interested in my own course. And then, as a person, it has made me more mature and given me a better idea of what I want to do next. I still have some doubts from time to time, but now, at least, I know what I enjoy doing, and what I am looking for in a job.” – University of Bath

Ana Miarnau is a mechanical engineering undergraduate at University of Bath. She had an international one-year placement at a research organisation in Switzerland. Initially, she was not meant to do a placement, but after speaking to students at the university who had been on a placement before, Ana thought it was a good idea to get work experience before graduating and increase their chances of finding a good job once graduated.

“You got to learn the lesson to rely on other people and look for help when you need it. I think it helped me to come to university because if I hadn’t done it, I would be struggling with problems and trying to solve things on my own, when there are better options out there, such as going to look for help and working together in group. I think that is, at the moment, perhaps the best thing I have learnt.” – from University of Cambridge

Charlie Constable is a first year engineering undergraduate student at University of Cambridge. He took a gap year before coming to university, through the Engineering Development Trust ‘Year in Industry Scheme’, in order to try and feel how actually engineering works.

 

Any views, thoughts, and opinions expressed herein are solely that of the author(s) and do not necessarily reflect the views, opinions, policies, or position of the Engineering Professors’ Council or the Toolkit sponsors and supporters.

Your Placement Journey Toolkit is designed to support you to get the best from your placement experience. It will help you to think about your placement, looking at your expectations, recognising your own responsibilities alongside those of your university and placement provider.

Aligned with the Engineering Placements Toolkit, designed for education institutions and employers, this toolkit aims to support your placement experience in three key stages: before, during and after placement.

 

Your placement provides you with new learning experiences, knowledge, and skills that will be assessed by your university and valued by future employers.

Top Tips

Assessment

On completion of your placement, ensure that you have submitted all the documents and reports on the due date.

Evaluate the placement itself and prepare for meeting with your personal tutor and placement coordinator. 

Reflect and evaluate your achievements

Look at what you’ve enjoyed the most and benefited from during your placement experience.

How do you assess your skills development? Reflect on what you have achieved and the skills you have acquired to enable this.

Reflect on what have you enjoyed the most, what have you and least, and why.

Your future plans

Write your CV, and give specific examples based on the experience you acquired during your placement.

Contact your Careers Service for individual advise on your future plans.

Think about professional registration

Once you have achieved the necessary qualifications and workplace experience you should apply to your institution to become professionally registered.  Your institution will guide you through the registration process and help you to decide when you’re ready to apply.

Read more on the Engineering Council website.

As you prepare to enter the world of work, it’s critical to align your skills and experience with the needs of the businesses which will look to employ you. Many employers made it plain that undergraduates achieving professional registration as an Engineering Technician (EngTech) and / or ICT Technician (ICTTech) on completion of their year in industry will have a distinct advantage when it comes to finding employment upon graduation.

Read more about the technician professional registration for students on The Institute of Engineering and Technology website.

Share your experience with fellow students

Share your thoughts and experience with your Career Services and fellow students at your university. You can also have a wider impact contacting organisms such as the National Centre for Universities and Business (NCUB) and their dedicated programmes such as My Placement Experience.

 

Read more

 

Any views, thoughts, and opinions expressed herein are solely that of the author(s) and do not necessarily reflect the views, opinions, policies, or position of the Engineering Professors’ Council or the Toolkit sponsors and supporters.

Your Placement Journey Toolkit is designed to support you to get the best from your placement experience. It will help you to think about your placement, looking at your expectations, recognising your own responsibilities alongside those of your university and placement provider.

Aligned with the Engineering Placements Toolkit, designed for education institutions and employers, this toolkit aims to support your placement experience in three key stages: before, during and after placement.

 

During your placement you have the responsibility to get the most of your experience. Be proactive in seeking out experiences for your level of practice and skills with the support of your placement supervisor at the company.

How can I get the most of my placement?

Communication

Communication is key. Demonstrate your willingness to work as part of the team and adopt a reflective approach to your learning. Don’t be afraid to ask questions. Ask for feedback as much as possible. 

Reflective skills

Also, reflect on your progress. Writing a log book and or/diary will help you not only to track and gather evidence of your learning, but also to increase your self-awareness and confidence.

Continuous development

Look out for learning opportunities in your company that were not initially expected to occur in your placement. Also, utilize learning opportunities outside the placement. Have you ever thought about learning a new language, or develop your business skills? Employers value your ability to learn new things inside and outside your field of study. Have a look at your university’s free courses or explore online resources such as:

Develop your professional network

Engage with your colleagues, be part of the team and be open to new learning experiences. Work in as many projects as possible, even if not directly related with your placement learning outcomes. You might enjoy things that you were not initially considering to do. Many students were offered jobs after their placements because of their engagement with the company.

How will I be assessed?

Make sure you know the criteria in advance. What is expected from you? Know your learning outcomes, learning tasks and assessment which you should agree with both your academic and your placement supervisors.

I am struggling with my placement. What can I do?

Seek guidance and support from your placement supervisor to enable you to achieve your learning outcomes.

If the relationship with your placement placement supervisor is not working for any reason, seek help from your university’s academic supervisor.

Work-life balance

Your placement can be a bit daunting in the beginning. You may feel that is all about work and getting yourself stuck in. However, it’s also important to have a good work-life balance.

Top Tips

 

Read more

 

Any views, thoughts, and opinions expressed herein are solely that of the author(s) and do not necessarily reflect the views, opinions, policies, or position of the Engineering Professors’ Council or the Toolkit sponsors and supporters.

The Engineering Placements Toolkit is designed to support higher education institutions and employers to enhance the experience and the value of students’ placements. Aligned with the Your Placement Journey Toolkit, designed for students, this toolkit aims to support the placement experience in three key stages: before, during and after placement.

 

Universities

Careers Service

University Departments

Employers

Joint actions

  • Get feedback from the student at the end of the placement
  • Provide a final assessment record
  • Identify benefits and costs

 

Read more

 

Any views, thoughts, and opinions expressed herein are solely that of the author(s) and do not necessarily reflect the views, opinions, policies, or position of the Engineering Professors’ Council or the Toolkit sponsors and supporters.

Let us know what you think of our website