1 QUALITY IN THE IVT PH.D.- PROGRAM by T. Moan PhD Regulations enforced in 2012 Framework of Qualifications Kvalifikasjonsrammeverket (KRV) Background - NTNU visions for research - purpose of PhD study - quality measures and assurance Challenges in running the PhD program IFEL 8000 course Highlights of the book: How to get a PhD Seminar agenda
2 Background Main challenges relating to NTNU s Vision to become Internationally outstanding 2020 Improve academic and scientific quality and relevance Recruit outstanding students and researchers Increase our visibility Internationalise PhD candidates are crucial in this endeavour
3 Background Purpose of PhD study - train to become an independent researcher - aquire transferable skills & knowledge (through coursework, research) - accomplish research results Contribute to innovation: patents. which are publishable Specified in the Framework of Qualifications Kvalifikasjonsrammeverket (KRV) Knowledge - in the research front, scientific methods, development of new knowledge Skills - Planning and conduction of research, dealing with complex subject matters within the area of specialization General competence - identifying ethical problems, conduct research with professional integrity, disseminate scientific knowledge, participate in professional debates, contribute innovation
4 Background Research on the right topics (for relevance ) IVTs research plan ( fagplan ) - strategy- and action plan Reseach in the right manner (to achieve quality) (more postdoc. research)
5 Measures of Quality in research Intrinsic qualities Originality Adapted partly after: Seglen, P. O. (2001) Evaluating Biology: A Scientometric Study of a University Biology Department. NIFU publication 6/2001. - Theme (offroad, niche, novel combination, unexplored area) - Problem (novel problem) - Difficulty (attacking hard problems) - Methods (novel developments, improvements, novel applications) - Theory (original and well supported! - hypotheses and theories) - Results (new knowledge) Solidity - Data quality (clear, obvious, large effects, many experiments, adequate statistics) - Methodological quality (adequate methods; advanced methods) - Control (by experiments, checking and excluding alternative explanations) - Information power (well-defined and solid conclusions) Informativity - Clarity (of problem formulation, results and conclusions) - Objectivity (critical evaluation of own data; - other research ) - Knowledgeability (expertise, broad knowledge and insight,..) - Technical quality (clear, well-organised and informative figures and tables)
6 Measures of Quality in research (continued) Extrinsic qualities Intra-scientific utility - Overall citations (high h Hirsch - index) - Number of publications in high ranking journals and conferences, - Relative citedness within own field (high c crown index) - Accessibility (type of publication) - Cooperativity (national and international collaborations) - Invited lectures - Research prizes grants and keynote addresses - Honorary titles and positions & other peer honours Extra-scientific utility/relevance - Recognised scientific breakthrough discoveries, Inventions and patents - Products (including software) - Prizes and grants for applied research - Private and government assignments - Industrialisation based on inventions
7 Measures of Quality in research, continued Journals - impact factor - National ranking of journals The Norwegian Association of Higher Education Institutions (UHR) - category 1 or 2. - peer assessment - paper rejection rate Conferences - peer assessment - paper rejection rate Universities - student/employee ratio; publications; citations - peers view, etc T.Moan 07.11.13
8 Measures of Quality in Applied research - application potential (Relevance!) - innovation - more applicable as a measure of the quality of research groups than individuals - funding obtained from the society (Research Council), industry, - patent-licenced income - spin-off companies - patents
9 Background Quality assurance in research Internal: - by those carrying out the research: ----- for PhD projects: candidate, supervisor (s) External: - paper review, thesis committee, research group evaluation, university evaluation Peer-review and repeating experiments is the only way to be sure that the knowledge is correct.
10 Background Quality assurance in PhD research By those who do the work (candidate, supervisors, colleagues) Recruiting excellent students Project plan (research plan) - new items (innovation) - approval of written plan by PhD committee vs presentation and defence in front of a committee (within the faculty) Progress reports - written/oral? Midterm evaluation - written selfevaluation and oral defence Supervisors competence and function (time spent etc) Peer review of thesis and publications (internally, externally,..) Necessary resources - Administrative - Professional/scientific
11 Challenges in running the PhD program at IVT - from admittance to graduation I. PhD Supervisor/ program leader in the different phases Admission/ Selection of supervisor Training (courses/research/ presentations/scientific writing) Assessment - admission (GPA, exam:research attitude.) - employment/admission to study Final assessment - committee/administrator - disputation -PhD Regulations -NTNU PhD handbook Responsibilities Faculty Department Supervisor PhD candidate
12 Admission - GPA of min B in the MSc study (min. 3.81 in a system A=5, B=4 etc) (especially for stud. comming from foreign institutions) - suitability as a researcher (admittance test?) - Min. 30 studypoints course work of which min. 20 PhD study points Selection of supervisor/advisor - minimum two supervisors, min. one sci. employee of NTNU - min. one with previous experience or training as supervisor - doc. degree or equivalent - supervisors should be active researchers One of the supervisors: Min 3 pub. points in the last 5 years Published significantly at conferences - formally appointed by the department (PhD program leader?) a supervisor and candidate find each other
13 v v v NTNU Fakultet for ingeniørvitenskap Norges teknisk-naturvitenskapelige og teknologi Universitet Doktorgradsutvalget 08.04.2008 DESCRIPTION OF THE RESEARCH PROJECT CONTENT The description of the research project at IVT Faculty should contain the following items: Background o Give a brief description of the approach and issues that will be addressed in the doctoral thesis. o Why is the proposed thesis subject of interest in view of the current state of the art? o New knowledge that is expected to result from the research work on the thesis should be outlined relative to the state of the art within this field and the candidate s previous work within that field. Objectives o The academic or scientific objectives of the PhD thesis work are to be specified. o The objectives are to be listed in points and formulated in a way that enables them to be examined and evaluated once the research is concluded. Scope o Consider the limitations in the coverage and explain which topics are to be covered by the thesis and which issues are outside the scope of the work. Project description 6 months after entering the PhD study Descibe -The need for new knowledge - knowledge status (ref. scientific literature)
14 v Research method o The research content of the PhD thesis is to be specified. o Describe the specific research methods that will be used to achieve the objectives listed under point two above. o If experimental data is to be collected, describe the research design and data analysis that will be used. Expected results o The potential new knowledge that could result from the research is to be explained. o Show how the findings and results from the thesis can be applied in an industrial context or be useful to other sectors such as public administration. v Work plan/work schedule o State the tasks that will be performed in order to achieve the stated objectives. o A schedule that shows the time required for each of the tasks in the work plan should be included. References o The references used to describe the background and current state of the art should be included. The description of the research project should normally be between 5 to 10 sheets of A4 with normal layout and continuous text.
15 Monitoring progress completing course exams (with a B for MSc courses, C for PhD courses), initial research Time management from the start! Midterm evaluation defending your research plan; demonstrating readiness for research (vs. Initial qualifying exam)? Forced termination of the PhD study ( 5.7) in case of - too slow progress on course study or research - unethical or criminal conduct (cheating in exams, plagiarizing research etc) - Up to now there has only been a trial period of 6 months as for any other employee of the university - Written warning lay off? - Convince candidates that it is best for all parties that the studies are terminated Nominally 3 years ; or 4 years when combined with a teaching assistantship up to one year (possible job before defence?)
16 Assessment of Thesis and Trial Lecture Committee - standard: 1 NTNU; 1 from Norway, outside NTNU (for how long time after NTNU career); 1 foreigner - commonly: 1 NTNU; 2 foreigners - independence of the candidate - independence of the supervisors!? Thesis PhD regulations of NTNU allow a thesis in the form of - a monograph, - a collection of (3 journal) papers together with a summary of the work - a so-called article-based thesis It is possible to make small modifications of the thesis after submitting the thesis based on e.g. comments by the assessment committee Trial lecture - the topic for trial lecture should be outside the thesis topic
17 II. Subject IFEL 8000 Introduction to research methodology, theory of science and ethics Staff in charge: Torgeir Moan Weekly hours: Fall/Spring 4 SP Schedule: Lectures to be announced and independent projects work Category: Mandatory course for PhD students Aim: The aim of the subject is to: - establish a common basis for the PhD research education - provide insight into the theory of science and research methodology - encourage reflections about ethics - develop the (individual) research plan for the PhD study Attendance : 8 out of 11 sessions Submittance of research plan (project description)
18 Plan Session (Duration) Topic Lecturer Session 1 (2 hours) Session 2 (3 hours) Session 3 (3 hours) Session 4-5 (6 hours) Session 6 (3 hours) Session 7 (3 hours) Session 8-9 (6 hours) Session 10 (3 hours) Session 11 (3 hours) Welcome to the Faculty Introduction to the PhD study - Course req., research - Practical issues Overview of IFEL8000 Scientific theories.. Early science history. Kepler, Galilei, Newton Beyond Newton. Modern science Research methods in eng. sci. Qualitative research methods Research Ethics Thesis, other publications, etc. Research plan issues (I.Strømmen/) T. Moan T. Moan Per A. Bjørkum Per A. Bjørkum T. Moan A. Tjora R. Nydal T. Moan T. Moan
19 Focus on selected chapters Chapter 3 The nature of the PhD qualifications Chapter 4 How not to get a PhD - don t under-/overestimate what is required Chapter 5 How to do research Chapter 6 The form of a PhD thesis Chapter 7 Writing your PhD Chapter 8 The PhD process (-psychological aspects - time management) Chapter 9, 12 & 14 Supervisor & PhD candidate s roles Chapter 10 & 11 (partly) Equal opportunities for non-trad./minority students Check: adjust to NTNU Ch. 15 Institutional responsibilities
20 Chapter 14 HOW TO SUPERVISE AND EXAMINE Students expect their supervisors to read their work well in advance be available when needed be friendly, open and supportive be constructively critical have a good knowledge of the research area structure the tutorial so that it is relatively easy to exchange ideas have sufficient interest in their research to put more information in the students path be sufficiently involved in their success to help them get a good job at the end of it all! Particular issues Establishing a role model Teaching the craft of research from Phillips & Pugh How to get a PhD, The Open University Press Etc,
21 Comments on: Supervisor & PhD candidate s roles: Chapters 9, 12, 14 PhD process: Learning and intellectual development of the PhD student and supervisor (or, rather advisor!) There are different types of PhD students and supervisors (advisors) - Some types of PhD students and advisors (partly adapted after Professor M.Levin, NTNU) Student Passive/receptive Aggressive non-advisable Active -pragmatic Active critical & reflective Advisor Passive Active - Bulldozer/directive and commanding Active - Challenger
22 Comments on: Supervisor & PhD candidate s roles: Chapters 9, 12, 14 PhD process is a learning process for all parties (adult education) - making the student mobilize own resources for own development The candidate and supervisor should communicate both during the course study (subjects to take, additional knowledge to fill in etc) and during the thesis work - main directions of research, literature study, - work progress (regular meetings, PhD candidate prepares material to discuss, and constructive, critical feed back from supervisor) - taking into account the asymmetry in the dialogue (power and social capital in the hands of the supervisor)
23 Chapters 10 & 11 Equal opportunities for non- traditional students ----candidates from different cultures Part time students Overseas (Foreign) students Ethnic minorities, racial & sexual harassment, women You should note that we expect PhD candidates to: - be self-driven - take initiative, - argue with your seniors These expectations are particularly important to observe for PhD candidates with a non-european cultural background from Phillips & Pugh How to get a PhD, The Open University Press
24 III. Necessary (or useful) skills in accomplishing the PhD thesis and any job later! 1. Technical skills of a particular engineering branch, or discipline(s) within a branch (civil, electrical, marine, mechanical, ) 2. Computer proficiency 3. Probability and statistics 4. Creative thinking 5. Time management - work smarter 6. Communication skills - Public speaking - Technical & scientific writing 7. People skills teamwork - cooperation 8. Career planning
25 IV. Contact persons Subject matter Person(s) - Living in Norway : Fellow students,..book - Research matters, subjects : Supervisor, possible co-supervisors, researchers, fellow students etc - Employment matters & lab., data expences etc : Supervisor, Department - PhD administrative matters - change of plan, formalities : Department contact person Faculty (IVT) contacts: - Runa Nilssen/Elin Steen - IFEL8000 : - Inger Lise Johansen inger.l.johansen@ntnu.no, -T. Moan - IVT PhD Committee : Professors H. C. Dreyer, T.Moan (chair), H. Anderson and B. Skallerud; PhD candidates L. C. Hald and B. Winther Solemslie (Deputies for HCH and HA: M. Fernandino and E.Hertwich) - DION (the organisation of PhD students at NTNU) T.Moan.Session 07.11.13 1_30.01.13
26 Seminar for supervisors ( Veilederseminar ) Agenda Session 1: 09:15 10:00 INTRODUCTION QUALITY IN THE PH.D. ACTIVITIES AT IVT Torgeir Moan Overview of the activities to assure the quality of the PhD studies at IVT, as a context for the PhD supervision and as a basis for discussion of improvements; with reference to the qualification framework, PhD handbook, - Recruiting PhD candidates, preparing the research plan, - QA during the completion of the PhD degree. - Supervisor qualifications - Content of the IFEL8000 subject for PhD candidates : Session 2: 10:15-11:00 PhD candidates perspective on supervision Astrid Vigtil based on inquiry of Phd candidates at IVT - Experiences and challanges of being a PhD-candidate - Ph.d. candidates (and supervisors mutual) expectations - Reference to relevant parts of handbook: Quality on ph.d. education etc
27 Session 3: 11:15-12:15 EXAMPLES OF BEST PRACTICES Pro-rector Johan Hustad How is quality achieved while balancing academic research and innovation? -organizing performance culture through cooperation. -multidisciplinary/cross-disciplinary research -dealing with ph.d. candidates with different cultural and scientific background -planning and executing research -experiences with interaction with industry compromising quality and relevance? -industry PhD candidates Professor Bjørn Skallerud How is quality achieved? -organizing performance culture through cooperation..- e.g. with two supervisors.- teambuilding.. -multidisciplinary/cross-disciplinary research -planning and executing research -experiences with interaction with industry compromising quality and relevance? -LUNCH : 12:15-13:15
28 Session 4: 13:15-13:45 CODUCTING RESEARCH TRAINING IN A CULTURAL/SCIENTIFIC MANIFOLD Professor May-Britt Hägg, NT -organizing performance culture through cooperation..- e.g. with two supervisors.- teambuilding.. -multidisciplinary/cross-disciplinary research -dealing with ph.d. candidates with different cultural and scientific background -planning and executing research -experiences with interaction with industry compromising quality and relevance? Session 5: 14:00-16:00 GROUP WORK : 14:00 15:30 Topics: Entrance exam/midway assessment The role of the supervisor - 10 advices for good supervision Internationalisation Cultural differences Summary of group work in a plenary session: 15.30-16.00: