1 Blackwell Science, LtdOxford, UKVHEValue in Health ISPOR Original ArticleReport of ISPOR TCA Task ForceWild et al. Volume 8 Number VALUE IN HEALTH Principles of Good Practice for the Translation and Cultural Adaptation Process for Patient-Reported Outcomes (PRO) Measures: Report of the ISPOR Task Force for Translation and Cultural Adaptation Diane Wild, MSc, 1 Alyson Grove, MSc, 1 Mona Martin, MPA, 2 Sonya Eremenco, MA, 3 Sandra McElroy, BA, 4 Aneesa Verjee-Lorenz, MSc, 1 Pennifer Erikson, PhD 5 1 Oxford Outcomes Ltd., Oxford, UK; 2 Health Research Associates, Seattle, WA, USA; 3 Center on Outcomes, Research, and Education (CORE), Evanston, IL, USA; 4 Pfizer Inc., Kalamazoo, MI, USA; 5 Pennsylvania State University, State College, PA, USA ABSTRACT In 1999, ISPOR formed the Quality of Life Special Interest group (QoL-SIG) Translation and Cultural Adaptation group (TCA group) to stimulate discussion on and create guidelines and standards for the and cultural adaptation of patient-reported outcome (PRO) measures. After identifying a general lack of consistency in current methods and published guidelines, the TCA group saw a need to develop a holistic perspective that synthesized the full spectrum of published methods. This process resulted in the development of Translation and Cultural Adaptation of Patient Reported Outcomes Measures Principles of Good Practice (PGP), a report on current methods, and an appraisal of their strengths and weaknesses. The TCA Group undertook a review of evidence from current practice, a review of the literature and existing guidelines, and consideration of the issues facing the pharmaceutical industry, regulators, and the broader outcomes research community. Each approach to and cultural adaptation was considered systematically in terms of rationale, components, key actors, and the potential benefits and risks associated with each approach and step. The results of this review were subjected to discussion and challenge within the TCA group, as well as consultation with the outcomes research community at large. Through this review, a consensus emerged on a broad approach, along with a detailed critique of the strengths and weaknesses of the differing methodologies. The results of this review are set out as Translation and Cultural Adaptation of Patient Reported Outcomes Measures Principles of Good Practice and are reported in this document. Keywords: cultural adaptation, good practice, guidelines, linguistic validation, patient reported outcomes measures,. Background and Rationale At ISPOR Second Annual European Congress, which took place in 1998 in Edinburgh, Scotland, a meeting was held about quality of life in general and the need for a greater presence at ISPOR. At this meeting, a list of possible topics was generated by the group and the attendees identified the topic that was of interest. From there, the working groups were formed based on the areas of interest. When the working groups of the Quality of Life Special Interest Group (QoL-SIG) were set up in Address correspondence to: Diane Wild, Oxford Outcomes Ltd., The Old Barn, Jericho Farm, Cassington, Oxford, OX29 4SZ, UK , a separate chair was asked to lead each working group. The groups were given no specific remit, rather they were intended to offer a forum, in which ISPOR members could meet to share thoughts and discuss issues pertinent to the particular research interests of the group. Open meetings were scheduled to take place at each of the European and International ISPOR conferences so that ISPOR members were free to join any group at any stage, depending on their own particular research interests at any given time. Information can be found about other QoL-SIG working groups on the ISPOR s Web site at The Translation and Cultural Adaptation (TCA) group met for the first time at the ISPOR Third Annual European Congress in Antwerp in ISPOR /05/
2 Report of ISPOR TCA Task Force 95 The Congress was attended by representatives of the pharmaceutical industry, academia, and contract research organizations (CROs); all participants were either interested or involved in the and cultural adaptation of patientreported outcomes (PRO) measures for use in clinical trials or other forms of outcomes research. Some members had no prior knowledge of the process and had come expecting to have their questions answered during the meeting, while other members, with first-hand experience of managing s, had come expecting to discuss some of the difficult issues they faced as practitioners. Discussions at this meeting demonstrated that there were no definitive answers to many methodological questions and confirmed that differing methodologies were being employed in current practice. The TCA group concluded that better definitions were required for the following reasons: 1. In practice differing methodologies are employed by consulting groups to perform similar tasks, making consistency and comparison difficult to achieve. 2. Different terminology is used to refer to the same aspects of the process, making it harder to achieve clarity. 3. Instrument developers have sometimes developed their own guidelines for use with a specific instrument that may be inconsistent and/or out of date compared to current research requirements. 4. Poorly translated instruments threaten the validity of research data and the safe aggregation of global data sets. There is no practical means to assess the validity and conceptual equivalence of new or existing s except by post hoc psychometric validation. Quality assurance is therefore heavily dependent on the methodology used. TCA group discussions at subsequent ISPOR meetings focused on the evaluation of existing guidelines, their current relevance to outcomes research, and possible forms that any new guidelines might take. After it became apparent that the open nature of those meetings was causing little progress to be made, it was decided in May 2001 to form a core group of regular meeting attendees in order to complete a draft of a new guidance document. The remaining group of interested members could then act as a reference group to review and comment on the new guidance as it progressed. This core group began work in June Problem Statements The main problems initially identified by the TCA group were: 1. Lack of consistency in terminology. For example, the terms pilot testing and cognitive debriefing are both used to describe the testing of a new on a small group of five or six patients. In addition, the term pilot testing is also used to refer to the testing of an instrument on a larger group of patients to gather some initial data. 2. Lack of consistency in methodology. While most practitioners agree that the overall aim of is to produce a new language version, which is both conceptually equivalent with the original and relevant to the new target culture, the actual methods employed differ. For example, some methods do not include a back to further refine the, while some methods include one or two back s. While the literature expresses the preference of individual authors, there is a lack of published research studies that demonstrate the superiority of any one approach. 3. The scope of future guidance. In particular should it prescribe language-specific methodology or methods for specific types of PRO instruments (e.g., symptom checklists, diaries, and components of case report forms)? 4. The extent to which any new guidance should be prescriptive or descriptive, i.e., whether it should describe the way in which the process can be undertaken or should it set out criteria, standards, or requirements that must be met. 5. The target audience for the new guidance needs to be defined in order to determine how results should be presented. The scope of the new guidance document was explored during initial TCA group discussions. It was determined early on that each particular type of language to language process (e.g., English to German, or French to Russian) should be dealt with separately from same language adaptations (e.g., adapting a Spanish for Spain for use in Argentina, or English for the United States being adapted for use in South Africa). The TCA group chose to begin by reviewing existing guidelines for language to language s, and decided that same language adaptations merited their own guidelines.
3 96 In addition, there was discussion about the different methodologies employed for different types of patient-reported outcome measures. It was decided that the discussion around whether some types of PRO measures (e.g., diaries) require a less rigorous approach to fully validate health-related quality of life (HRQoL) measures should wait until after further discussion had taken place. When discussing the style in which the new guidance document would be written, the working group also considered its target audience. It was decided that it should be produced with the entire ISPOR membership in mind, as it was intended to benefit the interests of outcomes research. It needed to be written in a user-friendly format and from a very practical point of view for all interested parties whether they be from industry, academia, or contract research. It was agreed that, because of the subjective nature of language and the range of PRO instruments in current use, resulting guidance should not be overly prescriptive. However, if guidance were purely descriptive, readers without experience in the area might be unable to effectively select an appropriate method. The TCA group therefore decided that it should aim to publish good practice guidance that set basic standards but allowed flexibility. It would provide a description of the process in a step-by-step format that would be clear enough for anyone to follow and understand, without using ill-defined labels or jargon. An additional section was to be provided to inform readers about the risks they would face if they chose to omit any one of the steps in the process. The final work would therefore not be presented as a set of rigid procedures, but rather set out the principles of good practice in the area of and cultural adaptation, making clear both the rationale for including each step and the risks of omission. Methods The TCA working group of ISPOR s QoL-SIG carried out a review of the following 12 major sets of guidelines available for and cultural adaptation: 1. American Association of Orthopaedic Surgeons (AAOS) ; 2. Association of Test Publishers ; 3. EORTC group ; 4. Euro QoL group [EuroQoL Group, unpublished]; Wild et al. 5. Evidence: Clinical and Pharmaceutical Research ; 6. FACIT group ; 7. Health Outcomes group (HOG) ; 8. Health Utilities Inc. (HUInc) ; 9. International Quality of Life Assessment (IQOLA) group ; 10. Kidney Disease Quality of Life (KDQOL) ; 11. Medical Outcomes Trust (MOT) ; and 12. World Health Organization . Each of these was broken down into different steps in the process (e.g., forward, reconciliation, back, pilot testing), and each member of the working group reviewed the content of published guidelines for each key step. For some steps, there was a great deal of consistency in approach, while for other steps there was considerable disparity. The resultant reviews were evaluated in terms of current practice and research needs and agreement was reached regarding what should be included in the methodological description of each step. Agreement was also reached on the need for additional information that would provide assistance to outcomes researchers in implementing the suggested methods. These other areas included: 1. the rationale for each step; 2. a description of the actors to be involved in each step; and 3. an outline of the risks associated with not including that step in the process. For clarity and ease of use, the information was to be presented in a tabular format, with a list of clear definitions. The PGP working paper resulted from this process and was circulated to the TCA QoL-SIG reference group for review. Suggestions for changes or additions were subsequently discussed by the working group and implemented as appropriate. Two further rounds of review and revision were carried out until the working and reference groups agreed on the current document. The Translation and Cultural Adaptation Principles of Good Practice are presented over the following pages, beginning with definitions of each step in the process and the actors involved at each step. The framework for describing each step in the process is: 1. Preparation; 2. Forward Translation; 3. Reconciliation; 4. Back Translation;
4 Report of ISPOR TCA Task Force Back Translation Review; 6. Harmonization; 7. Cognitive Debriefing; 8. Review of Cognitive Debriefing Results and Finalization; 9. Proofreading; and 10. Final Report. Each step is described in the following ways: 1. Step identification; 2. Critical components; 3. Rationale; 4. Who should do this; and 5. For each of the 10 steps, a summary of the TCA Group discussions and revisions that lead to the current PGP are also included. ISPOR Principles of Good Practice: The Cross-Cultural Adaptation Process for Patient-Reported Outcomes Measures Part 1: Definitions For clarity, the following explanations are provided for the terms most often used to label each step in the process and the key actors involved in each step. They are not deemed to be definitive labels, but an aid to understanding and evaluating the content of each step. Explanation of the labels used to describe each step in the process Preparation initial work carried out before the work begins; Forward of the original language, also called source, version of the instrument into another language, often called the target language; Reconciliation comparing and merging more than one forward into a single forward ; Back of the new language version back into the original language; Back review comparison of the back-translated versions of the instrument with the original to highlight and investigate discrepancies between the original and the reconciled, which is then revised in the process of resolving the issues; Harmonization comparison of back s of multiple language versions with each other and the original instrument to highlight discrepancies between the original and its derivative s, as well as to achieve a consistent approach to problems; Cognitive debriefing testing the instrument on a small group of relevant patients or lay people in order to test alternative wording and to check understandability, interpretation, and cultural relevance of the ; Review of cognitive debriefing results and finalization comparison of the patients or lay persons interpretation of the with the original version to highlight and amend discrepancies; Proofreading final review of the to highlight and correct any typographic, grammatical or other errors; Final report report written at the end of the process documenting the development of each. Description of the key actors involved in the process Client the person or group of people requiring or commissioning the of an instrument; Instrument developer person or group of people who developed the original instrument being translated, and who may be responsible for the management of the instrument; Project manager the person coordinating the project, working at a CRO or other similar organization. He or she provides oversight at each stage of the process; Key in-country consultant the main contact person managing the process in the target country. This person is responsible (sometimes) for developing the first forward. He or she should be a native speaker of the target language, fluent in the source language, usually English, and should reside in the target country. He or she should come from a medical/health/ psychology/social science background and have experience in translating/managing the of PRO measures; Forward translators the people who develop the second and subsequent forward s. They should be professional translators, native speakers of the target language and fluent in the source language, usually English. It is preferable that forward translators reside in the target country and have experience in the of PRO measures; Independent translator a translator who may be used to carry out the reconciliation. He or she should be a native speaker of the target language, be fluent in the source language, and
5 98 reside in the target country, preferably with experience in the of PRO measures; Back translators the people who develop the s from the target language back to the source language. They should be professional translators, native speakers of the language of the source measure, and fluent in the target language. They should have no prior knowledge of the measure, and should not see the source or any other language version before or during back ; In-country consultant an in-country person who may be used to carry out the cognitive debriefing interviews. He or she should be a native speaker of the target language, be fluent in the source language, and reside in the target country, preferably with experience in qualitative interviewing and/or cognitive interviewing techniques; and Proof readers the people who check the final for typographic, grammatical, or other errors. They should be native speakers of the target language. Part 2: The Translation and Cultural Adaptation Process Step 1 preparation. Although this is usually omitted from guidelines, the TCA group recognized that there is a good deal of preparatory work to be done before the work can begin. Therefore, a step was included to outline what this preparation work involves. The TCA group agreed that it is usually the project manager who both develops the explanation Wild et al. of the concepts with the developer if available/interested, and also recruits the key in-country persons. However, there was some discussion regarding who should take responsibility for contacting the developer for permission to use the instrument and to invite them to become involved in the process. In practice, this was sometimes carried out by the client requiring the s, while at other times the client had often not obtained permission before requesting that the project manager carry out the s. It was therefore decided that to reflect current practice, and to avoid being too prescriptive, the PGP maintains that initial contact with the developer to obtain permission for should be carried out, by either the client or the project manager. In some cases, an independent researcher may wish to undertake the of an instrument, and in such cases, the researcher would need to contact the developer for permission before beginning any work (Table 1). Step 2 forward. There was general agreement in the existing guidelines regarding the need for more than one forward. Ensuing discussions centered on the qualifications required for the people carrying out the forward. It is clear that culture is a primary determinant of language and that native speakers within a given culture have advantages with language ability that second language speakers do not, and thus it was agreed that all forward translators should be native speakers of the target language with prior experience in the of PRO measures. However, there was some disagreement about the need for all forward translators to be resident in the Table 1 Step 1 Preparation 1. Obtain permission to use instrument 2. Invite instrument developer to be involved 3. Develop explanation of concepts in instrument 4. Recruit key in-country persons to the project 1. To respect copyright 1. The client or the project manager contacts the instrument developer to ask for permission to use and translate the instrument 2. If the instrument developer is involved, he/she is often able to clarify any ambiguities, and clarify the concepts behind the items 3. To strengthen the conceptual equivalence of the forward s, and help to avoid any ambiguities 4. To have a key person in the target country to work closely with the project manager for the duration of the process 2. The project manager or the client invites the instrument developer to be involved in the process. The extent of their involvement is dependent on their own level of interest in the instrument 3. The project manager works with the instrument developer (where possible) to produce information about the conceptual basis for the items in the measure, for use by the translators in the process 4. The project manager recruits a key in-country person for each target language of not doing this? 1. Being prosecuted for unauthorized use of copyright material 2. Misinterpretation of items or concepts 3. Misinterpretation of items or concepts 4. Not applicable
6 Report of ISPOR TCA Task Force 99 Table 2 Step 2 Forward Translation 1. Development of at least two independent forward s 2. Provision of explanation of concepts in the instrument to the key in-country persons and forward translators 1. Translations can be compared, enabling detection of errors and divergent interpretation of ambiguous items in the original, thus reducing the potential bias of each key in-country person and forward translators 2. To provide key in-country persons and other forward translators with a clear explanation of the basic concepts, with the intention that the s will capture the conceptual meaning of the questions rather than being a literal 1. Two or more forward translators carry out independent forward s of the instrument. It is preferable that one forward be carried out by the key in-country person 2. The project manager provides the key in-country person and the other forward translators with background information about the conceptual basis of the measure. The project manager should instruct them to produce colloquial s that will be easily understood by the general lay population. In some circumstances it may be necessary to ask that wording is kept compatible with certain reading levels or ages 1. A which includes too much of one person s own style of writing 2. Lack of conceptual equivalence in s due to misinterpretation of items target country. Bearing in mind that the aim of the PGP was to present practical guidance rather than prescriptive rules, it was agreed that as the key incountry person would reside in the target country, it was acceptable for any second or subsequent forward translators to live in another country. However, it was felt that the PGP should indicate that residence in the target country was preferable (Table 2). Step 3 Reconciliation. There was relatively little concurrence between existing guidelines about how the reconciliation of the forward s should be carried out. There are three approaches: 1. a panel consisting of the key incountry person, all forward translators, and the project manager; 2. an independent native speaker of the target language who had not been involved in any of the forward s; and 3. an appointed in-country investigator who may have prepared one of the forward s, who will also conduct pilot testing and cognitive debriefing. TCA group discussions agreed to accept more than one way to achieve reconciliation, suggesting that it could be achieved by the key in-country persons working with their own and any other forward s or by an independent translator without prior knowledge of the, but also concluding that it is preferable for the key incountry person to work with the other forward translator(s) and the project manager. Most importantly, reconciliation decisions should be reviewed by or referred to the project manager. This allows for a degree of consistency and harmonization with other translated versions (Table 3). Step 4 back. The existing guidelines suggested a variety of approaches to back transla- Table 3 Step 3 Reconciliation Reconciliation of the forward s into a single forward Reconciliation resolves discrepancies between the original independent s, and seeks agreement between individual speech habits and preferences. A consensus may require alternative s to be produced but results in one final reconciled forward ready for back Where possible, reconciliation should be carried out via discussion with the key in-country person and the second forward translator, with input from the project manager. Alternatively an independent translator may be used to perform the reconciliation. As a minimum requirement, the key in-country person may compare the two forward s and reconcile them via discussions with the project manager, with reference to the second forward translator for difficult items A biased that is written in one person s own personal style or speech habit; misinterpretations remaining in the
7 100 Table 4 Step 4 Back Translation Back of the reconciled into the source language 1. The primary purpose of the backward process is to provide a quality-control step demonstrating that the quality of the is such that the same meaning n be derived when the is moved back into the source language 2. Some constructs (e.g., medical symptoms) might require a more literal back while more subjective constructs (e.g., QoL items) might need to be rendered more conceptually Back translators should be used to carry out at least one backward. Depending upon the nature of the content of the measure, it should be made clear by the project manager whether a literal or conceptual back is required Wild et al. 1. A in the new language version, which has a different content to and/or conceptual basis from the source measure (and therefore less likely to maintain the psychometric performance that source measure demonstrated) 2. A that does not respect the normal speech patterns and colloquialisms of the target culture tion. There was a general agreement on the need for back translators to be native speakers of the original language, but little agreement regarding how the back should actually be carried out. Some guidelines included more than one back, to be carried out either in parallel or sequentially; others suggested a back panel and many included a single back. The focus of the TCA working group s discussions, however, was on what style of back should be recommended i.e., should the back s be literal or conceptual. It was agreed that, for practical purposes, a more literal back would prove more useful when compared with the original language version. However, further discussion highlighted the potential need for more conceptual back s in the case of more subjective items, such as those dealing with QoL issues. Thus the PGP report highlights the need to determine which back approach is most appropriate to a specific situation (Table 4). Step 5 back review. The TCA group felt that this was one of the most important components of the cross-cultural adaptation process, but one that most of the existing guidelines had not specifically addressed. There was considerable agreement within the TCA group on this aspect of the process, with review of the back against the original being the key function. There was also recognition that discrepancies identified in this way would lead to further assessment of the reconciled version and to possible revisions of it to eliminate the discrepancies. It was also agreed that this review should be carried out by the project manager and any revision of the be agreed upon by the project manager and the key in-country person. Clarification should be sought from the developer whenever this was possible (Table 5). Step 6 harmonization. The TCA Group agreed that harmonization was a key objective of the and cultural adaptation process. Harmonization across different s is essential to ensuring inter validity, and allowing for reliable pooling of data from randomized controlled trials. However there is great disparity in the process through which harmonization is achieved. It is Table 5 Step 5 Back Translation Review Review of the back s against the source language To ensure the conceptual equivalence of the The project manager and the key in-country person should review the back s against the source instrument to identify any discrepancies The project manager should address the problematic items and, in liaison with the key in-country person, refine the It may also be useful to involve the developer to help resolve difficult issues A mis or omission may be overlooked and therefore remains in the
8 Report of ISPOR TCA Task Force 101 Table 6 Step 6 Harmonization Harmonization of all new s with each other and the source version To detect and deal with any discrepancies that arise between different language versions, thus ensuring conceptual equivalence between the source and target language versions and between all s. This provides an additional qualitycontrol step and further ensures that data from global trials can be safely aggregated Harmonization can be achieved in two main ways: 1. A harmonization meeting chaired by the project manager, where back translators representing each language provide a verbal back of each item in the measure. Close attention should be paid to the correspondence of each back translated item to the original version as well as to any instances or trends of differences between language versions in their rendering of the concepts 2. The project manager identifies items, which are found to be conceptually problematic in one or more languages. He/she then shares solutions for those items with all other key in-country persons working on the measure at the same time. These solutions can be shared at any point during the process, but are mainly communicated at the point of back review. It may also be useful to refer difficult items to the developer for clarification Translations that include differences between language versions may make it difficult to aggregate the global data set perhaps not surprising therefore, that it has been omitted from the majority of existing guidelines. Some practitioners believe that harmonization can only be achieved via a harmonization meeting, in which key in-country consultants, or back translators representing each language, compare all s with each other and the original. Other practitioners do not advocate a specific harmonization step, but integrate a harmonization component within each major step of the process. With the need for a specific harmonization step unproven, and the expense of hosting a full harmonization meeting prohibitive for many clients, it was decided that, to maintain a practical approach, the PGP should not support a single approach to harmonization. Instead the PGP should inform the reader of its importance and to describe alternative methodologies for achieving it. This is an issue that requires further investigation by the TCA group to obtain empiric evidence (Table 6). Step 7 cognitive debriefing. Although there is broad agreement within the existing guidelines on the purpose and necessity of a cognitive debriefing aspect in the process, each set of guidelines differs slightly in terms of the number and types of people they suggest should be included. The TCA group was very much aware of the need to avoid setting strict criteria which would be difficult to meet in real-world situations, while making sure that the recommendations were rigorous enough to ensure that the purpose of including this step (e.g., ensuring that the is comprehensible to the general or patient population) could be met. It was therefore decided to suggest a range for the number of patients that should be included, and give a clear recommendation that these should match the target population for as many criteria as reasonably practical (Table 7). Step 8 review of cognitive debriefing results and finalization. As with the back review Table 7 Step 7 Cognitive Debriefing Cognitive debriefing of the new, usually with patients drawn from the target population To assess the level of comprehensibility and cognitive equivalence of the To test any alternatives that have not been resolved by the translators To highlight any items that may be inappropriate at a conceptual level To identify any other issues that cause confusion The newly translated measure should be tested for cognitive equivalence by the key in-country person (or another in-country consultant) on a group of 5 to 8 respondents in the target country Respondents should be native speakers of the target language who adequately represent the target population (sex, age, education, diagnosis) In certain circumstances it may be appropriate to include healthy respondents Missing or inaccurate data resulting from respondents misunderstanding of items
9 102 Table 8 Step 8 Review of Cognitive Debriefing Results and Finalization Cognitive debriefing results are reviewed and the finalized To incorporate findings of the debriefing process to improve the performance of the 1. The project manager reviews the results from cognitive debriefing and identifies modifications necessary for improvement. Items and response options may be reworded where respondents comments justify such changes 2. Following agreement on changes between the project manager and the key in-country person, the can be finalized Wild et al. Translation may include words or phrases that are not familiar to or commonly used by the respondents Subsequent data collected may include a high level of missing data, or may be inappropriate to aggregate step, this is an aspect of the process, which even though included in cognitive debriefing exercises, is not often specifically described. A review of the cognitive debriefing results against the original version of the instrument is a key to assure cultural relevance. The review should be carried out by the project manager. Revisions to the should be agreed between the project manager and the key in-country person. Finally, it was agreed that clarification should be sought from the developer whenever possible (Table 8). Step 9 proofreading. Even though the proofreading of final s is likely to be carried out at the end of most projects, few of the existing guidelines included it as a step in the process. The working group agreed that its inclusion was important because it is an important opportunity to ensure that any minor errors are corrected before the translated instrument is approved for use among the target population. Also, those PGP users who may be unfamiliar with s would be aware that even though a has been taken through many rigorous steps, there is still a need for this final quality-control step (Table 9). Step 10 final report. Again this is an important aspect of the process, which the TCA working group agreed needed to be included here, although it is often not clearly explained in the existing guidelines. The Final Report provides a description of all and cultural adaptation decisions, which may be useful when interpreting derivative data sets or informing other future s of the same instrument, especially with regard to harmonization (Table 10). Discussion PRO measures are included in the majority of global clinical trials and other research studies Table 9 Step 9 Proofreading The finalized is proofread To check for minor errors which have been missed during the process The key in-country person and/or a proof reader checks the final and corrects any remaining spelling, diacritical, grammatical, or other errors A final that contains spelling, grammatical, and/or other errors Table 10 Step 10 Final Report Report is written on the development of the 1. To clearly explain the reasons for all / wording choices made throughout the process 2. This is essential for future s of the same measure to be harmonized with language versions previously developed The project manager writes the final report, which should include a full description of the methodology used, plus an item-by-item representation of all decisions undertaken throughout the process 1. Translations of measures that may not be used because of inadequate reporting of methods used in development 2. Development of subsequent s that are not harmonized with previous language versions
10 Report of ISPOR TCA Task Force 103 throughout the world. This usually means that at least some of the measures included in the research have been translated into other languages from a single original language and the data obtained from each country using these translated measures is often pooled or aggregated and analyzed and reported as a single data set. The quality of the data derived from those translated measures relies on the accuracy of the. It is therefore surprising that no current set of quality assurance guidelines exist, given the risks that poor methods can present to research data. It is in this context that the need for some generic guidance in the area of and cultural adaptation was identified very early on in the discussions of the TCA group. These PGP are based on a comprehensive review of existing guidelines, identifying areas of common agreement and areas of disparity. They synthesize published guidelines to achieve, to the greatest degree possible, a comprehensive and universally acceptable document. During the review of existing guidelines, the TCA Group noted four main problems: 1. lack of consistency in the use of both terminology and methods; 2. gaps or insufficient information in the literature about several areas of importance, including harmonization and proofreading; 3. little information on why each step should be followed, and nothing identifying the risk of omitting key parts of the TCA process; and 4. emphasis on theoretical ideals for and cross-cultural adaptation rather than what is actually feasible in research practice. Based on their work and discussion of these issues, the TCA working group in consultation with the wider TCA reference group decided to take a new approach to guidance by creating an allencompassing methodology that describes how each step can be undertaken, and the benefits and risks of undertaking, or omitting each step. Overall, we found more areas of agreement on principles of good practice than disagreement. The areas of most disparity were reconciliation and approaches to harmonization because of the widely differing approaches to carrying out those steps. The approach in this case to address the disparity was to present all the differing viewpoints so that it was clear that all were acceptable under these guidelines. Because of the consensus-building approach, we sought to be as inclusive as possible in providing options for how the various steps can be carried out. As long as agreement was found on the broader steps of what was essential to developing a highquality, linguistically valid, the details of how to actually carry out each step were not as critical as ensuring that each step was carried out in one form or another. During the same period that the current guidance document was being developed, similar work was being undertaken by the ERIQA Group. The group was established in 1998 and brings together HRQoL researchers, representatives from pharmaceutical companies, and health care authorities with the objective of establishing HRQoL as a credible criterion for evaluation in clinical trials. The ERIQA Group aims at establishing principles and practice guidelines for the integration of HRQoL outcomes in the regulatory process. At the same time that the ISPOR group was working on its guidance document, the ERIQA group conducted a literature review of existing guidelines and developed a draft checklist of recommended steps in the process of developing questionnaires of cross-cultural adaptations. The steps identified in the ERIQA checklist mirror those identified in the guidance document presented in this paper and appear as a checklist, which includes a description of steps in the process, the team involved, and the minimal requirements. The ERIQA group plans to disseminate and publish the checklist and to discuss the applicability of the checklist to all types of PROs. Conclusion This study has shown that it is indeed possible to find consensus on PGP in and cultural adaptation by looking for the areas of agreement in broader terms and allowing for different ways to achieve the same goal for each step in the process of. Building on the success of these principles, the TCA working group plans to investigate other areas for future research including same language adaptation, methods for translating non-validated instruments such as diaries, symptom checklists, and new analytical approaches such as Item Response Theory and Differential Item Functioning to better demonstrate the validity of translated measures. The group anticipates that addressing these issues will once again involve collecting different points of view from various sources, and consolidating them based on areas of agreement while allowing for some disparities in practice. We will also investigate ways to address the need for empiric evidence of what approaches to may yield better results.
11 104 Thanks to the following members of the TCA reference group who provided valuable input into the development of the principles of good practice: Amy Guo, Baxter Healthcare; David Himmelberger, Health Outcomes Group Inc.; Nan Luo, University of Singapore; Eric Myon, Pierre-Fabre, Elisabeth Stahl, Astra Zeneca; Monika Vance, Multi-Health Systems Inc. Source of financial support: No direct funding was received for this project but it was supported in an indirect way (e.g., availability of meeting space, etc.) by ISPOR. References 1 Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine 2000;25: Association of Test Publishers (1999). Increasing the validity of adapted tests: myths to be avoided and guidelines for improving test adaptation practices. ATP Website (http://www.testpublishers.org). 3 Cull A, Sprangers M, Bjordal K, Aaronson N on behalf of the EORTC Quality of Life Study Group. Translation Procedure. EORTC Monograph, 1998, 26 pages. 4 Evidence Clinical and Pharmaceutical Research (2004). Available from: com/ieo/qlf.html. Wild et al. 5 Bonomi AE, Cella DF, Hahn EA, et al. Multilingual s of the Functional Assessment of Cancer Therapy (FACT) quality of life measurement system. Qual Life Res 1996;5: Health Outcomes Group (2004). Available from: 7 Szecket N, Medin G, Furlong WJ, et al. Preliminary and cultural adaptation of health utilities index questionnaires for application in Argentina. Int J Cancer 1999;83(Suppl. 12): Bullinger M, Alonso A, Apolone G, et al. Translating health status questionnaires and evaluating their quality: the IQOLA approach. J Clin Epidemiol 1998;51: Merkus MP, Dekker FW. Kidney Disease Quality of Life-Short-Form: Translation Document. Amsterdam, The Netherlands Scientific Advisory Committee of the Medical Outcomes Trust. Assessing health status and quality of life instruments: attributes and review. Qual Life Res 2002;11: Sartorius N, Kuyken W. Translation of health status instruments. In: Orley J, Kuyken W, eds, Quality of Life Assessment: International Perspectives. Berlin Heidelberg: Springer Verlag, Acquardro C. ERIQA recommendations for and cultural adaptation of HRQL measures. ISPOR 6th Annual European Congress. Barcelona, Spain, November 9 11, 2003.
The Palliative care Outcome Scale (POS) Manual for cross-cultural adaptation and psychometric validation Author: Bárbara Antunes 1 Contributors: Barbara Daveson 1, Christina Ramsenthaler 1, Hamid Benalia
146 There is an increasing need for questionnaires to assess the health-related quality of life of Turkish and Moroccan cancer patients in the Netherlands (chapter 1). The first generation of Turkish and
A leader in the provision of translation services to the life sciences industry Medical Translation Division RWS Group overview Founded in 1958, RWS Group is one of the world s leading translation companies.
IFAC Board Exposure Draft November 2012 Comments due: March 14, 2013, 2013 International Standard on Auditing (ISA) 720 (Revised) The Auditor s Responsibilities Relating to Other Information in Documents
IFAC Board Exposure Draft July 2012 Comments due: October 11, 2012 Proposed International Education Standard (IES) 4 Initial Professional Development - Professional Values, Ethics, and Attitudes (Revised)
PEER REVIEW HISTORY BMJ Open publishes all reviews undertaken for accepted manuscripts. Reviewers are asked to complete a checklist review form (http://bmjopen.bmj.com/site/about/resources/checklist.pdf)
International Auditing and Assurance Standards Board Exposure Draft January 2011 Comments requested by May 20, 2011 Proposed International Standard on Review Engagements ISRE 2400 (Revised), Engagements
Process for advising on the feasibility of implementing a patient access scheme INTERIM September 2009 Patient Access Schemes Liaison Unit at NICE P001_PASLU_Process_Guide_V1.3 Page 1 of 21 Contents (to
Exposure Draft April 2014 Comments due: July 18, 2014 Proposed International Standard on Auditing (ISA) 720 (Revised) The Auditor's Responsibilities Relating to Other Information Proposed Consequential
Big Data for Patients (BD4P) Stakeholder Engagement Plan Index I. BD4P Program Background a. Goals and Objectives II. Participation a. How will stakeholders be engaged? i. Stakeholders ii. Workgroups III.
Programme Specification (Postgraduate) Date amended: 1. Programme Title (EdD) 2. Awarding body or institution University of Leicester 3. a) Mode of Study part time b) Type of Study postgraduate research
A Guide to Clinical Coding Audit Best Practice 2015-16 Authors: Clinical Classifications Service Contents 1 Introduction 3 1.1 Purpose of Document 3 1.2 Audience 3 1.3 Background 3 1.3.1 Information Governance
International Auditing and Assurance Standards Board Exposure Draft April 2011 Comments requested by September 1, 2011 Proposed International Standard on Assurance Engagements (ISAE) ISAE 3000 (Revised),
Policy Statement May 2015 International Federation of Accountants Policy for Translating and Reproducing Standards Published by the International Federation of Accountants This document was developed and
IFAC Board Exposure Draft August 2012 Comments due: December 11, 2012 Proposed International Education Standard (IES) 8 Professional Development for Engagement Partners Responsible for Audits of Financial
Guidelines for external reviews of quality assurance agencies in the European Higher Education Area Guidelines for external reviews of quality assurance agencies in the European Higher Education Area 2
PRO TASK FORCE: Changing Mode of Administration / epro Chair: Stephen Joel Coons PhD Professor of Pharmacy and Public Health University of Arizona, Tucson, AZ, USA Speaker: Keith Wenzel BS Perceptive Informatics,
IFAC Board Exposure Draft December 2013 Comments due: April 17, 2014 Proposed International Education Standard (IES) 8 Professional Competence for Engagement Partners Responsible for Audits of Financial
A DV I S O RY January 2013 NEW HIPAA PRIVACY RULES ALTER OPTIONS FOR HEALTH CARE MARKETING AND RESEARCH In a notice published in the Federal Register on Jan. 25, 2013, 1 the Department of Health and Human
FINANCIAL PLANNING PRACTICE STANADARDS Introduction IFPHK has adopted the Financial Planning Practice Standards ( Practice Standards ) in order to: Establish the level of practice expected of a financial
1. INTRODUCTION UTILIZATION OF INTERPRETERS People with limited English proficiency (LEP) and people who are deaf or hard of hearing face many barriers to health and mental health care. When communication
Improving Access and Quality of Health Care for Deaf Populations A Collaborative Project of the Sinai Health System and Advocate Health Care July 1, 2002 December 31, 2012 LESSONS LEARNED Overarching Lesson:
: Evaluator and Planning Team Job Descriptions I. Overview II. Sample Evaluator Job Description III. Evaluator Competencies IV. Recruiting members of your strategic evaluation planning team V. Recruiting
SUBMISSION DATE: 4/07/2014 DRAFT Nurse Practitioner Accreditation Standards Australian College of Nursing (ACN) is pleased to provide feedback on the Australian Nursing and Midwifery Accreditation Council
Outcomes of the consultation on guidance for registrants about the statutory requirement to have appropriate professional indemnity cover as a condition of registration Summary of responses to the consultation
Chapter 2 Essential Skills for Case Managers 2.1 Essential Skill Overview If you ask ten people what case management means to them, you will most likely get ten different answers. Though case management
IFAC International Auditing and Assurance Standards Board March 2003 Exposure Draft Response Due Date June 30, 2003 Assurance Engagements Proposed International Framework For Assurance Engagements, Proposed
Faculty Performance Appraisal System Akamai University A. University Position Statement Akamai faculty supervisors and the administration conduct periodic performance appraisals of all members of the faculty
ACLF Advanced to Consultant level Framework A developmental framework for pharmacists progressing to advanced levels of practice Version 2009(a) CoDEG www.codeg.org ADVANCED AND CONSULTANT LEVEL COMPETENCY
J. T. M. Miller, Department of Philosophy, University of Durham 1 Methodological Issues for Interdisciplinary Research Much of the apparent difficulty of interdisciplinary research stems from the nature
AMERICAN SOCIETY OF CIVIL ENGINEERS Standards Writing Manual for ASCE Standards Committees Prepared by ASCE Codes and Standards Committee Revised August 20, 2010 Contents Section Page 1.0 Scope, purpose,
Critical and creative thinking (higher order thinking) refer to a set of cognitive skills or strategies that increases the probability of a desired outcome. In an information- rich society, the quality
This article was downloaded by: [188.8.131.52] On: 27 August 2015, At: 21:16 Publisher: Routledge Informa Ltd Registered in England and Wales Registered Number: 1072954 Registered office: 5 Howick Place,
27.12.2006 L 378/1 I (Acts whose publication is obligatory) REGULATION (EC) No 1901/2006 OF THE EUROPEAN PARLIAMT AND OF THE COUNCIL of 12 December 2006 on medicinal products for paediatric use and amending
Quality Management Review Introduction New this year In order to maintain the integrity and currency of our annual review visits to BTEC centres, this process has undergone revision for 2015/16. This revision
BOSTON UNIVERSITY SCHOOL OF PUBLIC HEALTH PUBLIC HEALTH COMPETENCIES Competency-based education focuses on what students need to know and be able to do in varying and complex situations. These competencies
Professional Accreditation Handbook For Computer Science Programmes Revised by authority of the Accreditation Committee for Computer Science Programmes as of August 2014 CONTENTS 1. FRAMEWORK FOR ACCREDITATION
Assessment and Reporting in Society and Culture Stage 6 Effective from 2015 HSC Date published June 2014 This document contains the Board of Studies, Teaching and Educational Standards NSW (BOSTES) requirements
A Handbook for Planning Committees Developing Educational Programs Approved October 23, 2012 Educational Program Development Cycle Step 1 Convene planning committee Step 8 Review the evaluation results
Guidance Notes for Applicants of the Certificate for Clinical Trial on Medical Device List of Contents Page 1. Introduction 1.1 The Medical Device Administrative Control System and the 3 proposed legislation
Research & Development Guidance for Students 2 Contents Introduction 3 Understanding the Research Approval Process 3 Is My Project Audit, Research or Something Else 4 What Next? 4 R&D Step by step Guide
Research in the NHS HR Good Practice Resource Pack Acknowledgements The Research Passport system was first developed in Greater Manchester by a partnership of NHS organisations and the University of Manchester.
CHE Competencies Starting in the early 1990s, three national professional organizations the Society for Public Health Education, the American Association for Health Education, and the American Alliance
IFAC Board Exposure Draft December 2015 Comments due: March 15, 2015 Proposed Drafting Changes to International Education Standards, Framework for International Education Standards for Professional Accountants
Subsidiaries Background Information and Basis for Conclusions Section 1591 CPA Canada Handbook Accounting, Part II Foreword In September 2014, the Accounting Standards Board (AcSB) released SUBSIDIARIES,
COMPREHENSIVE EXAMINATION Adopted May 31, 2005/Voted revisions in January, 2007, August, 2008, and November 2008 and adapted October, 2010 All students are required to successfully complete the Comprehensive
STUDENT THESIS PROPOSAL GUIDELINES Thesis Proposal Students must work closely with their advisor to develop the proposal. Proposal Form The research proposal is expected to be completed during the normal
Question Detail ACM Comments 1. Are you a registered nurse? 2. Which of the following best indicates your current role? 3. What is your age? 4. If you work in nursing what is your current area of practice?
Competency Based Recruitment and Selection A Handbook for Managers 2010 March 2010 v2 1 March 2010 v2 2 Table of Contents Introduction...4 1. What are competencies?...4 2. Why use competencies for recruitment
QUALITY ASSURANCE COUNCIL AUDIT MANUAL SECOND AUDIT CYCLE Table of Contents Executive Summary 1 1. Introduction 3 2. Aims of audit 10 3. Scope of the second round of QAC audits 12 4. Process for the second
The NHS Foundation Trust Code of Governance www.monitor-nhsft.gov.uk The NHS Foundation Trust Code of Governance 1 Contents 1 Introduction 4 1.1 Why is there a code of governance for NHS foundation trusts?
Policy Statement 1 (7/93) The Development of Statements of Accounting Concepts and Accounting Standards Prepared by the Public Sector Accounting Standards Board of the Australian Accounting Research Foundation
INTERNATIONAL STANDARD ON AUDITING (UK AND IRELAND) 700 THE AUDITOR S REPORT ON FINANCIAL STATEMENTS CONTENTS Paragraphs Introduction... 1-4 Basic Elements of the Auditor s Report... 5-26-1 The Auditor
STATE OF CALIFORNIA DEPARTMENT OF INSURANCE 300 Capitol Mall, Suite 1700 Sacramento, California 95814 July 16, 2010 File No.: REG-2007-00054 ADOPTED TEXT OF REGULATION California Code of Regulations, Title
Session 10:15 11:45 am Ballroom C Clinical Trials: Is Your Staff Competent? What fundamental skills and knowledge should clinical trials nurses have? In response to questions from its members about how
Graduate School Into the groove, Rebecca Watts, Graduate School Research Images Competition 2012 The Graduate School guide to Surviving the viva You have submitted your thesis and now all you have to do
HKSAE 3000 Issued March 2014; revised February 2015 Hong Kong Standard on Assurance Engagements HKSAE 3000 (Revised), Assurance Engagements Other than Audits or Reviews of Historical Financial Information
Page 117 AGREEMENT ON TECHNICAL BARRIERS TO TRADE Members, Having regard to the Uruguay Round of Multilateral Trade Negotiations; Desiring to further the objectives of GATT 1994; Recognizing the important
The design review provides a forum in which questions can be answered, assumptions clarified and advice sought. They are a useful mechanism whereby the design of a product can be optimised through a systematic
International Accounting Education Standards Board Exposure Draft January 2009 Proposed Framework for International Education Standards for Professional Accountants REQUEST FOR COMMENTS The International
Guidelines for Masters / Magister / MA Theses Table of Contents Language of the Guidelines Digital Copy Process Basics Research question Research methodology (social sciences) Research methodology (computer
A Practical Guide to Performance Calibration: A Step-by-Step Guide to Increasing the Fairness and Accuracy of Performance Appraisal Karen N. Caruso, Ph.D. What is Performance Calibration? Performance Calibration
INSTITUTE OF FINANCIAL ADVISERS INC. P2 - PRACTICE STANDARDS EFFECTIVE 1 JANUARY 2012 TABLE OF CONTENTS INTRODUCTION... 2 Professional Financial Advice... 2 The Six-Step Process... 2 The Core Components...
University of Washington School of Pharmacy Care Definition, Practice Foundations, and Ability-Based Outcomes The pharmacist graduating from the University of Washington School of Pharmacy promotes the
Actuarial Standard of Practice No. 41 Actuarial Communications Revised Edition Developed by the General Committee of the Actuarial Standards Board Adopted by the Actuarial Standards Board December 2010
Medicals c i e n t i f i c study design risks medical-ethics review board 2 Table of contents M e d i c a l - s c i e n t i f i c study Preface 2 Introduction 4 Medical-scientific study 5 Why participate?
International Consortium for Harmonization of Clinical Laboratory Results Operating Procedures Approved: February 11, 2014 Background Results from clinical laboratory measurement procedures should be comparable
Cultural Competency Program Description and Annual Plan July 1, 2010 through June 30, 2011 Table of Contents Mission Statement... 1 Cultural Competency Program Description Introduction... 2 What is Cultural
CULMINATING PROJECT GUIDELINES Department of Educational Leadership and Interdisciplinary Studies Western Illinois University Macomb, IL 61455 Table of Contents Introduction 3 Culminating Project Completion
A private sector assessment combines quantitative and qualitative methods to increase knowledge about the private health sector. In the analytic phase, the team organizes and examines information amassed
The IAASB s Work Plan for 2015 2016 December 2014 International Auditing and Assurance Standards Board Work Plan for 2015 2016: Enhancing Audit Quality and Preparing for the Future This document was developed
DEVELOPMENT OF A QUALITY FRAMEWORK FOR THE MEDICARE BENEFITS SCHEDULE DISCUSSION PAPER This paper has been prepared by the Department of Health and Ageing (the Department) as a basis for further consultation
Guidance by the General Board on the arrangements for External Examiners Contents 1. Purpose... 2 2. Roles and responsibilities... 2 Setting and reviewing question papers... 2 Moderating examination scripts:...
REFLECTING ON EXPERIENCES OF THE TEACHER INDUCTION SCHEME September 2005 Myra A Pearson, Depute Registrar (Education) Dr Dean Robson, Professional Officer First Published 2005 The General Teaching Council
Pergamon Library Acquisitions: Practice & Theory, Vol. 22, No. 3, pp. 279 285, 1998 Copyright 1998 Elsevier Science Ltd Printed in the USA. All rights reserved 0364-6408/98 $19.00.00 PII S0364-6408(98)00082-9
CIHR Reviewers Guide for New Investigator Salary Awards October 2014 Table of Contents INTRODUCTION... 3 PEER REVIEW AT CIHR... 3 SUMMARY OF THE PEER REVIEW PROCESS... 3 STAGE 1: INDIVIDUAL REVIEW... 4
Annotated Bibliography Guidelines for Translating Surveys in Cross-Cultural Research Prepared by the Measurement and Methods Core of the Center for Aging in Diverse Communities, University of California
CFP Certification Global excellence in financial planning VISION STATEMENT To establish financial planning as a recognized profession through the promotion of excellence in financial planning for the benefit
Author's response to reviews Title:Online training course on critical appraisal for nurses: adaptation and assessment Authors: Eva Reviriego (firstname.lastname@example.org) María Ángeles Cidoncha (email@example.com)
PROGRAMMME SPECIFICATION FOR MA in LEADERSHIP AND MANAGEMENT (HEALTH AND SOCIAL CARE SERVICES) MA in LEADERSHIP AND MANAGEMENT (HEALTH AND SOCIAL CARE SERVICES) 1. Award 2. Route Management (Health and
INTERNATIONAL STANDARD ON ENGAGEMENTS 2410 OF INTERIM FINANCIAL INFORMATION PERFORMED BY THE INDEPENDENT AUDITOR OF THE ENTITY (Effective for reviews of interim financial information for periods beginning
Quality Assurance of Medical Appraisers Recruitment, training, support and review of medical appraisers in England www.revalidationsupport.nhs.uk Contents 1. Introduction 3 2. Purpose and overview 4 3.