For each thematic area, recommendations were made based on data obtained from each systematic review of Delphi methods, in order to reach consensus among the members of the expert group. The Delphi process is a ”systematic method of collecting and aggregating informed judgments of an expert group on specific issues and issues,” based on the assumption that group judgments are more appropriate than individual judgments (Reid, 1993). Delphi methods improve the development of recommendations by an informed organization while reducing the disadvantages of collective decision-making (Jones and Hunter, 2000). Subsequent consensus in the Delphi process also provides evidence of their simultaneous validity, as participants have components that are both recognized and agreed upon, validated by real-world experts (Cross, 1999; Williams and Webb, 1994). The Delphi process is an asset in that it offers the opportunity to gather a broader set of information while allowing for an exchange of views and to learn from each other`s points of view, without factors that could cause affections such as academic hierarchy and reputation. The interretatric reliability of the health equity plausibility algorithm was assessed by the recruitment of methodologists, clinicians and users of systematic evaluations to apply the health justice calculation algorithm to a sample of 10 systematic controls. 35 interviewees (methodologists, clinicians and users of systematic evaluations) were recruited by aspiring members of the Cochrane Collaboration who participated in the 2009 annual symposium. Respondents were asked to assess the probability of differences for two progress plus elements: 1) Sex: female vs. male and 2) low socio-economic status in relation to high socio-economic status on the basis of the survey (Additional File 1: Appendix 2). Seventeen of the evaluations with an inter-rate agreement of more than 70% (17/32; 53%) applicability assessments described by the authors of the systematic reviews).
For example, differences in incidence due to patient characteristics (question 1) on the control of tobacco use in the population beyond socio-economic status were considered probable, supported by the findings of the systematic review that price control is more effective for low-income groups . This study highlights the need to develop, evaluate and promote structured methods to take into account applicability to affected population groups in systematic controls. Lower Kappa suggests that a depth of content and stakeholder expertise after J.C. is needed through systematic teams of verification authors in decision-making. The results also indicate the need to improve the clarity of issues that should help users conduct systematic assessments. In the design and design of primary research studies and studies, consideration should be given to whether there are expected and plausible differences between population groups, such as gender, with appropriate methods such as stratification and pre-planned subgroup analysis. Campbell and Cochrane Equity Methods Group conducts methodological research on methods such as the use of logical models, subgroup analyses, applicability judgments and process evaluations as tools for assessing the plausibility of health effects . Five evaluators (JB, RK, WDB, JS, JanHo), dazzled by the results of the study, evaluated the generalization of each study independently and in duplicate. In the absence of empirical evidence of the relative significance of each article, we used a sequential approach to medical decision-making21 to explain the weighting of each element (see Appendix 2 for a detailed description). This approach facilitated judgments on global generalization (i.e. ”generalized,” ”probably generalized,” ”probably non-generalized” and ”non-generalized”). We calculated the agreement of the reviewers in the general classification with Kendalls W