We conducted two online surveys about antibiotics targeted at the Japanese general population in March 2017 and February 2018. In total, 6,982 participants completed the questionnaire. Factors associated with knowledge of antibiotics, knowledge of antimicrobial resistance (AMR) and appropriate behavioural changes were evaluated by a machine learning approach using DataRobot. Factors strongly associated with three dependent variables in the model were extracted based on permuation importance. We found that the strongest determinant of knowledge of antibiotics and AMR was education level. Knowledge of antibiotics was strongly associated with the frequency of internet use. Exposure to primary information was associated with motivation for appropriate behavioural changes. Improving the availability of primary information would be a beneficial intervention. Individuals lacking higher education and without opportunities to obtain primary information should be considered a target population for effective interventions.
Antimicrobial resistance (AMR) is currently one of the greatest threats to global health1,2. A year after the publication of the Global Action Plan on Antimicrobial Resistance in 20151, the Japanese government established a National Action Plan3. According to this plan, comprehensive countermeasures against AMR are needed, including educational activities for the general population.
The National Center for Global Health and Medicine in Japan established the AMR Clinical Reference Center as the main hub of information, educational activities and research related to AMR in Japan.
Some studies have evaluated the general population’s knowledge of antibiotics and AMR and related behaviours4,5,6,7,8,9,10. A systematic review has shown that the general population typically understands that excessive or unnecessary antibiotic use and the incompletion of antibiotic courses cause antibiotic resistance6. However, Kamata and colleagues have reported that a larger proportion of the Japanese general population demonstrates insufficient knowledge and inappropriate behaviours towards antibiotics and AMR than the general populations of European countries11. Therefore, providing sufficient information about AMR to the Japanese general population might be an important AMR countermeasure in the implementation of national health policy.
However, in the qualitative analysis by Kamata and colleagues, the factors associated with sufficient knowledge and appropriate behavioural changes towards antibiotics and AMR in Japan were not identified. An understanding of the precise determinants of sufficient knowledge and motivation for appropriate behavioural changes can provide a basis for the development of more effective interventions. In this study, we used a questionnaire-based approach to identify the key determinants of knowledge and behaviours related to antibiotics and AMR in Japan.
In total, 1,351 (19.3%) and 824 (11.8%) of participants demonstrated sufficient knowledge of antibiotics and AMR, respectively, and 447 (25.5%) showed motivation to make appropriate behavioural changes. The details and results of questions related to antibiotics, AMR, and beliefs and behaviours are available in Tables 1–3.
We generated three datasets from the original data with three partition types. For over 30 models, the fit was compared for each dependent variable (knowledge of antibiotics, knowledge of AMR, and behavioural change). We obtained the model with the largest AUC value for each dependent variable in each dataset, yielding nine models for three dependent variables.
The factor that was most strongly associated with knowledge of antibiotics and AMR was education level (permutation importance were 1.0 in all datasets for both). Knowledge of antibiotics was strongly associated with the frequency of internet use (permutation importance was 0.62, 0.49, and 0.35 in each dataset). Exposure to primary information was strongly associated with motivation to make appropriate behavioural changes (permutation importance was 1.0, 0.86, and 1.0 in each dataset). The details of the models and factors strongly associated with each dependent variable are shown in Tables 4 and 5. Besides, Figures 1–3 represent each variable’s partial dependence value. Partial dependence is an indicator which represents the marginal effect of features on the predicted outcome of a machine learning model after we have averaged out the influence of all other variables.
Details of the selected models are provided in Supplementary File S2.
This study provides the first evidence for an association between socioeconomic factors and sufficient knowledge of AMR in Japan. It should be noted that age is not consistently regarded as a determinant of sufficient knowledge, although several previous studies have reported that antibiotic use tends to be more frequent in older individuals than in relatively young individuals7. A few recent studies have reported an association between education level and knowledge of antibiotics and AMR10, which is consistent with our results. Therefore, targeted interventions based on education level might be more effective than existing interventions aimed at the general public as a whole. For example, educational programmes at primary schools such as e-Bug by Public Health England12,13 are promising.
Our results also showed that the source of information about antibiotics and AMR might play an important role in the knowledge level of the general public. In previous studies of sources of information about antibiotics and AMR14,15,16,17, the Internet has not been identified as an important source. These results highlight the importance of information source for the implementation of educational interventions targeting the general public.
Napolitano and colleagues pointed out that parents who do not refer to physicians as an information source tend to use antibiotics more frequently14. Hoffmann and colleagues reported that patients who obtain information from general practitioners are more informed about antibiotics and AMR than those who obtain information from other sources15. Additionally, that study showed that higher education level is more strongly associated with a higher score than information source. Those findings are compatible with our present results indicating that education level and exposure to primary information are strongly associated with the motivation for appropriate behavioural changes. These findings taken together show that exposure to primary information, especially information provided by healthcare professionals, may promote effective changes in antibiotic consumption.
However, internet use has not previously been linked to sufficient knowledge of antibiotics and AMR. One of our key findings was that frequent internet use is an independent factor for having sufficient knowledge about antibiotics; this seems to contradict previous findings that primary information is important for sufficient knowledge about AMR and appropriate behavioural changes. It is possible that the existence of antibiotics has become general knowledge and therefore the public can easily access information about antibiotics. However, the concept of AMR is relatively novel for the general public because only 3 years have passed since the National Action Plan was issued by the Japanese government. In addition, people who use the Internet frequently might have a higher sensitivity to information than those do not use the Internet and tend to search for new terms more frequently. As a result, internet-based information tends to present both advantages and disadvantages, and primary information from healthcare professionals becomes more reliable. Although further research about the effect of information source is needed, our data clearly indicate that the frequent provision of primary information would substantially improve the knowledge and behaviour of the general public.
This study has some strengths and limitations. One important strength that differentiates our analysis from previous studies is its methodology. DataRobot, which we used to conduct all analyses, can rapidly compare many model types. Accordingly, we can choose the optimal model among dozens of models and avoid arbitrariness in model selection. However, it is important to note that the AUC values of the models were relatively low, despite this strict model selection process. A larger number of variables is probably needed to explain the association of knowledge and behaviour with socioeconomic factors. In addition, the questionnaire was administered online. Therefore, respondents were internet literate and might represent a biased sample.
In conclusion, our results confirm the importance of education level in having sufficient knowledge of antibiotics and AMR. The use of primary information was strongly associated with both knowledge and behavioural changes, suggesting that the information source could be an important factor for improving the general public’s knowledge of AMR. Although our results should be interpreted with caution, they could help health policy decisionmakers conduct educational interventions directed at the general public.
A web-based questionnaire was developed to collect responses anonymously. When participants first visited the survey website, the policy for the use of the collected data and the protection of personal information was displayed. The details of the questionnaire are available as Supplementary File S1.
The online nationwide cross-sectional survey was conducted twice, in March 2017 and February 2018. The participants were selected among Japanese adults aged 20–69 years from a public panel in which 7.6 million people were registered by a research company (INTAGE Corporation). A total of 6,982 complete survey responses were obtained. Individuals aged 70 years or older were excluded owing to potential difficulties in responding to online surveys and to match the age criterion applied in a similar European study (20–69 years)4. In addition, the participants were selected to reflect the general population (based on the national population census of Japan in 2015) in terms of sex, age, place of residence and population size. Participant characteristics and their responses to other questions related to antibiotics and AMR are shown in Tables 6 and 7.
To examine factors associated with sufficient knowledge of antibiotics and AMR, data from all 6,982 respondents were used. To identify factors associated with appropriate behavioural changes, data from 2,962 respondents were used. The sample sizes differed because the questions addressing behavioural changes could only be answered by those who initially answered that their behaviour had changed.
Data preparation and pre-processing
Knowledge of antibiotics was determined based on four questionnaire items. Two or fewer correct answers indicated a lack of knowledge whereas three or more correct responses indicated sufficient knowledge.
Knowledge of AMR was determined based on the results of two questions. The first question consisted of two small questions that were considered correct only if both were answered correctly. The second question asked respondents about the causes of AMR, and comprised a multiple-choice question with six options, four of which were regarded as correct statements. The other two options were “Others” and “Do not know”. The former was excluded from the calculation of the number of correct answers because the correctness depends on precise responses. If the respondent selected “Do not know”, the number of correct answers was 0, regardless of other choices. Accordingly, the total number of correct answers ranged from 0 to 5. Respondents with two or fewer correct answers were regarded as lacking knowledge about AMR whereas those with three or more correct responses were regarded as having sufficient knowledge about AMR.
As for behavioural change after obtaining knowledge about AMR, respondents who indicated two or more behavioural changes among those who had the opportunity to obtain knowledge about AMR were regarded as changed their behaviour. The details of the question about behavioural change are available in Supplementary File S1.
Various pre-processing methods were automatically applied to the data. For categorical values, the pre-processing methods included ‘one-hot encoding’18 and ‘ordinary encoding’. For numerical values, ‘standardization’19, ‘constant splines’20, and ‘imputing missing values’21 were used.
Data were separated into training and validation sets. Cross-validation was used for model construction and evaluation. Five-fold cross validation was used, and the partitions were determined with stratified sampling. Each of the three types of partitions were obtained with different random seeds.
As an optimization metric, logarithmic loss was used.
Model building by machine learning
Models were created using the automated machine learning platform DataRobot. It was used to create over 40 models, including “blender models” obtained by using several machine learning algorithms. A blender model, sometimes referred to as an ensemble model, increases accuracy by combining the predictions of two or more models. The best model of all developed models was selected based on the largest area under the curve (AUC) value. All analyses were conducted on 4 December 2019. The details of variables included in each analysis are available in Table 8.
Factors were identified based on permutation importance22. Permutation importance measures how much worse a model would perform if DataRobot made predictions after randomly shuffling the elements in a given column (while leaving the other columns unchanged). DataRobot normalizes the scores by setting the value of the most important column to 1.
The influence of changes in values for each factor on the outcome was also evaluated based on partial dependence23. A partial dependence plot was generated to show the marginal effect of features on the predicted outcome of a machine learning model.
We conducted sensitivity analyses by multi-class classification approach. We classified all participants in accordance with the score each of them marked. This approach did not improve accuracy of precision substantially in view of AUC value then we deployed the original approach as our main results. The details of sensitivity analyses are available in Supplementary File S3.
This research was approved by the institutional ethical review board of the National Center for Global Health and Medicine, Tokyo, Japan and was conducted in accordance with the approved guidelines.
The first and the corresponding author (ST) affirms that this manuscript is an honest, accurate, and transparent account of the study; that no important aspects of the study have been omitted; and that any discrepancies from the study as planned (and, if relevant, registered) have been explained.
World Health Organization. WHO | Global action plan on antimicrobial resistance, http://www.who.int/antimicrobial-resistance/publications/global-action-plan/en/.
European Commission. A European one health action plan against antimicrobial resitance (AMR), https://ec.europa.eu/health/amr/sites/amr/files/amr_action_plan_2017_en.pdf (2017).
The Government of Japan. National Action Plan on Antimicrobial Resistance (AMR) 2016–2020. (2016).
TNS Opinion & Social. Special Eurobarometer 445: Antimicrobial Resistance.
McNulty, C. A. M., Boyle, P., Nichols, T., Clappison, P. & Davey, P. The public’s attitudes to and compliance with antibiotics. J. Antimicrob. Chemother. 60(Suppl 1), i63–68 (2007).
McCullough, A. R., Parekh, S., Rathbone, J., Del Mar, C. B. & Hoffmann, T. C. A systematic review of the public’s knowledge and beliefs about antibiotic resistance. J Antimicrob Chemother 71, 27–33 (2016).
McKay, R., Mah, A., Law, M. R., McGrail, K. & Patrick, D. M. Systematic Review of Factors Associated with Antibiotic Prescribing for Respiratory Tract Infections. Antimicrob. Agents Chemother. 60, 4106–4118 (2016).
Mazińska, B., Strużycka, I. & Hryniewicz, W. Surveys of public knowledge and attitudes with regard to antibiotics in Poland: Did the European Antibiotic Awareness Day campaigns change attitudes? PLOS ONE 12, e0172146 (2017).
Schneider, S. et al. Perceptions and attitudes regarding antibiotic resistance in Germany: a cross-sectoral survey amongst physicians, veterinarians, farmers and the general public. Journal of Antimicrobial Chemotherapy 73, 1984–1988 (2018).
Waaseth, M. et al. Knowledge of antibiotics and antibiotic resistance among Norwegian pharmacy customers – a cross-sectional study. BMC Public Health 19, 66 (2019).
Kamata, K., Tokuda, Y., Gu, Y., Ohmagari, N. & Yanagihara, K. Public knowledge and perception about antimicrobials and antimicrobial resistance in Japan: A national questionnaire survey in 2017. PLOS ONE 13, e0207017 (2018).
McNulty, C. A. M. et al. Overview of e-Bug: an antibiotic and hygiene educational resource for schools. J. Antimicrob. Chemother. 66(Suppl 5), v3–12 (2011).
Eley, C. V., Young, V. L., Hayes, C. V., Verlander, N. Q. & McNulty, C. A. M. Young People’s Knowledge of Antibiotics and Vaccinations and Increasing This Knowledge Through Gaming: Mixed-Methods Study Using e-Bug. JMIR Serious Games 7, e10915 (2019).
Napolitano, F., Izzo, M. T., Di Giuseppe, G. & Angelillo, I. F. Public knowledge, attitudes, and experience regarding the use of antibiotics in Italy. PLoS ONE 8, e84177 (2013).
Hoffmann, K., Ristl, R., Heschl, L., Stelzer, D. & Maier, M. Antibiotics and their effects: what do patients know and what is their source of information? Eur J Public Health 24, 502–507 (2014).
Zajmi, D. et al. Public knowledge, attitudes and practices regarding antibiotic use in Kosovo. Pharm Pract (Granada) 15, 827 (2017).
Zucco, R. et al. Internet and social media use for antibiotic-related information seeking: Findings from a survey among adult population in Italy. Int J Med Inform 111, 131–139 (2018).
Suits, D. B. Use of Dummy Variables in Regression Equations. Journal of the American Statistical Association 52, 548–551 (1957).
Marquardt, D. W. Comment. Journal of the American Statistical Association 75, 87–91 (1980).
Gelman, A. & Park, D. K. Splitting a Predictor at the Upper Quarter or Third and the Lower Quarter or Third. The American Statistician 63, 1 (2009).
Acuña, E. & Rodriguez, C. The Treatment of Missing Values and its Effect on Classifier Accuracy. In Classification, Clustering, and Data Mining Applications (eds. Banks, D., McMorris, F. R., Arabie, P. & Gaul, W.) 639–647, https://doi.org/10.1007/978-3-642-17103-1_60 (Springer, 2004).
Breiman, L. Random Forests. Machine Learning 45, 5–32 (2001).
Friedman, J. H. Greedy function approximation: A gradient boosting machine. Ann. Statist. 29, 1189–1232 (2001).
We thank all of the participants who completed the questionnaire survey. This study was funded by a Grant-in-Aid by the Ministry of Health, Labour and Welfare, Japan (Grant number H29 shinkougyousei shitei 005). The funding body played no role in the study design, data collection and analysis, the decision to publish, or preparation of the manuscript.
SI is a staff member of DataRobot Japan. N.F. and K.H. are staff members of NTT data, which is a marketing partner of DataRobot. All the other authors have no conflicts of interest to declare.
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Tsuzuki, S., Fujitsuka, N., Horiuchi, K. et al. Factors associated with sufficient knowledge of antibiotics and antimicrobial resistance in the Japanese general population. Sci Rep 10, 3502 (2020). https://doi.org/10.1038/s41598-020-60444-1
BioData Mining (2021)
Impact of national guidelines for antimicrobial stewardship to reduce antibiotic use in upper respiratory tract infection and gastroenteritis
Infection Control & Hospital Epidemiology (2021)
Antimicrobial stewardship programs: perceptions and practices among Jordanian healthcare practitioners
Journal of Pharmaceutical Health Services Research (2021)
Last Call for Replacement of Antimicrobials in Animal Production: Modern Challenges, Opportunities, and Potential Solutions
Improved penicillin susceptibility of Streptococcus pneumoniae and increased penicillin consumption in Japan, 2013–18
PLOS ONE (2020)