Inter- and Intra-Rater Reliability of Physician Assessments of Artificial Intelligence-Generated Female Gluteal Esthetic Images

Authors

  • Edoardo Raposio
  • Elisa Bertulla

DOI:

https://doi.org/10.14740/psam3

Keywords:

Generative artificial intelligence, Female profile, Female beauty, Butt contouring, Butt beauty, Female esthetics, Butt esthetics

Abstract

Background: Generative artificial intelligence (genAI) can produce idealized body-contour images, but their esthetic interpretation and suitability as reference stimuli require critical evaluation. We examined physician ratings of synthetic female gluteal images.

Methods: Sixty distinct genAI-generated images were evaluated by 16 physicians (eight board-certified plastic surgeons and eight plastic surgery residents). Six images were repeated as concealed duplicates, yielding 66 presentations per physician and 1,056 image-level evaluations. Eight esthetic domains, an ideality classification, and image-quality flags were recorded.

Results: Mean esthetic-domain scores ranged from 6.09 to 6.34 on the stated seven-category scale, suggesting possible ceiling effects. The mean-of-16-rater intraclass correlation coefficient (ICC, 2, 16) estimates ranged from 0.586 to 0.805, with domain-specific estimates and confidence intervals (CIs) requiring confirmation from the source dataset. Of 1,056 ideality responses, 693 (65.6%) were Yes, 159 (15.1%) Borderline, and 204 (19.3%) No. Duplicate-stimulus ratings showed a mean absolute difference of 0.46 points, 60.6% exact agreement, and 93.6% agreement within one point.

Conclusion: Physicians frequently rated these AI-generated images favorably, but single-rater agreement, high score concentration, and image-standardization concerns limit interpretation. The present results address rating agreement and repeatability, not the reproducibility of the generator or clinical validity of the images. Prospective validation is required before use as surgical or medico-legal reference standards.

Author Biography

  • Edoardo Raposio, DISC, University of Genova; AOM - IRCCS Ospedale Policlinico San Martino

    Plastic Surgery Chair, Department of Surgical Sciences and Integrated Diagnostics (DISC), University of Genova, Italy

Published

2026-11-12

Issue

Section

Original Article

How to Cite

1.
Raposio E, Bertulla E. Inter- and Intra-Rater Reliability of Physician Assessments of Artificial Intelligence-Generated Female Gluteal Esthetic Images. Plast Surg Aesthet Med. 2026;1:e3. doi:10.14740/psam3