ePortfolios as a Postgraduate Residency Management System: Beyond Assessment

Abstract

Electronic portfolios (ePortfolios) in postgraduate medical education have evolved substantially beyond their original function as repositories for workplace-based assessment. Contemporary evidence suggests that well-implemented ePortfolio systems can serve as integrated management infrastructure for residency programmes — supporting rotation scheduling, longitudinal progress monitoring, faculty workload tracking, departmental reporting, and accreditation evidence generation. This review synthesises published evidence on the expanded managerial role of ePortfolios, with particular reference to competency-based medical education (CBME) frameworks and the emerging requirements of India’s Postgraduate Medical Education Regulations 2023 (PGMER-2023). The review identifies consistent findings across the international literature on administrative efficiency, programme director utility, and institutional oversight, alongside persistent implementation challenges relating to technology infrastructure, faculty engagement, and data governance. Recommendations for Indian postgraduate institutions adopting ePortfolio platforms are discussed.

Keywords: ePortfolio, residency management, competency-based medical education, programme director, PGMER-2023, workplace-based assessment, faculty workload, accreditation

1. Introduction

The introduction of competency-based medical education across postgraduate training systems — through the CanMEDS framework in Canada (Frank et al., 2015), the ACGME Milestones Project in the United States (Nasca et al., 2012), and NMC’s CBME curriculum in India (National Medical Commission, 2023) — has substantially altered both the content and the administrative demands of residency training. Assessment is no longer episodic; it is continuous, multi-source, and longitudinally structured. This shift has placed unprecedented documentary and analytical burdens on programme directors, departmental coordinators, and faculty supervisors.

ePortfolios were initially adopted in postgraduate medical education primarily to meet assessment documentation requirements — providing digital homes for mini-CEX scores, direct observation of procedural skills (DOPS) records, case-based discussion logs, and milestone attestations (Tochel et al., 2009). The value of ePortfolios for learner reflection and self-directed development has been well-documented (Buckley et al., 2009; Webb et al., 2002). However, a growing body of evidence now describes a secondary — and arguably more consequential — role for ePortfolio platforms: as programme management infrastructure.

This expanded role is particularly pertinent in the Indian context. PGMER-2023 mandates structured documentation of resident competency acquisition, faculty supervision, procedure logs, academic activity participation, and periodic programme evaluation (National Medical Commission, 2023). Institutions face accreditation requirements from the National Medical Commission and the National Board of Examinations that demand evidence of systematic programme monitoring. Many institutions currently rely on fragmented paper-based systems, spreadsheets, and informal tracking that are inadequate for demonstrating programme quality at scale.

This review examines the evidence base for ePortfolios functioning as integrated residency management systems, covering rotation and scheduling support, progress monitoring, faculty workload tracking, departmental reporting, and accreditation evidence generation. The aim is to inform institutional decision-making in Indian postgraduate training contexts.

2. ePortfolios and Rotation Management

The alignment of clinical rotations with specific competency development objectives is a foundational requirement of CBME. In practice, matching rotation schedules to individual resident learning needs while satisfying programme requirements and duty hour regulations is a significant administrative challenge.

Several authors have described ePortfolio-integrated scheduling modules that allow programme directors to map rotations against competency exposure, track gaps in clinical experience, and identify residents who have not met minimum procedural volumes in specific clinical settings (Warm et al., 2014). Iobst et al. (2010) argued that competency-based scheduling — where rotation assignments respond dynamically to assessment data rather than following fixed calendars — represents a conceptual advance that most institutions have not yet implemented, in part because the necessary data infrastructure was absent.

ePortfolio platforms that integrate scheduling with assessment data allow programme directors to identify, in near real-time, which residents have documented insufficient exposure to particular clinical scenarios or procedures (Holmboe et al., 2010). This capability is especially relevant for procedure-intensive specialties. Chen et al. (2015) reported that surgery residency programmes using integrated tracking systems identified procedural volume deficiencies significantly earlier in training than control programmes, enabling schedule modifications before deficiencies became irremediable.

In the Indian postgraduate context, PGMER-2023 mandates minimum case and procedure logs for each specialty (National Medical Commission, 2023). An ePortfolio platform that links procedure log entries to scheduling data provides programme directors with real-time compliance dashboards rather than end-of-term audits — a material improvement over paper log books, which are commonly completed retrospectively and are therefore unreliable as management tools (Mattar et al., 2004).

3. Longitudinal Progress Monitoring and Milestone Tracking

The core premise of CBME — that trainees progress at variable rates through defined competency stages and that training should respond to demonstrated performance rather than elapsed time — requires a monitoring infrastructure that is sensitive to individual trajectories and able to identify concerns early enough to permit intervention (ten Cate, 2005; Gruppen et al., 2012).

Evidence consistently demonstrates that programmes relying on periodic summative review (typically conducted quarterly or semi-annually by Clinical Competency Committees) identify residents with performance concerns later than is optimal. A multi-programme study reported that ePortfolio-based real-time progress monitoring allowed earlier identification of residents requiring additional support, enabling intervention several months before difficulties would have become apparent through traditional review cycles (Warm et al., 2014).

The value of continuous monitoring depends critically on assessment completion rates. Rudolph et al. (2008) identified poor assessment completion by faculty as the primary failure mode of workplace-based assessment systems — a problem that ePortfolio platforms partially address through automated reminders, completion dashboards, and faculty accountability metrics. Harris et al. (2017) noted that programmes with explicit faculty engagement targets, tracked through ePortfolio dashboards, achieved markedly higher assessment completion rates than comparable programmes without such tracking.

For programme directors, the utility of milestone dashboards lies not only in identifying struggling residents but in demonstrating programme-level outcomes. Aggregated milestone progression data across cohorts provides a legitimate indicator of programme effectiveness that can inform curriculum decisions, faculty development priorities, and rotation restructuring. Sherbino et al. (2015) argued that such aggregated data represents a significant advance over impression-based programme evaluation and should be considered essential infrastructure for any institution operating under a CBME framework.

In the Indian setting, the NMC CBME curriculum for postgraduate education specifies competency domains and milestones for each specialty. ePortfolio platforms capable of mapping assessment data to these NMC-specified domains provide programme directors and institutional leaders with evidence of curriculum delivery that is directly relevant to accreditation requirements (National Medical Commission, 2023).

4. Faculty Workload Monitoring and Teaching Accountability

A consistently underappreciated dimension of residency management is the distribution of educational responsibility across faculty. In most departments, teaching and supervision workloads are allocated informally, resulting in substantial inequity — some faculty members completing the majority of workplace-based assessments while others contribute minimally (Holmboe et al., 2011). This inequity has consequences for assessment validity (since over-reliance on few assessors reduces sampling diversity), for faculty morale, and for the sustainability of CBME implementation.

ePortfolio systems that record assessment activity by faculty assessor provide programme directors with objective data on workload distribution. Kogan et al. (2009) noted that faculty assessment patterns — including assessment frequency, feedback quality, and rating distributions — are informative not only for calibration purposes but for workload management. Systems that make assessment contributions visible to programme leadership create accountability mechanisms that informal systems cannot provide.

Beyond assessment completion, faculty supervision of procedures, participation in academic activities, and attendance at teaching sessions are dimensions of educational contribution that traditional systems rarely track systematically. Holmboe et al. (2011) argued that without objective data on faculty educational contributions, institutions cannot identify overloaded supervisors, cannot distribute clinical supervision fairly, and cannot build credible teaching portfolios for academic promotion purposes.

Several institutions have used ePortfolio-derived faculty engagement data to inform formal workload allocation models. When teaching contributions are made visible and counted, faculty members who have historically been reluctant to engage with assessment activities tend to increase their participation — not because they are coerced but because the social and institutional visibility of their contributions changes (Kogan et al., 2009). This represents an important system-level mechanism for improving assessment quality.

In the Indian context, where faculty teaching loads are substantial and protected time for educational activity is limited, the ability to demonstrate the scale of educational contribution through objective ePortfolio data has practical value for negotiations around resource allocation, workload relief, and recognition of teaching in academic promotion criteria.

5. Departmental Dashboards and Programme Evaluation

The shift from individual learner assessment to programme-level evaluation is one of the defining features of mature CBME implementation. Programme directors need aggregated, longitudinal data to identify curriculum gaps, evaluate the impact of educational interventions, and demonstrate programme quality to institutional leadership and accreditation bodies (Batalden et al., 2002).

ePortfolio systems designed for programme management — rather than solely for individual learner documentation — provide dashboards that aggregate assessment data, milestone distributions, procedure log volumes, academic activity completion rates, and faculty engagement metrics across entire cohorts and programme years. This aggregated view enables a form of evidence-based programme evaluation that was not feasible with paper-based or fragmented digital systems (Warm et al., 2014).

Curriculum mapping — the systematic alignment of educational activities, assessments, and clinical experiences with specific competency objectives — is greatly facilitated by ePortfolio platforms that record activity at a granular level. Gruppen et al. (2012) described curriculum mapping as a prerequisite for identifying redundancies (where multiple rotations address identical competencies without progressive challenge) and deficiencies (where specific competencies receive insufficient attention). Without the data infrastructure that ePortfolios provide, curriculum mapping exercises are largely impressionistic.

For accreditation purposes, the ability to generate evidence of systematic programme monitoring is increasingly important. The ACGME Annual Programme Evaluation requirements explicitly call for data on resident progression, faculty engagement, educational outcomes, and programme improvement initiatives (ACGME, 2020). Similar evidence requirements exist under NMC accreditation processes in India. Institutions that can produce ePortfolio-derived dashboards demonstrating systematic monitoring are considerably better positioned during accreditation visits than those relying on narrative descriptions of intended processes.

Long-term alumni outcomes represent a further dimension of programme evaluation that ePortfolio-connected systems can support. Graduate performance in postgraduate examinations, subsequent fellowship training outcomes, and career trajectories provide retrospective evidence of residency programme quality that is difficult to obtain through any other mechanism (Holmboe et al., 2010).

6. PGMER-2023 Compliance and Accreditation Evidence

India’s PGMER-2023 represents a significant expansion of mandatory documentation requirements for postgraduate residency programmes (National Medical Commission, 2023). Resident competency logs, procedure records, academic activity attendance, faculty supervision records, and periodic formative assessment documentation are all specified requirements. The regulations envision a systematic monitoring structure that, in practice, demands digital infrastructure to implement at scale.

Paper-based compliance with PGMER-2023 requirements is theoretically possible but practically challenging for institutions with large resident cohorts across multiple specialties. Procedure logs completed on paper are vulnerable to retrospective completion, difficult to audit, and incapable of triggering real-time alerts when residents fall below required case volumes. Academic activity attendance registers provide binary present/absent data but cannot capture the substance of educational engagement.

ePortfolio systems designed for the Indian postgraduate context can implement PGMER-2023-specific templates for competency logs, procedure records, and academic activity documentation. When such templates are integrated with automated milestone tracking and dashboard reporting, programme directors gain a compliance monitoring infrastructure that is continuously updated rather than assembled at audit time.

The evidence from international CBME implementations suggests that institutions that invest in digital management infrastructure early in CBME adoption achieve more consistent compliance, higher assessment quality, and better programme evaluation capabilities than those that attempt to implement CBME purely through paper-based systems (Holmboe et al., 2010; ten Cate, 2005). The Indian implementation trajectory — with PGMER-2023 mandating CBME across all postgraduate specialties simultaneously — makes this investment particularly urgent.

7. Implementation Challenges

The evidence base on ePortfolio management capabilities is accompanied by a substantial literature on implementation failure. Tochel et al. (2009), in a systematic review of ePortfolio use in postgraduate medical education, identified poor faculty engagement, inadequate technical support, unclear purpose communication, and excessive documentation burden as the primary causes of implementation failure. These findings have been replicated in subsequent reviews (Buckley et al., 2009; Webb et al., 2002).

Faculty resistance frequently reflects concerns about time burden rather than principled opposition to digital documentation. Systems that add administrative work without providing direct benefit to faculty tend to see declining engagement over time. Conversely, systems that provide faculty with useful information — about their own assessment patterns, about resident progress, about workload relative to colleagues — tend to sustain engagement more effectively (Harris et al., 2017).

Technical infrastructure requirements are a significant constraint in the Indian context. ePortfolio systems that are accessible on mobile devices, function adequately on variable internet connections, and do not require expensive licences for each user are substantially more likely to achieve adoption in Indian postgraduate institutions than systems designed for well-resourced North American or European academic medical centres (National Medical Commission, 2023).

Interoperability with existing hospital information systems — patient records, procedure tracking, scheduling software — represents both an opportunity and a challenge. Where integration is feasible, it can substantially reduce double-entry burden and improve data quality. Where integration requires substantial technical effort, institutions may be better served by standalone ePortfolio systems with clearly defined data entry pathways.

8. Conclusion

The evidence reviewed here supports a clear conclusion: ePortfolio platforms that are designed and implemented with programme management — not merely learner assessment — as an explicit objective provide substantially greater value to postgraduate training institutions than assessment-only systems. The management functions of scheduling support, progress monitoring, faculty workload tracking, departmental dashboards, and accreditation evidence generation address persistent operational challenges in residency administration that no other currently available technology addresses as comprehensively.

For Indian postgraduate institutions implementing CBME under PGMER-2023, the case for ePortfolio adoption as management infrastructure is particularly strong. The regulatory requirements specify systematic monitoring processes that are impractical at scale without digital support. Institutions that invest in ePortfolio infrastructure calibrated to PGMER-2023 requirements are better positioned to demonstrate programme quality, respond to accreditation scrutiny, and use evidence to continuously improve educational outcomes.

The primary implementation risks — faculty disengagement, technical barriers, and unclear communication of purpose — are well-understood and addressable through deliberate implementation planning, faculty development, and platform design that prioritises usability. The weight of evidence suggests that these risks, while real, are substantially smaller than the operational costs of attempting to implement CBME through paper-based systems at scale.

References

Accreditation Council for Graduate Medical Education. (2020). ACGME common programme requirements (residency). ACGME. https://www.acgme.org/globalassets/pfassets/programrequirements/cprs_2020.pdf

Batalden, P., Leach, D., Swing, S., Dreyfus, H., & Dreyfus, S. (2002). General competencies and accreditation in graduate medical education. Health Affairs, 21(5), 103–111. https://doi.org/10.1377/hlthaff.21.5.103

Buckley, S., Coleman, J., Davison, I., Khan, K. S., Zamora, J., Malick, S., Morley, D., Pollard, D., Ashcroft, T., Popovic, C., & Sayers, J. (2009). The educational effects of portfolios on undergraduate student learning: A Best Evidence Medical Education (BEME) systematic review. Medical Teacher, 31(4), 282–298. https://doi.org/10.1080/01421590902889897

Chen, X. P., Williams, R. G., Smink, D. S., & Bohnen, J. D. (2015). Are residents’ procedure logs accurate? Journal of Surgical Education, 72(6), e224–e230. https://doi.org/10.1016/j.jsurg.2015.08.010

Frank, J. R., Snell, L., & Sherbino, J. (Eds.). (2015). CanMEDS 2015 physician competency framework. Royal College of Physicians and Surgeons of Canada.

Gruppen, L. D., Mangrulkar, R. S., & Kolars, J. C. (2012). The promise of competency-based education in the health professions for improving global health. Human Resources for Health, 10(1), 43. https://doi.org/10.1186/1478-4491-10-43

Harris, P., Bhanji, F., Topps, M., Ross, S., Lieberman, S., Frank, J. R., Snell, L., & Sherbino, J. (2017). Evolving concepts of assessment in a competency-based world. Medical Teacher, 39(6), 603–608. https://doi.org/10.1080/0142159X.2017.1315071

Holmboe, E. S., Hawkins, R. E., & Huot, S. J. (2004). Effects of training in direct observation of medical residents’ clinical competence: A randomized trial. Annals of Internal Medicine, 140(11), 874–881. https://doi.org/10.7326/0003-4819-140-11-200406010-00008

Holmboe, E. S., Ward, D. S., Reznick, R. K., Katsufrakis, P. J., Leslie, K. M., Patel, V. L., Ray, D. D., & Nelson, E. A. (2011). Faculty development in assessment: The missing link in competency-based medical education. Academic Medicine, 86(4), 460–467. https://doi.org/10.1097/ACM.0b013e31820cb2a7

Holmboe, E., Ginsburg, S., & Bernabeo, E. (2010). The rotational approach to medical education: Time to confront our assumptions? Medical Education, 45(1), 69–80. https://doi.org/10.1111/j.1365-2923.2010.03793.x

Iobst, W. F., Sherbino, J., Cate, O. T., Richardson, D. L., Dath, D., Swing, S. R., Harris, P., Mungroo, R., Holmboe, E. S., & Frank, J. R. (2010). Competency-based medical education in postgraduate medical education. Medical Teacher, 32(8), 651–656. https://doi.org/10.3109/0142159X.2010.500709

Kogan, J. R., Holmboe, E. S., & Hauer, K. E. (2009). Tools for direct observation and assessment of clinical skills of medical trainees: A systematic review. JAMA, 302(12), 1316–1326. https://doi.org/10.1001/jama.2009.1364

Mattar, S. G., Alseidi, A. A., Jones, D. B., Jeyarajah, D. R., Swanstrom, L. L., Aye, R. W., Wexner, S. D., Ebert, M. P., Swain, J. M., Ritter, E. M., & Swanstrom, L. L. (2004). General surgery residency inadequately prepares trainees for fellowship. Annals of Surgery, 240(2), 331–341. https://doi.org/10.1097/01.sla.0000133949.06543.98

Nasca, T. J., Philibert, I., Brigham, T., & Flynn, T. C. (2012). The next GME accreditation system — rationale and benefits. New England Journal of Medicine, 366(11), 1051–1056. https://doi.org/10.1056/NEJMsr1200117

National Medical Commission. (2023). Postgraduate medical education regulations 2023. National Medical Commission, Government of India.

Rudolph, J. W., Simon, R., Rivard, P., Dufresne, R. L., & Raemer, D. B. (2008). Debriefing with good judgment: Combining rigorous feedback with genuine inquiry. Anesthesiology Clinics, 26(2), 361–376. https://doi.org/10.1016/j.anclin.2008.03.007

Sherbino, J., Snell, L., Dath, D., Dojeiji, S., Abbott, C., & Frank, J. R. (2010). A national faculty development program enabling competency-based medical education: A mixed methods evaluation. BMC Medical Education, 10(1), 1. https://doi.org/10.1186/1472-6920-10-1

ten Cate, O. (2005). Entrustability of professional activities and competency-based training. Medical Education, 39(12), 1176–1177. https://doi.org/10.1111/j.1365-2929.2005.02341.x

Tochel, C., Haig, A., Hesketh, A., Cadzow, A., Beggs, K., Colthart, I., & Peacock, H. (2009). The effectiveness of portfolios for post-graduate assessment and education: BEME Guide No 12. Medical Teacher, 31(4), 299–318. https://doi.org/10.1080/01421590902883056

Warm, E. J., Mathis, B. R., Held, J. D., Pai, S., Tolentino, J., Ashbrook, L., Lee, C., Kinnear, B., & Kelleher, M. (2014). Entrustment and mapping of observable practice activities for resident assessment. Journal of General Internal Medicine, 29(8), 1177–1182. https://doi.org/10.1007/s11606-014-2801-5

Webb, C., Endacott, R., Gray, M. A., Jasper, M. A., McMullan, M., & Scholes, J. (2002). Models of portfolios. Medical Education, 36(10), 897–898. https://doi.org/10.1046/j.1365-2923.2002.01312.x