Abstract: This study compares the effectiveness of simulation-based and traditional counter-Improvised Explosive Device (IED) training methods in the Australian Army. Participants were 16 enlisted personnel from the Royal Australian Corps of Transport who took part in simulation-based training using Virtual Battlespace 2 (VBS2) and conventional Rehearsal of Concept (ROC) drill training. Usability and training effectiveness of each were assessed through a mixture of qualitative and quantitative measures. Participants’ performance in a field exercise following training was also analysed. Results showed significant differences between levels of self-efficacy in VBS2 and ROC drill, and qualitative data indicated that participants perceived the value and training benefit of both methods. The implications for use of simulation-based training, challenges of conducting experimentation in conjunction with military training courses, and recommendations for future research are discussed.