Dr Keith Joiner

Senior Lecturer in Test and Evaluation, Aircraft Systems
School of Engineering and Information Technology
UNSW Canberra Cyber
Capability Systems Centre
+61 2 6268 8168


UNSW University College at Australian Defence Academy, Building 21, Room 363


Dr Keith Joiner, CSC, PhD, MSc, MMgmt, BEng(Aero), CPPD, CPEng, MAIPM, MIEAust

Dr Joiner joined the Air Force in 1985 and became an aeronautical engineer, project manager and teacher over a 30 year career before joining the University of New South Wales in 2015 as a senior lecturer in test and evaluation. From 2010 to 2014 he was the Director-General of Test and Evaluation for the Australian Defence Force where he was awarded a Conspicuous Service Cross. He was responsible for Defence-wide test and evaluation policy, ensuring all new capability submissions to Government had test plans, for conducting trials on all proposed new capabilities (prototypes and off-the-shelf), and operational field evaluations for new Army and joint capabilities. During his tenure in this role he testified to the Senate Inquiry into Defence Procurement (2012) and was tasked by the Service Chiefs with developing and implementing new reforms in test and evaluation. Dr Joiner has completed a number of post-graduate degrees including a Masters of Science in Aerospace Systems Engineering with distinction through Loughborough University in the United Kingdom, a PhD in Calculus Education and a Masters of Management. In previous roles he was a design engineer for aircraft and missiles, a project engineering manager, a chief engineer for several aircraft types, and a base commander for an airfield and domestic infrastructure. In 2009 he did wartime service as a plans officer in Baghdad for the Multi-National Force Iraq where he was awarded a United States Meritorious Service Medal for his work developing drawdown plans. He is a Certified Practising Engineer with the Institute of Engineers Australia and a Certified Practising Project Director with the Australian Institute of Project Management. In all his roles he has worked extensively with Defence scientists, sponsoring, conducting and trialling experiments and research including recent important human factors and anthropometric work for future submarines and combat vehicles.

Research Interests: Dr Joiner has been actively teaching and researching the use of new more efficient and effective test design and test analyses statistical methods in fields as diverse as explosive ordnance proofing, electronic warfare, target recognition and cyber-security. Methods used include design-of-experiments, high throughput testing (combinatorial), historical data analysis, logistics regression and ordinal regression to efficiently build probabilistic multi-factor regression models of systems, either very early in acquisition to de-risk project scoping and requirements, or towards the end of acquisition for operational characterisation to create flexible force modelling and live, virtual and constructive simulation of the "force-in-being". Dr Joiner is also teaching and conducted research on project governance frameworks especially within Defence contexts in the areas of: 1) integration, interoperability and information (I3) assurance; 2) digital transformation; 3) ICT projects; 4) preview test and evaluation (i.e., pre-contract de-risk trialling); and 5) cyber-resilience. His primary PhD is in teaching research and so he also conducts research into curriculum reform in higher education, especially into classroom environments, inclusive curricula methods, and the benefits of structured peer review in post-graduate teaching. 

New Students: Having only changed careers recently into academia, Dr Joiner is keen for higher degree by research students, especially, but not limited to, Defence or other complex systems fields involving prescribed acquisition, testing, evaluation, modelling and simulation, such as health, infrastructure, ICT or transportation. He is keen to work with new PhD students and their companies to do 'in-the-workplace' research on testing and governance frameworks; that is, with sponsored part-time PhD students. By the nature of such research, students would need to be domestic (i.e., Australian), or work mostly in Australia with an international firm that has an Australian footprint. Within Defence, transportation and mining, he is interested in teaching and researching test design methods for autonomous and robotic systems, while inside Government and critical Australian financial or civil infrastructure, he is interested in researching new test methods for cyber-resilience. In summary, he can take HDR students in engineering test design and analyses, project governance, or engineering/technology education across a broad range of applications.


Book Chapters

Ghildyal A; Ru D; Chang E; Joiner K; Saberi M; Despande A, 2021, 'Conceptual Framework for Measuring Project Benefits Using Belief—Plausibility and Type 1 Fuzzy Inference System', in Studies in Fuzziness and Soft Computing, pp. 243 - 256, http://dx.doi.org/10.1007/978-3-030-47124-8_20

Joiner KF, 2021, 'Securing the Cyberspace Dimension of Large Events (accepted)', in Dietz JE; Black DR (ed.), Large Event Security Planning and Emergency Management (pending), Routledge, U.S.

Jnitova V; Efatmaneshnik M; Joiner K; Chang E, 2020, 'Improving Enterprise Resilience by Evaluating Training System Architecture: Method Selection for Australian Defence (accepted)', in Handley H; Tolk A (ed.), A Framework for Human System Engineering Applications and Case Studies, IEEE Press

Yaxley KJ; Joiner K; Abbass H; Bogais J, 2020, 'Life-learning of smart autonomous systems for meaningful human-autonomy teaming (accepted)', in Handley H; Tolk A (ed.), A Framework for Human System Engineering Applications and Case Studies, IEEE Wiley

Joiner K; Efatmaneshnik M; Tutty M, 2019, 'Test and Evaluation Toolset', in Gorod A; Hallo L; Ireland V; Gunawan I (ed.), Evolving Toolbox for Complex Project Management, Auerbach Publications, Boca Raton, Florida, pp. 339 - 370

Journal articles

Warren M; Joiner K; Tahtali M, 2021, 'Damage Accumulation Comparison for Various Vibration Test Profile Generation Methods applied to a Complex Payload (submitted)', Journal of Vibration and Control

Modini J; Lynar T; Moustafa N; Sitnikova E; Joiner K, 2021, 'The Application of Epidemiology for Categorising DNS Cyber Risk Factors (submitted)', Journal of Cybersecurity and Privacy

Redman S; Yaxley K; Joiner K, 2020, 'Improving General Undergraduate Cybersecurity Education: A responsibility for all universities? (submitted)', Creative Education, vol. Volume 9, https://seace.iafor.org/

Wilson R; Joiner K; Abbasi A, 2020, 'Defence Academy Time-Management: Improving Students' Academic Performance(submitted)', Australian Journal of Defence and Strategic Studies, https://www.defence.gov.au/ADC/Publications/AJDSS/

Keane J; Joiner K, 2020, 'Experimental Test & Evaluation of Autonomous Underwater Vehicles', Australian Journal of Multi-Disciplinary Engineering, http://dx.doi.org/10.1080/14488388.2020.1788228

Yesudas R; Castelle K; Joiner K; Bradley J; Efatmaneshnik M, 2020, 'Solving tensions and impacts of overlapping project management and systems engineering with the elegance of the complex systems governance approach', International Journal of System of Systems Engineering, vol. 10, pp. 164 - 193, http://dx.doi.org/10.1504/IJSSE.2020.10029687

Joiner K; Rees L; Levett B; Sitnikova E; Townsend D, 2020, 'Learning Environment of Distance and Partly-Distance Postgraduate Coursework Programs', Learning Environments Research, http://dx.doi.org/10.1007/s10984-020-09335-w

Katina PF; Tolk A; Keating CB; Joiner K, 2020, 'Modeling and Simulation in Complex System Governance', International Journal of System of Systems Engineering, vol. 10, pp. 262 - 292, http://dx.doi.org/10.1504/IJSSE.2020.10031374

Atkinson SR; Skinner CJ; Joiner K; Caldwell NHM; Swidan A, 2020, 'Important Trends and Junctures in Warship Design', Marine Systems & Ocean Technology, vol. 15, pp. 135 - 150, http://dx.doi.org/10.1007/s40868-020-00076-2

Offner K; Sitnikova E; Joiner K; MacIntyre R, 2020, 'Towards understanding cybersecurity capability in Australian healthcare organisations: A systematic review of recent trends, threats and mitigation', Intelligence and National Security, http://dx.doi.org/10.1080/02684527.2020.1752459

Joiner K; Rees L; Levett B; Sitnikova E; Townsend D, 2020, 'Efficacy of structured peer critiquing in postgraduate coursework', Studies in Higher Education, http://dx.doi.org/10.1080/03075079.2020.1716318

Yesudas R; Castelle K; Joiner KF; Bradley JM; Efatmaneshnik M, 2020, 'Addressing tensions of overlapping project management and systems engineering with the elegance of a complex systems governance approach', International Journal of System of Systems Engineering, vol. 10, pp. 164 - 193, http://dx.doi.org/10.1504/IJSSE.2020.109143

Efatmaneshnik M; Shoval S; Joiner K, 2019, 'System Test Architecture Evaluation: A Probabilistic Modeling Approach', IEEE Systems Journal, vol. 13, pp. 3651 - 3666, http://dx.doi.org/10.1109/JSYST.2019.2899697

Warren M; Joiner K, 2019, 'Improving Vibration Test Methods and Profile Selection for Complex Land Vehicle Payloads', Australian Journal of Multidisciplinary Engineering, vol. 15, pp. 75 - 83, http://dx.doi.org/10.1080/14488388.2019.1668202

Brennan G; Joiner K; Sitnikova E, 2019, 'Architectural Choices for Cyber Resilience', Australian Journal of Multidisciplinary Engineering, vol. 15, pp. 68 - 74, http://dx.doi.org/10.1080/14488388.2019.1664210

Joiner KF; Atkinson SR; Christensen PH; Sitnikova E, 2018, 'Cybersecurity for Allied Future Submarines', World Journal of Engineering and Technology, vol. 6, pp. 696 - 712, http://dx.doi.org/10.4236/wjet.2018.64045

Joiner KF, 2018, 'International T&E: Looking towards the U.S. not outward from the U.S.', The ITEA (International Test and Evaluation Association) Journal, vol. 39, pp. 5 - 7

Ghildyal A; Chang E; Joiner K, 2018, 'A Survey of Benefit Approaches and a Human-Centred Innovation Loop embedded Benefit Realisation Framework', Archives of Business Research, vol. 6, http://dx.doi.org/10.14738/abr.610.5102

Joiner KF; Ghildyal A; Devine N; Laing A; Coull A; Sitnikova E, 2018, 'Four testing types core to informed ICT governance for cyber-resilient systems', International Journal of Advances in Security, vol. 11, pp. 313 - 327

Joiner KF; Tutty MG, 2018, 'A tale of two Allied Defence Departments: New assurance initiatives for managing increasing system complexity, interconnectedness, and vulnerability', Australian Journal of Multidisciplinary Engineering, vol. 14, pp. 4 - 25, http://dx.doi.org/10.1080/14488388.2018.1426407

Joiner KF; Brewster AL, 2017, 'Cooking perfect cupcakes: Freeing curricula context gives student-centred pedagogy for course on experimental design', Creative Education, vol. 8, pp. 1833 - 1859, http://dx.doi.org/10.4236/ce.2017.812126

Fowler S; Sweetman C; Ravindran S; Joiner KF; Sitnikova E, 2017, 'Developing cyber-security policies that penetrate Australian defence acquisitions', The Australian Defence Force Journal, http://www.defence.gov.au/adc/adfj/Documents/issue_202/Sweetman_July_2017.pdf

Joiner KF, 2017, 'How Australia can catch up to U.S. cyber resilience by understanding that cyber survivability test and evaluation drives defense investment', Information Security Journal: a Global Perspective, vol. 26, pp. 74 - 84, http://dx.doi.org/10.1080/19393555.2017.1293198

Joiner KF; Atkinson SR, 2016, 'Australia's future submarine: shaping early adaptive designs through test and evaluation', Australian Journal of Multi-Disciplinary Engineering, pp. 1 - 24, http://dx.doi.org/10.1080/14488388.2016.1238025

Joiner KF; McAulliffe M; Kiemele M, 2016, 'Australia's First Official Use of Design of Experiments in T&E: User Trials to Select Rifle Enhancements', ITEA Journal, vol. 2016, pp. 141 - 152

Joiner KF, 2015, 'Implementing the Defence First Principles Review: Two key opportunities to achieve best practice in capability development', Strategic Insights, https://www.aspi.org.au/publications/implementing-the-defence-first-principles-review-two-key-opportunities-to-achieve-best-practice-in-capability-development

Joiner KF, 2015, 'How New Test and Evaluation Policy is Being Used to De-risk Project Approvals through Preview T&E', ITEA Journal, vol. 2015, pp. 288 - 296

Joiner KF; Malone JA; Haimes DH, 2002, 'ASSESSMENT OF CLASSROOM ENVIRONMENTS IN REFORMED CALCULUS EDUCATION', Learning Environments Research, pp. 51 - 76

Joiner KF, 1999, 'Australia's Air Strike Capability: A personal and critical perspective', Australian Defence Force Journal: journal of the Australian profession of arms, vol. 138, pp. 48 - 56, http://www.adfjournal.adc.edu.au/site/journal_index.asp?page=18

Aldis GK; Sidhu HS; Joiner K, 1999, 'Trial of Calculus and Maple with heterogeneous student groups at the Australian Defence Force Academy', International Journal of Computer Algebra in Mathematics Education, pp. 167 - 190

Hepworth A; yaxley K; Baxter D; Joiner K; Abbass H, 'Tracking Footprints in a Swarm: Information-Theoretic and Spatial Centre of Influence Measures', , http://dx.doi.org/10.36227/techrxiv.12834002

Hepworth A; yaxley K; Baxter D; Joiner K; Abbass H, 'Tracking Footprints in a Swarm: Information-Theoretic and Spatial Centre of Influence Measures', , http://dx.doi.org/10.36227/techrxiv.12834002.v1

Conference Papers

Hepworth A; Yaxley K; Baxter DH; Joiner K; Abbass H, 2020, 'Tracking Footprints in a Swarm: Information-Theoretic and Spatial Centre of Influence Measures (submitted, preprint online)', IEEE, Canberra, Australia, presented at 2020 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE, Canberra, Australia, 01 December 2020 - 03 December 2020, https://www.techrxiv.org/articles/preprint/Tracking_Footprints_in_a_Swarm_Information-Theoretic_and_Spatial_Centre_of_Influence_Measures/12834002/1

Modini J; Lynar T; Sitnikova E; Joiner K, 2020, 'Applications of Epidemiology to Cyber Security', Chester, U.K., presented at 19th European Conference on Cyber Warfare and Security, Chester, U.K., 25 June 2020 - 26 June 2020

Modini J; Van Zomeran M; Fowler S; Joiner K; Lynar T, 2020, 'Rising to the Challenge of Insider Threats for Middle Powers', in Payne BK; Wu H (ed.), Academic Conferences and Publishing International Ltd, Norfolk, Virginia, pp. 521 - 529, presented at 15th International Conference on Cyber Warfare and Security, Norfolk, Virginia, 12 March 2020 - 13 March 2020, https://www.academic-conferences.org/conferences/iccws/

Yesudas R; Efatmaneshnik M; Joiner K, 2019, 'Identifying Focal Points in IT Project Governance using a Synthetic and Systems Thinking Approach', in Boy GA; Guegan A; Krob D; Vion V (eds.), Complex Systems Design & Management Proceedings of the Tenth International Conference on Complex Systems Design & Management CSD&M Paris 2019, Springer Nature Switzerland AG, Paris, pp. 79 - 92, presented at Complex Systems Design & Management (CSD&M) conference, Paris, 12 December 2019 - 13 December 2019, http://dx.doi.org/10.1007/978-3-030-34843-4_7

Joiner K; Atkinson SR; Castelle K; Bradley J, 2019, 'Near-Term Asian War: Impacts and Options for Australia’s Submarine Program', in Morgan GA (ed.), 5th Submarine Science, Technology and Engineering Conference (SubSTEC5), Submarine Institute of Australia Inc, Fremantle, Western Australia, pp. 15 - 28, presented at 5th Submarine Science, Technology and Engineering Conference (SubSTEC5), Fremantle, Western Australia, 18 November 2019 - 22 November 2019

Atkinson SR; Fowler S; Bogais J; Joiner K, 2019, 'Ratcatchers, Regulators, and Zealots – A Hitchhiker’s Guide to Cyber T&E', IEAust, Canberra, presented at Systems Engineering, Test and Evaluation, Canberra, 29 April 2019 - 01 May 2019, https://search.informit.com.au/browsePublication;res=IELENG;isbn=9781925627312

Warren M; Joiner K, 2019, 'Improving Vibration Test Methods and Profile Selection for Land Vehicle Payloads', in SETE 2019, Institute Engineers Australia, Canberra, presented at Systems Engineering Test and Evaluation, Canberra, 29 April 2019 - 01 May 2019, https://search.informit.com.au/browsePublication;res=IELENG;isbn=9781925627312

Showing 1 - 50 of 98 publications