research interests and publications main fields of research - human factors/ human-machine interaction
- personality psychology
- entrepreneurship
- experimental psychology
specific research interests - automation, human-machine function allocation
- performance shaping factors in supervisory control
- assessment of situation awareness
- assessment of mental workload
- usability engineering and evaluation of supervisory control master displays
- development and evaluation of aptitude tests
- quality of assessment centers
publications
Please check this list for potential links to your work. If you are interested in reading the full papers, please contact me via email. For further information on co-authors, click on their names.
submitted Nachtwei, J. (submitted). A multi-level design approach for a supervisory control master display in human factors experiments. Behaviour & Information Technology.
Nachtwei, J. (submitted). SAGAT versus SPAM? It depends!An Aid for Situation Awareness Method Selection (aSAms). Ergonomics.
Schermuly, C. C., Nachtwei, J. & Meißner, M. (submitted). Quality Criteria for Assessment Centers from an Expert Point of View. Practical Assessment Research and Evaluation.
accepted/ in press
Schölmerich, F., Nachtwei, J. & Schermuly, C. C. (accepted). Evaluating the Quality of Assessment Centers Used Within Employee Selection -Development of the Benchmark for Assessment Center Diagnostics (BACDi). Empirische Evaluationsmethoden.
Stade, M., Meyer, C., Niestroj, N. & Nachtwei, J. (accepted). Die multiple lineare hierarchische Regression als flexible Methode für korrelative und experimentelle Designs - Unter besonderer Berücksichtigung der Voraussetzungsprüfung. Empirische Evaluationsmethoden.
Gèrard, N. ,
Huber, S. , Nachtwei, J.,
Satriadarma, B. &
Schubert, U. (accepted). A Framework for Designers to Support Prospective Design of Human Computer Interaction. International Journal on Human-Computer Interaction.
- In this paper, we analyze the term "prospective design" from various perspectives. The
theoretical-, research- and empirical-based approximations are centralized. Furthermore, a working de finition of "prospective design in human-computer interaction" is proposed in the rst part of this paper. In practice, however, the mere de nition of prospective design and awareness that user, context, technical system and task have to be known is not enough. Therefore we propose a new model of performance shaping factors in the second part of this paper. This model gives recommendations for human-computer interaction design and research in terms of factors that should be considered for a prospective design of user interfaces. The utility of this new model is shown using a case study in psychology
alarm.
Nachtwei, J. & Kain, S. (accepted). About the ecological validity in studies on human-computer interaction. In: Krause, and B. Metzler, P. (Eds.). Empirical Evaluation Methods Volume 14, Zee Verlag: Berlin.
- studies on human-machine interaction are associated with high costs, since the modeling of complex and dynamic reality clips in this field can be achieved through simple experimental settings. Rather, complex simulations are necessary to meet the high expectations also reality. But how can you assess whether a real man-machine system (eg a control room in the process industry) is actually implemented in its foundations appropriate? Because the proximity of the laboratory environment for real system largely determines the generalizability and thus the practical value (in terms of productivity, safety, etc.) of the research results.
At this point helps the concept of "ecological validity", which is explained in more detail, first post and in popular Validitätsformen (eg, content validity, external validity) is to be located. Following werden Mikrowelten als Messansatz zur Gewährleistung des nötigen Grades an ökologischer Validität diskutiert. Dabei wird auf die Problematik des zu hohen Determinismus und damit der realitätsfernen Antizipierbarkeit von Prozessverläufen bei den meisten gängigen Ansätzen eingegangen. Ein Lösungsvorschlag in Form einer selbst entwickelten Mikrowelt (Socially Augmented Microworld, SAM) wird angeboten und von Alternativen (vgl. Cabin Air Management System, CAMS) abgegrenzt. Hierfür wird der Ansatz zur Erhöhung der Variabilität der Prozesse in einer Mikrowelt und deren Umsetzung belegt durch Ergebnisse aus empirischen Untersuchungen sowie die partielle Aufklärung der Variabilität durch den Einsatz von Kontrollvariablen reported. The paper concludes with a discussion, what factors might serve to input a checklist to assess the degree of ecological validity of an existing test environment.
Hildebrandt, M. ,
Kain, S. ,
Kesselring, K. , Nachtwei, J.,
Niestroj, N. & Schwarz, H. (accepted). The hierarchical task analysis in Babel interdisciplinary software development projects. Journal of Industrial Engineering.
- The guiding principle, a sound task and requirements analysis is central to the success of software development projects, is now taken seriously. However, often there is confusion about the "how" or "How". What methods are useful and of practical use to identify needs and possible risks of software as soon as possible? We discuss the hierarchical task analysis (HAA) as a method to achieve these goals and have purposely chosen this particular form. For the interdisciplinary approach in software development projects requires a common language needed to be understood by computer scientists, engineers, designers and psychologists alike. We highlight the HAA in the intersection of computer science and psychology, and report it from our own experience in one of our projects, so as to sensitize the practice of this approach.
Schroeder, T., Nachtwei, J. & Schermuly, C. (in press). Potential of elderly people. Human Resources Manager, 2 / 09.
- What are the key trends and issues for the future of staff development, personnel selection and training
in German companies? On this issue, the Institute has performed at the Free University of Berlin Futur the study "Human Resources Development 2020, were posed questions to HR professionals. As usual with Delphi studies, there were several rounds of questioning. The multi-stage approach aimed at to reach an expert consensus that experience, has high reliability and predictive power. First, the study authors interviewed 17 staff developers to their future expectations and fears. From the answers, they developed 20 scenarios describing the possible and plausible future developments. In a second Delphi round, the researchers laid the scenarios about 500 experts for evaluation. In the third round, the same experts thought again to the place and the previous answers of other respondents. We analyzed only the responses of participants who answered all questions. The Human Resources Manager reported in a three-part series in advance of important Ergebnisse der Studie. Im zweiten Teil der Serie geht es um die Frage, wie sich der demographische Wandel auf die Personalarbeit
auswirkt.
2010
Nachtwei, J. (2010). The many faces of human operators in process control – A framework of analogies. Theoretical Issues in Ergonomics Science, 1-21, iFirst: http://dx.doi.org/10.1080/14639221003728609.
- This article is meant to enlarge common views on automation and function allocation by introducing a framework which describes characteristics of operators as they are represented in the minds of the developers who conceptualize automation and assistance for them. The characteristics of the operators are interpreted by the developer, automation or assistance is designed accordingly and as a result certain roles, chances and analogies to describe these aspects. The article shall both serve as an integrative review and as guidance for designers in order loading) allocation of functions in human-machine systems. In order to support the main ideas results from experimental real accidents from industry and transportation are jointly presented.
Schermuly, C.C. & Nachtwei, J. (2010). Assessment-Center optimieren. Harvard Business Manager, 09/10, 16-17.
- Assessment Center sind zu teuer, zu wenig aussagekräftig und werden zu selten genutzt – so das Ergebnis einer Studie der Wissenschaftler Jens Nachtwei und Carsten C. Schermuly in der April-Ausgabe 2009 des Harvard Business Managers. Jetzt zeigen die Autoren, wie sich die Qualität dieses Instruments zur Personalauswahl verbessern lässt.
Schermuly, C. ,
Schröder, T. , Nachtwei, J. &
Scholl, W. (2010). Das Instrument zur Kodierung von Diskussionen (IKD): Ein valider und zeitökonomischer Zugang zur Kodierung von Interaktionen in Organisationen. Zeitschrift für Arbeits- und Organisationspsychologie, 54(4), 149-170.
- Das Instrument zur Kodierung von Diskussionen (IKD) ist ein neues und user-friendly process can be time-efficient coding of the interaction processes in organizations. Thus, it is possible to observe large numbers of groups and communication situations (eg, decision meetings, team meetings or staff meetings) Act standardized to act and to analyze. By IKD two types of communication levels are investigated simultaneously: the interpersonal and the functional significance of a statement. In the present study to examine the reliability and validity of 60 dyads were observed in an interactive task with assigned roles (manager, employees) as part of an assessment center with the ICD. There were high Observer match results are determined (kappa values and intraclass correlations ≥ .80 unjusted). For the validity test of the relationship ICD variables of personality and intelligence traits were found. Similarly, one could Priming and the supervisor and employee role proved largely confirming the hypothesis in the ICP data.
2009 Meyer, C. , Nachtwei, J.,
Cain, S. (2009). Empirical versus subjective reality representation: influence of personality characteristics on process monitoring and management in human-machine systems. MMI Interactive, 12/09.
http://www.mmi-interaktiv.de/uploads/media/MMI.Meyer_Kain_Nachtwei2009.pdf - The Human Factors Research researchers operate from a variety of disciplines. But how well do those actually made with the knowledge stock of the Human Factors area? We addressed this question for a specific area investigated, knowledge of the importance of personality variables to the performance of surgeons in the human-machine interaction. In the literature can be found empirical evidence of this significance. Nevertheless, this fact is so far given in the Human Factors research little attention. Be caused by lack of knowledge on the part of researchers. In fact was evident in a study conducted by our expert evaluation, in the seven personality characteristics should be assessed for their effect size on the performance of operators in process monitoring and management for the area of \u200b\u200bair traffic control and power generation, the effect sizes of the features of male as rather low be. In addition, this assessment seems to be task-and system-independent.
Schermuly, C. & Nachtwei, J. (in press for 51st Anthropotechnik FAS). The analysis of cooperative work processes in human-machine systems with the Instrument for coding discussions (IKD). In M. Grandt & A. Bauch (Eds.), cooperative work processes (pp. 59-75). Bonn: German Society for Aeronautics and Space Association (DGLR Report 2009).
- The diagnostic team is in the process of ongoing relevance of cooperative work processes in the human factors area a special importance. Who are working together during playback end communication processes because of the wealth of information and mutual dynamics for the participants but also for untrained observers rarely seen. To analyze this offer the different analysis strategies. The article focuses on the behavioral observation method and a new instrument that was developed at the Humboldt University in Berlin (Schermuly & Scholl, in press). The instrument for coding discussions (IKD) is a process, efficiently with the communication processes act for act to be coded and analyzed. With the ICD can examine in detail who has something to whom, how and with what functional significance said and how is this speech was answered. By the time economy larger numbers of groups and communication situations standardized observed and analyzed. The user-friendliness the process is enhanced by a computer program for direct data entry and analysis.
Kain, S. & Nachtwei, J. (2009). The role of control variables in the Human Factors Research - A proven concept in a modern application field. In: Krause, and B. Metzler, P. (Eds.). Empirical Evaluation Methods Volume 13 (p. 5-14). Zee Verlag: Berlin.
- The following article addresses the question of how the Human Factors Research, which deals with mainly practically relevant problems of human-computer interaction is concerned, can the use of control variables (the example of personality variables) benefit. In addition to the methodological and statistical characteristics of human factors research, the potentials of the inclusion of control variables and the advantages and disadvantages of short scales for personality measurement are discussed. High practical relevance and methodological approach must not be ruled out clean. The paper shows how "can the adaptation of the measurement approach (use of short scales) to the specific features of screening in the technology domain, both human rights agreement.
Meyer, C. , Nachtwei, J.,
Cain, S. (2009). The moderating effect of personality traits on the performance of operators of process control and monitoring in complex human-machine systems. In A. Lichtenstein, C. & C. ram Clemens (Eds.), Prospective design of human-machine interaction. 8. Berlin Workshop Human-Machine Systems. (P. 185-190). Dusseldorf: VDI.
- Abstract: This paper examines personality traits as moderators of operators' performance in process control environments. A number of empirical findings prove personality traits to predict expected Significantly behavioral outcomes and emphasize the need of a systematic integration of these traits in empirical settings. However the potential of personality traits still lacks attention of experts in Human Factors practice und research. Based on a literature review, ratings of Human Factors experts and further empirical studies the focus is thus on increasing the awareness of personality traits in measuring process control performance. In addition emphasis is placed upon an appropriate statistical control of these operator characteristics in Human Factors research. Serving as a facilitator the project “Personality Traits as Control Variables in Human Factors Research” (PeCoHF) seeks to increase the assessment of personality traits in empirical studies using short scales of personality questionnaires. Description and results of a recent study applying this principle are reported.
Nachtwei, J. &
Schermuly, C. (2009). Eight myths about fitness tests. Harvard Business Review, 6-10.
- Abstract: Many HR people shy away from personality and intelligence tests, and thus often lose the race for talent. If you ask them why they refuse these tests, they have a whole range of reservations at hand. It is not a selection tool, which measures future professional success as precise. [...] We know it would have more accurately and in a two-part study (see box below) were examined, was to-educational assessment in Germany, despite all scientific recommendations are still so few are common. We have gone to three central issues: first How well say different selection tools - interviews, assessment centers, work samples, skills and aptitude tests - expected their future career success? 2. How common are these instruments in German companies? 3. Whatever reservations lead to screening tests play a minor role so far?
2008 Huber, S. ,
Kain, S. & Nachtwei, J. (2008). Effects prove safer: personality characteristics as control variables in human Factors research. In M. Grandt & A. Bauch (Eds.), contributions of ergonomics to the human-system integration (p. 143-159). Bonn: German Society for Aeronautics and Space Association (DGLR Report 2008).
- Abstract: The Human Factors research has to overcome because of their strong practical orientation some methodological and statistical hurdles. Due to high context information and extensive test environments subjects are confronted with complex tasks (Meister, 2001). These conditions, the detection of practically significant, statistically significant effects more difficult. A supposed solution to this problem is to increase the sample, this result difficult available domain experts is often not possible. The following review therefore an alternative solution is shown, which is far less established in the Human Factors area: the involvement of personality characteristics of the subjects as control variables to bind Störvarianz experimental effects and thus prove more secure. While the technical system to be tested often specially designed, controlled laboratory conditions by the environment and the task is instructed, often no or at least less effort in the consideration of those personality traits is inserted. It appears, however, that many features in the in the prediction of behavior Dealing with technical systems are important. The acquisition requires psychological know-how and was previously associated with a significant amount of time. The trend towards short scales measuring the personality but allows economic inclusion as a control variables. The review will address the statistical significance of control variables and the question of what personality traits in human-computer interaction, and how important they are to be measured.
Wandke, H. & Nachtwei, J. (2008). The different human factor in automation: the developer behind vs. the operator in action. In: D. de Waard, FOR Fleming, B. Lorenz, H. Oberheid, and KA Brookhuis (Eds.), Human factors for assistance and automation (pp. 493-502). Maastricht, the Netherlands: Shaker Publishing.
- Abstract: The rapid technological improvements in computer-based control systems make any direct comparison of performance between human operators and machines obsolete. Recent studies of automation do not concentrate on performance oriented comparisons but rather emphasise unwanted side-effects of function allocation, such as loss of competence, deficiencies in situation awareness, complacency, mistrust, etc. We focus on a “forgotten” question of function allocation: How well can future events be prospectively handled by developers compared with the operator’s handling of the same events when they really happen? Developers of automation systems are able to program suitable algorithms for predictable problems. Human operators are needed for unpredictable situations. But analyses of accidents reveal that developers of automation are unable to consider all possible combinations of disturbances, while human operators are unable to act as quickly and accurately as needed. This represents a serious problem. A Socially Augmented Microworld (“SAM”) was developed for the experimental comparison of developers 'anticipation and operators' actions. We analyze the state-of-the-art concepts of function allocation from the perspective Described. Developers and operators have different resources anticipated in vs. real-time process control. These resources are discussed and the methodological approach of "SAM" is explained. First laboratory studies are reviewed .
Nachtwei, J. (2008). Operators in complex human-machine systems: Theory and Practice for Trias' resource, diagnostic and process control performance. " In: Society for Industrial Science (GfA) (ed.): Product ergonomics and production - a task for developers and planners. Report for the 54th Congress of the Society of Industrial Engineering, 09.-11.04. 2008, Munich (805-808). Dortmund: GfA Press.
- Abstract: Presented are their own theoretical model and an empirical approach to the creation of the link between resources and the diagnostic and process control performance of operators in complex, dynamic systems.
Nachtwei, J. (2008). An experimental approach to cognitive ergonomics - People Kodeterminanten characteristics as the complexity of a vibrant micro-world. VDM Verlag Dr. Müller: Saarbrücken.
- Abstract: This paper is part of the project ATEO (developer division surgeon) were performed. This project attempts from the classic comparison of human and machine to solve and answer the following question with an experimental approach: The tasks in human-machine systems (MMS) can be alleviated by, conceived by developers delegate automatic in the technical component and the responsibilities should remain with the current situation located in the operator. Wandke (2004) presents advantages and disadvantages of the two protagonists in detail dar. The basis of the mentioned experimental approach is a specially developed test environment which results from the so-called micro-ATEO World (MW), a tracking experiment in a driving simulation and the so-called micro-worlds (MET) is composed. Following the approach of ecological validity, raises the question of how those in the laboratory setting well-controlled, micro world can be manipulated systematically in their complexity. This work will focus on the micro-worlds and postulates: the complexity of the task environment can be explained by personal characteristics of the MET systematically manipulated. With the so-called 3K model (cooperation-conflict-complexity model) was specifically developed causal model is available to establish this relationship. A number of personal characteristics was assessed on the basis of empirical findings, as well as theoretical and pragmatic considerations as regards the ability to answer the question. As a result, emerged the personal characteristics and strategy expertise, which were under three experimental studies in their influence on behavior in the Solo Tracking investigated. A connection to the behavioral indicators in the tracking error and time could be detected. Despite this allows a differentiated consideration of personal characteristics and tracking measures appear heterogeneous, the clinical findings. Possible causes and implications are discussed. The foundation for further investigations with the help of cooperative tracking can be used as be considered secure. In carrying this work of the other paths of the 3K model are empirically tested in order to ultimately draw the bow from the feature of the micro-world dweller for the characteristic of the micro-world (the complexity) can.
Nachtwei, J. (2008). Action strategy as a control variable in laboratory experiments - Construction and Evaluation of the questionnaire instrument FESE-R. In:
In P. Khader, K. Jost, H. & F. Rösler Lachnit (eds.), Experimental Psychology. Contributions to the 50th Meeting experimentally working psychologists. Lengerich: Pabst Science Publishers (177).
- Abstract: Especially in the light part only small effect and thus search for general and economically measurable control variables is essential. In the personality-and traffic-psychological literature, several relating to dispositional constructs can carry out acts differ: sensation seeking, action-vs. Positional orientation, impulsivity, etc. The comparison to construct level identified speed vs. Accuracy of orientation as two poles of acquisition strategy and expertise, Revision (FESE-R) were recorded including the very dimension, the action strategy. Based on a theoretical derivation of the scale, first the design and quality evaluation is according to common principles of classical test theory described. Furthermore, results for construct validity (to place in a nomological network of Big Five and achievement motivation) and criterion validity (prediction of performance measures in a Pursuit-Tracking Experiment) are reported. normalized (N = 532) to assess the strategy of action control variable in experiments are discussed.
2007 Gross, B. & Nachtwei, J. (2007). How to develop and use assistance systems efficiently - Using the micro world as a method to acquire knowledge for developers and operators. In D. de Waard, B. Hockey, P. Nickel, and K. Brookhuis (Eds.), Human Factors Issues in Complex System Performance (pp. 345-350). Maastricht, the Netherlands: Shaker Publishing.
- Abstract: This research considers how a system which is sufficiently complex to mimic real world conditions can be derived in an experiment. Described is the approach of the Socially Augmented Microworld (SAM). It is shown that a direct variation of the complexity can be achieved by means of task modification as well as by choosing the microworld inhabitants on the basis of specific personal features. The scope for further developments is discussed.
Bruder, C. & Nachtwei, J. (2007). Zwischen Effekt und Effizienz: Die Stichprobengröße pragmatisch planen. M. Grandt & A. Bauch (Hrsg.) Stand und Perspektiven der simulatorgestützten Systemgestaltung, 173-188. Bonn: Deutsche Gesellschaft für Luft- und Raumfahrt e.V. (DGLR-Bericht 2007).
- Abstract: Empirische Untersuchungen, insbesondere unter Einsatz aufwendiger Simulatoren sind kostspielig. Die Anzahl der Probanden ist dabei der entscheidende Faktor. Häufig stellt sich daher die Frage nach der Zahl der nötigen Studienteilnehmer, um Untersuchungsergebnisse statistisch abzusichern und zugleich ökonomisch zu bleiben. Nach einem kurzen Exkurs zur Stichprobenplanung bei formativen Untersuchungen werden im Beitrag praxisnah und verständlich die Grundlagen zur Berechnung der Stichprobengröße für summative Untersuchungen dargestellt. Ausgehend von den Zusammenhängen zwischen Stichprobenumfang, Prozedur zur Berechnung des Stichprobenumfangs beschrieben. Da bei diesen Prozeduren praktisch bedeutsamen Faktoren unberücksichtigt bleiben, wird eine eigens entwickelte Faustformel vorgestellt, bei der die Gewichtungsfaktoren Budget, Untersuchungsart und Aufwand in die Berechnung des Signifikanzniveau, Effektstärke und Teststärke (statistische Power) wird eine Stichprobenumfangs eingehen.
2006 Gross, B. & Nachtwei, J. (2006). Assistenzsysteme effizient entwickeln und nutzen - Die Mikrowelt als Methode zur Wissensakquisition for developers and operators. In: M. & A. Grandt belly (Eds.), Cognitive Systems Engineering in the automotive and process control (pp. 75-88). Bonn: German Society for Aeronautics and Space Association (DGLR Report 2006-02/07).
- Abstract: In project ATEO (developer division surgeon) is about skills in dealing with complex technical systems. People in the role of developers of assistance systems and automatic functions are compared with operators of such systems. The focus of attention by the anticipation of a system are the developers and the reactions in the system by the operators: When can developers for a future system well ahead of schedule? Which situations operators cope well when they need support? Method of knowledge acquisition, experimental studies using a specially developed micro-busy world. The article draws on studies of operator performance and system by means of a busy dedicated micro-world can be implemented in the experiment. is the basis of two studies showed that a specific variation of the complexity already have the modification of task characteristics and the selection and use of micro-worlds according to the presence of selected major methodological issues of how to be a sufficiently complex personality characteristics are achieved can.
