Sixth International Summer School “APPLIED PSYCHOMETRICS IN PSYCHOLOGY AND EDUCATION”
Sixth International Summer School
“APPLIED PSYCHOMETRICS IN PSYCHOLOGY AND EDUCATION”
DATES: August 05–10, 2019
REGISTRATION: Until May 30, 2019
VENUE: HSE University Campus in Moscow, Russia
Dr. Christine Fox (University of Toledo)
Dr. Svetlana Beltyukova (University of Toledo)
Dr. Theodore Walls (University of Rhode Island)
Dr. Gary Cook (University of Wisconsin-Madison)
Dr. Gavin Brown (University of Auckland)
School tracks will be taught in English
Registration to the Summer School 2019 is now closed. If you would still like to participate, please contact Elena Kardanova, Head of the Summer School, at firstname.lastname@example.org for late registration.
The participants can opt for one of the following three tracks:
- Track 1. Foundations and Applications of the Rasch Model
- Track 2. Modelling the Growth
- Track 3. Simplifying, Identifying, and Evaluating Dimensions: Exploratory and Confirmatory Factor Analyses.
Track 1. Foundations and Applications of the Rasch Model
The course “Foundations and Applications of the Rasch Model” by Prof. Christine Fox and Prof. Svetlana Beltyukova is designed to introduce participants to the principles of objective measurement and build the foundation for using two most common Rasch measurement models: the Rasch model for dichotomous data and the Rasch Rating Scale model. The former is widely used in testing pass/fail situations while the latter is applicable in the analysis of survey or assessment data comprised of ratings. Both models provide rich item and person diagnostics that allow test developers and users to evaluate the extent to which the instrument meaningfully measures intended content in addition to making objective comparisons of scores across different subgroups of interest and over time. Partial Credit Model and Rasch Regression will also be introduced.
- Verbalize the principles of fundamental measurement
- Choose and interpret basic Rasch diagnostics
- Construct and run a WINSTEPS control file for a Dichotomous Model
- Interpret outputs for a Dichotomous Model
- Run a WINSTEPS control file for a Rating Scale Model
- Interpret outputs for a Rating Scale Model
- Recognize the need for the Partial Credit Model
- Describe the difference between the Rating Scale and Partial Credit models
- Choose user-friendly scales and outputs for presenting findings
- Identify and make decisions about misfitting persons and items
- Identify and interpret Differential Item Functioning
- Identify and make decisions about redundant items
- Construct iterative control file for Rasch Regression
- Interpret outputs within larger validation framework
Track 2. Modelling the Growth
This track consists of two courses: “Vertical Scales and Growth Models That Use Them” by Dr. Gary Cook and “Longitudinal Analysis” by Dr. Theodore Walls.
The course “Vertical Scales and Growth Models That Use Them” by Dr. Gary Cook is designed to provide participants with basic concepts and approaches to establishing vertical scales on large scale educational assessments using Item Response Theory (IRT). It also presents methods for applying vertical scales to student growth models. A variety of growth models are presented along with discussions about the benefits and drawbacks of each model.
The course begins with a brief overview of measurement theory starting with Classical Test Theory (CTT) and moving to IRT. The session then discusses methods used to establish vertical scales. For ease of discussion, the one-parameter Rasch models are used, although differences between IRT scaling methodology are mentioned. Following this, an overview of different student growth models using vertical scales is addressed. In this section, theories of action behind each growth model along with methods and resources needed to calculate them are discussed. The course finishes with a discussion about the meaningful application of growth models in educational and research settings.
- Review basic concepts behind CTT and IRT
- Understand general approaches to establishing vertical scales using Rasch model horizontal and vertical equating methodologies
- Understand the benefits and challenges behind different IRT vertical scaling approaches
- Understand the background and theories of action associated with different educational growth models
- Understand the basic approaches and methodologies for calculating different educational growth models
- Have experience calculating different educational growth models using the R statistical software package
The course “Longitudinal Analysis” by Dr. Theodore Walls covers three important areas in the analysis of longitudinal data: simulation and programming, longitudinal designs, and methods for the analysis of change. The objective of the course is to ensure that graduate students working on research involving longitudinal data have both the baseline conceptual skills and hands-on experience needed to pursue development of applied models in their work. Modeling frameworks include analysis of difference and change scores, repeated measures ANOVA, cross-lagged regression, time series and the family of random coefficient models, including hierarchical linear models, multi-level models, growth curve models, etc. Recently emerging models focused on intensive longitudinal data are also considered.
- Understand different longitudinal designs
- Appreciate a range of descriptive and inferential modeling frameworks
- Experience hands-on modeling toward developing baseline competencies
- Gain exposure to advanced modeling of intensive longitudinal data, its challenges and opportunities
- Understand and appreciate literature and community tackling longitudinal data as a field
Track 3. Simplifying, Identifying, and Evaluating Dimensions: Exploratory and Confirmatory Factor Analyses
The course “Simplifying, Identifying, and Evaluating Dimensions: Exploratory and Confirmatory Factor Analyses” by Dr. Gavin Brown will introduce students to principles and practices behind simplifying data into its component dimensions. This assumes that data contain latent factors and that multiple indicators are used to operationalize those various dimensions. The models rely on stable simultaneous estimation of multiple parameters (incl. variance and covariance matrices of all items, error terms, and relationship structures of latent factors). Students will be taught principles for determining a defensible number of dimensions and how that exploration can be tested. It is a truism that many models of dimensions can fit data; thus, the course will introduce the importance of testing and comparing multiple plausible alternative models. Unsurprising, a small proportion of models will be inadmissible even when N>400. Hence, time will be spent on identifying and troubleshooting problems such as negative error variance and covariance matrix not positive definite. Educational research often seeks to compare participant subgroups who have completed the same test or survey. Nested multigroup invariance testing is a mechanism for determining if scores can be legitimately compared.
- Understand the purpose and rationale for dimensionality reduction and determination
- Understand the differences in use and purpose of exploratory and confirmatory factor analyses
- Gain awareness of the need for and ability to test alternative models
- Develop ability to conduct exploratory and confirmatory factor analysis with simple correlated models
- Develop ability to identify and troubleshoot problems in FA
- Spoken English
- Your own laptop
- Spoken English
- Your own laptop
- Basic knowledge of measurement concepts such as reliability, validity, generalizability, fairness and equity
- Basic understanding of CTT and IRT
- Familiarity with statistics, especially regression models
- Knowledge of the R statistical software package
- Spoken English
- Your own laptop
- Previous exposures to the following statistical methods: chi-square testing; confidence intervals; correlation and covariance; regression
The School Fee for participants from outside the CIS is RUB 38,000 (approximately EUR 512). Non-CIS enrollees can take advantage of an early bird offer of RUB 30,000 (approximately EUR 405) until April 15, 2019. For applicants who are CIS citizens, a reduced rate of RUB 30,000 is effective up until admissions close on May 30, 2019.
The Fees stated cover tuition for a selected Track, lunch and two coffee breaks daily, and handouts. Travel and accommodation are paid by participants.
Note that you should proceed to pay your School Fee ONLY AFTER a notice is received to confirm that you qualify and have been officially admitted to your chosen School Track (i.e., NOT upon registration).
The Summer School will take place on the HSE University Campus in Moscow that is conveniently located in the city's historic downtown area, under 20 minutes’ walk from the Kremlin, Red Square and other popular sights.
You may wish to check out this quick lodging guide that we have compiled to help you decide where to stay in Moscow as would best dovetail with your School schedule and personal plans.
We stand ready to assist with visa procedures by issuing a Letter of Invitation upon your request.
Head of the Summer School is Elena Kardanova, Director of the IOE Center for Monitoring the Quality in Education and of the ‘Measurements in Education and Psychology’ Master’s program.
For questions and additional information, please contact the Organizing Committee:
- Irina Brun, email@example.com: general queries and enquiries about Track 1
- Irina Uglanova, firstname.lastname@example.org: enquiries about Track 2
- Dmitry Kholyavin, email@example.com: enquiries about Track 3