Tailcalled created a new personality test, the Targeted Personality Test. One of its purposes was to investigate the “realness” of personality traits without relying on the lexical hypothesis. This is done by asking people about concrete, narrow behaviors instead of abstract adjectives. I thought I’d also have a go at the data, both for robustness reasons and because it’s fun.
In their post, Tailcalled looks at three measures of how well a trait performs:
Trait impact: The average loading of the concrete behaviors on the trait, calculated by taking the square root of the average correlation of the concrete behaviors with each other. (This measures how much the trait impacts behavior.)
Factor model loss: The difference between the observed trait correlation matrix and a hypothetical correlation matrix if there were only a single factor. (This measures whether multiple traits are being conflated.)
Correlation with lexical notion: I’m not quite sure how this is calculated, other than that it’s based on the correlations between the abstract items and concrete items after adjusting for the fact that the concrete items do not perfectly correlate among themselves.
I thought I’d also have a go with my own versions of these measures. For factor model loss, I perform parallel analysis on the concrete items for a trait and report the number of factors it suggests. For the other two measures, I fit a two-factor model in which the concrete items load on one factor and the abstract items load on a second factor, with the two factors allowed to correlate. For trait impact, I report the average variance extracted (AVE) of the concrete factor (you can determine the “equivalent” loading by taking the square root). For correlation with lexical notion, I use the correlation between the concrete and abstract factors.
Factor Model Loss
To measure factor model loss, I performed parallel analysis on the concrete items for a trait and report the number of factors it suggested. Traits were one factor was suggested should be those where the concrete items reflect a single underlying construct. Traits with multiple factors may possibly be conflating several distinct constructs under the same label.
Factors
Traits
1
Art Appreciation, Conservatism, Honesty, Sociability, Well-Being
For each trait, I fit a two-factor model in which the concrete items load on one factor and the abstract items load on a second factor.
The number in parentheses beside the trait name is the correlation between the concrete and abstract factors. Higher values indicate that the abstract trait label corresponds more closely to the cluster of concrete behaviors.
Within each trait, I also report √AVE (the square root of the average variance extracted) for both factors. This serves as a measure of trait impact: higher values indicate that the factor explains more of the variation in its items.
Art Appreciation (corr = 0.67, concrete √AVE = 0.68)
Abstract Factor (√AVE = 0.78)
I appreciate art (0.87)
I believe in the importance of art (0.84)
I do not like poetry (-0.61)
Concrete Factor (√AVE = 0.68)
I don't find much pleasure in looking at art (-0.82)
I think art is a waste of time because it is not to any practical benefit (-0.80)
I associate art with boredom and snobbery (-0.74)
I visit art galleries (0.73)
I believe that a good way to get educated about other cultures is to look at their art (0.63)
I find the atmosphere of art galleries to be very comfortable (0.61)
I am bad at drawing (-0.20)
Orderliness (corr = 0.63, concrete √AVE = 0.50)
Abstract Factor (√AVE = 0.79)
I am orderly (0.85)
I keep things tidy (0.85)
I often forget to put things back in their proper place (-0.65)
Concrete Factor (√AVE = 0.50)
I keep my home tidy (0.81)
I don't see the need in tidying up as I can find my things anyway (-0.61)
I don't have the energy to tidy up my living place (-0.59)
I don't really notice if things are messy (-0.55)
I remember to water plants when needed (0.33)
I have lots of unread emails (-0.33)
I write things that must be bought on a list to keep track of them (0.27)
I make a plan ahead of holidays for what to do each day during the holiday (0.22)
Well-Being (corr = 0.59, concrete √AVE = 0.53)
Abstract Factor (√AVE = 0.76)
I am happy (0.85)
I love life (0.78)
I dislike myself (-0.65)
Concrete Factor (√AVE = 0.53)
I feel that I am a burden on my loved ones (-0.68)
I believe I have the ability to cope with whatever problems life throws at me (0.60)
I feel like others find my appearance repulsive (-0.57)
I am happy about how it is going for my family (0.56)
I feel like it is dangerous to be too happy, as it will lead to things going wrong (-0.52)
I engage in lots of enjoyable activities in my free time (0.47)
I feel I have friends that I can rely on for support (0.44)
I spend time on social media, looking at successful people and feeling envious of how well they are doing (-0.36)
Conservatism (corr = 0.59, concrete √AVE = 0.57)
Abstract Factor (√AVE = 0.70)
I am politically conservative (0.84)
I tend to vote for liberal political candidates (-0.72)
I believe in one true religion (0.50)
Concrete Factor (√AVE = 0.57)
I oppose gay marriage (0.80)
I believe we must reduce immigration (0.70)
Leftists are reckless about the economy (0.65)
I believe we need greener energy (-0.65)
I take part in leftist political marches and protests (-0.62)
I do not trust conservative politicians (-0.56)
Children ought to be empowered to be more independent and know their rights (-0.45)
I would never get a tattoo (0.44)
I believe that laws ought to be strongly enforced (0.41)
I dress in a modest manner (0.26)
Charisma (corr = 0.55, concrete √AVE = 0.42)
Abstract Factor (√AVE = 0.78)
I am charismatic (0.81)
I am skilled at handling social situations (0.78)
I lack the talent for influencing people (-0.76)
Concrete Factor (√AVE = 0.42)
I accidentally tend to make bad first impressions because I am awkward (-0.67)
If I'm at a party where I don't know many people, I often spend a lot of time by myself, rather than striking up conversation (-0.66)
I tend to be awkward when doing presentations for people (-0.58)
I go out of my way to find shared things to talk about with people I want to befriend (0.39)
My coworkers treat me like I am a role model for them (0.38)
I share what I do on social media and inspire others to do similar things (0.24)
When someone close to me has helped me, I give praise to them so they will help me more later (0.23)
I tend to hedge my claims, e.g. saying "maybe" or "sometimes" or "I think" a lot to appear less certain (-0.23)
I think about where conversations are going so that I can steer them towards everyone feeling comfortable and sharing their perspective (0.21)
In conversations, I jump straight to the point rather than doing smalltalk and other irrelevant things (-0.16)
Intellect (corr = 0.50, concrete √AVE = 0.48)
Abstract Factor (√AVE = 0.77)
I am quick to understand things (0.81)
I am intelligent (0.75)
I can handle a lot of information (0.74)
Concrete Factor (√AVE = 0.48)
I've often been very quick at grasping topics that others find difficult in school (0.70)
I've done well at exams in school (0.55)
I am quick at reading big, advanced books (0.49)
I end up feeling clueless about what others are talking about at work (-0.46)
When I try to learn new skills for work, I keep doing things wrong (-0.46)
I don't understand how to play board games or card games (-0.43)
At work, I often end up providing instruction to coworkers (0.33)
My choice of career was a mistake (-0.30)
Sociability (corr = 0.49, concrete √AVE = 0.39)
Abstract Factor (√AVE = 0.77)
I usually like to spend my free time with people (0.79)
I am sociable (0.76)
I avoid company (-0.75)
Concrete Factor (√AVE = 0.39)
I like to dance with people at parties (0.57)
I have groups of people (outside of work) that I regularly meet up with (0.53)
I don't know how to do smalltalk (-0.47)
I love doing presentations of topics that interest me to crowds of people (0.38)
I enjoy cooking food for other people (0.35)
I find teamwork to be a effective way to learn new skills (0.33)
I'd find it a bothersome to go with a friend to an activity that I am not interested in (-0.29)
I use headphones to avoid having people try to start conversations with me (-0.23)
I think that my moods don't change more than most people's do (0.72)
Concrete Factor (√AVE = 0.43)
I can stay stable and composed while coming up with solutions to urgent problems at work, even if my coworkers are worried and panicking (0.63)
I can calmly deal with bureaucracy in emergency situations (0.58)
If someone is trying to manipulate someone close to me, then I can stay calm while unravelling the lies (0.54)
I go from happy to suddenly quite sad if a minor part of my daily routine goes wrong (-0.48)
I can easily tolerate being around toxic people (0.28)
If someone I hold dear does something that upsets me, then I can end up assuming that they want to hurt me, when more likely it was an accident (-0.26)
I have had a dramatic breakup where my relationship with someone was totally destroyed and I hated them afterwards (-0.21)
I suddenly become quite excited if a minor part of my plan goes better than expected (-0.07)
I don't like the attention I get at big parties like my birthdays or my wedding (-0.64)
I am afraid of participating in events where a lot of people would be looking at me perform (-0.53)
I find it embarrassing to be praised for my achievements/abilities (-0.47)
When I organize events, I find it important to emphasize to people that it was me who planned the event (0.34)
In groups, if someone is telling a story about themselves, then I will often bring up relevant personal experiences and start telling my own story (0.33)
If nobody is talking to me at a social event, I will often bring up a relatable topic (such as politics or the weather) to begin conversation (0.32)
If I'm out in public and my companions start acting weird and silly, I would worry people are judging me (-0.21)
I try to moderate my mood so people will find me more exciting and pay attention to me (0.19)
Anxiety (corr = 0.41, concrete √AVE = 0.35)
Abstract Factor (√AVE = 0.81)
I am an anxious person (0.84)
I worry about things (0.83)
I panic easily (0.76)
Concrete Factor (√AVE = 0.35)
I'm anxious about whether my friends secretly dislike me (0.51)
I think that even if I do badly at a big exam or job interview, I will still have lots of good opportunities in life (-0.50)
I would feel uncomfortable about asking for assistance in a supermarket (0.42)
If part of my home (e.g. plumbing) was old and needed replacement, I would feel confident in handling that (-0.35)
If I get lost, I like thinking of it as being an adventure (-0.28)
I stress about making sure that my house is fine when holding an event for my family (0.28)
I am worried about my family members when they get sick (0.08)
I avoid learning about bad stuff happening on the other side of the globe that will never affect me personally (0.01)
If I have a task at work that I know is going to involve a lot of bureaucracy, I will likely procrastinate on it (-0.44)
Sometimes when trying to do a task, I can end up spending a long time just staring while not getting anything done (-0.42)
At work, I try to do my tasks extra slowly or avoid saying when I'm done, to avoid being assigned more tasks (-0.34)
I feel that if I do not work hard enough, then that is going to screw over others (0.30)
I put in extra thought or practice in my spare time for team games to avoid being the weak link in the team (0.16)
If I notice that someone at work has a problem, I love going in and seeing if I can help fix it (0.09)
Self-Control (corr = 0.34, concrete √AVE = 0.33)
Abstract Factor (√AVE = 0.67)
I easily resist temptations (0.74)
I have good self-control (0.69)
I rarely overindulge (0.56)
Concrete Factor (√AVE = 0.33)
I have a hard time controlling my diet (-0.54)
I am bad at saving money (-0.54)
I can't stop myself from constantly checking social media (-0.39)
I stay up at night for longer than I feel I should (-0.28)
I make sexual mistakes because I get too horny (-0.28)
If I think my friends are doing something stupid, I can easily resist peer pressure to join in (0.22)
I try to seem in control during emergencies (0.16)
I avoid drinking excessive amounts of alcohol (0.14)
If I have a deadline at work, I can work overtime and cancel my commitments in my free time to ensure I make it (0.12)
Compassion (corr = 0.34, concrete √AVE = 0.33)
Abstract Factor (√AVE = 0.74)
I am concerned about others (0.77)
I am compassionate (0.76)
I am sensitive to the needs of others (0.71)
Concrete Factor (√AVE = 0.33)
If people can't pay back their debts, then it's their own fault and I don't feel bad for consequences that might befall them (-0.51)
If the pet of someone close to me had run away, I might joke that it could have been run over by a car (-0.47)
I feel uncomfortable if my friends are unhappy (0.44)
I show support to people who feel concerned about catching diseases (0.32)
If people seem upset, I try to figure out whether they have a real problem or are just being dramatic (-0.28)
I give things to homeless people (0.26)
If someone asked for feedback about food they were proud of making, and I didn't like the food, I'd tell them it sucks (-0.23)
If people don't want to date me, it's usually because they are shallow assholes (-0.17)
I know how to make sad people feel happier after they've lost someone close to them (0.08)
Introspection (corr = 0.24, concrete √AVE = 0.32)
Abstract Factor (√AVE = 0.63)
I love to reflect on things (0.69)
I like to get lost in thought (0.60)
I try to understand myself (0.58)
Concrete Factor (√AVE = 0.32)
If I don't understand an event, I will try a lot to figure out what happened - why people did what they did (0.48)
I try to think about how I could improve my abilities (0.43)
If I have a strong emotional reaction to something, I keep thinking about why until I come up with an explanation (0.39)
I believe that introspecting too much can damage your psyche (-0.25)
I am often thinking back to past times that I found enjoyable (0.23)
I don't believe it's worth thinking about things you can't change (-0.20)
I avoid thinking about past experiences when they make me feel sad or embarrassed (-0.13)
Impulsivity (corr = 0.24, concrete √AVE = 0.26)
Abstract Factor (√AVE = 0.64)
I make rash decisions (0.74)
I am impulsive (0.72)
I stop to think things over before doing anything (-0.41)
Concrete Factor (√AVE = 0.26)
I impulsively end up making reservations or buying tickets to things without thinking through the best time or place to do it (0.43)
When going out to stores I usually end up buying something I don't need (0.38)
I would never quit my job before having a new job ready (-0.26)
I agree to tasks at work before figuring out all the details such as my responsibilities or the deadlines (0.23)
I dislike surprise parties (-0.20)
Before I get started working on a task, I make sure to gather all the things I need for the task (-0.18)
Sometimes I do random physical things such as jumping around (0.14)
Before leaving my home, I make sure to check the traffic, weather forecasts, and other things that might need to be taken into account (-0.10)
Trust (corr = 0.22, concrete √AVE = 0.23)
Abstract Factor (√AVE = 0.69)
I trust people (0.81)
I feel that most people can't be trusted (-0.78)
I believe that people are basically moral (0.40)
Concrete Factor (√AVE = 0.23)
I think people will never help you unless it benefits themselves somehow (-0.37)
I think my potential dating partners secretly have horribly judgemental thoughts about me, even if they pretend to be nice (-0.31)
I believe that if I lend money to my friends, they would pay me back when it is feasible (0.23)
I trust children when they say they have a problem or need help (0.22)
Police usually have to deal with dishonest criminals, who will say anything to slip out of the law (-0.18)
I trust that my coworkers will be qualified to do their jobs, even when I haven't seen them work (0.16)
If someone comes to me with a problem that they need help on, I trust them to have provided accurate and relevant information for me to help them (0.16)
I think companies contaminate their food with chemicals that they don't put on the labels (-0.12)
Irritability (corr = 0.21, concrete √AVE = 0.22)
Abstract Factor (√AVE = 0.78)
I get angry easily (0.84)
I seldom get mad (-0.78)
I am irritable (0.72)
Concrete Factor (√AVE = 0.22)
I get very annoyed if buses/trains are cancelled and I have to wait a long time as a result (0.29)
I'd get angry at my family if they got sick (0.27)
If people at work mess up, I'd always have patience with helping them repair the problem and improve themselves (-0.26)
I can't stand the sound of another person chewing (0.24)
I get frustrated when I can't figure out a problem at work (0.23)
If a company I ordered something from has a delay, I'm fine with waiting a bit, as long as I still get my order (-0.19)
I have had a long, close relationship with someone who often took terrible advantage of me (0.12)
If people I am close with confront me about something, I'd usually take the blame, even if I don't think it is my fault (-0.04)
I don't feel the need to arrange any elaborate events to go to in my free time (0.19)
I think it is best to take it easy about exams and interviews, rather than worrying a bunch about doing it right (0.19)
I don't feel like I should have breaks at work unless I've "earned" them by finishing something productive (-0.17)
In the evening I tend to relax and watch some videos/TV (0.15)
I have a stressful job (-0.11)
I think you've got to have low expectations of others, as otherwise they will let you down (0.03)
I get angry about politics (0.00)
Reassiging Items to Traits
A problem we see is that some items load very weakly on their respective traits. Upon further examination, I began to suspect that some of them do not load on their assigned trait at all, but rather on a different one. For example, an item such as “If nobody is talking to me at a social event, I will often bring up a relatable topic (such as politics or the weather) to begin conversation” is assigned to the Attention-Seeking factor but may fit better under the Charisma factor. So let’s see how the factors look when I reassign1 items to factors.
Art Appreciation
Item Loadings
I appreciate art (0.89)
I believe in the importance of art (0.85)
I don't find much pleasure in looking at art (-0.83)
I think art is a waste of time because it is not to any practical benefit (-0.82)
I associate art with boredom and snobbery (-0.76)
I visit art galleries (0.71)
I believe that a good way to get educated about other cultures is to look at their art (0.68)
I do not like poetry (-0.62)
I find the atmosphere of art galleries to be very comfortable (0.57)
I enjoy writing texts that describe a scene with a clear mood (0.44)
Originally assigned to Emotional Expressiveness
I have a hobby of creating decorations for my home (0.40)
Originally assigned to Creativity
I am interested in spirituality that happens outside of traditional religions (0.38)
Originally assigned to Conformity
If people can't pay back their debts, then it's their own fault and I don't feel bad for consequences that might befall them (-0.37)
Originally assigned to Compassion
I was better at math than humanities at school (-0.35)
Originally assigned to Creativity
Missing Items
I am bad at drawing
Item Correlation Matrix
Orderliness
Item Loadings
I keep things tidy (0.90)
I keep my home tidy (0.88)
I am orderly (0.83)
I often feel too lazy to clean my house (-0.69)
Originally assigned to Industriousness
I cannot be bothered to ensure that my house looks perfect (-0.68)
Originally assigned to Perfectionism
I don't have the energy to tidy up my living place (-0.64)
I often forget to put things back in their proper place (-0.64)
I don't see the need in tidying up as I can find my things anyway (-0.60)
I don't really notice if things are messy (-0.56)
I remember to water plants when needed (0.38)
Before I get started working on a task, I make sure to gather all the things I need for the task (0.36)
Originally assigned to Impulsivity
I spend money to come up with the perfect storage systems (0.35)
Originally assigned to Perfectionism
I have lots of unread emails (-0.34)
I have a strict morning routine that I can't stand breaking (0.32)
Originally assigned to Adaptability
If I have a task at work that I know is going to involve a lot of bureaucracy, I will likely procrastinate on it (-0.32)
Originally assigned to Industriousness
Missing Items
I write things that must be bought on a list to keep track of them
I make a plan ahead of holidays for what to do each day during the holiday
Item Correlation Matrix
Well-Being
Item Loadings
I am happy (0.83)
I dislike myself (-0.74)
I love life (0.73)
I feel that I am a burden on my loved ones (-0.72)
I believe I have the ability to cope with whatever problems life throws at me (0.65)
I feel like others find my appearance repulsive (-0.62)
I think that even if I do badly at a big exam or job interview, I will still have lots of good opportunities in life (0.61)
Originally assigned to Anxiety
I think my potential dating partners secretly have horribly judgemental thoughts about me, even if they pretend to be nice (-0.60)
Originally assigned to Trust
I am happy about how it is going for my family (0.56)
I feel like it is dangerous to be too happy, as it will lead to things going wrong (-0.55)
I engage in lots of enjoyable activities in my free time (0.52)
I am afraid of participating in events where a lot of people would be looking at me perform (-0.49)
Originally assigned to Attention-Seeking
I feel I have friends that I can rely on for support (0.46)
My choice of career was a mistake (-0.42)
Originally assigned to Intellect
Missing Items
I spend time on social media, looking at successful people and feeling envious of how well they are doing
Item Correlation Matrix
Conservatism
Item Loadings
I am politically conservative (0.89)
I oppose gay marriage (0.84)
I believe we must reduce immigration (0.73)
I tend to vote for liberal political candidates (-0.72)
I believe we need greener energy (-0.66)
Leftists are reckless about the economy (0.64)
I take part in leftist political marches and protests (-0.61)
I believe in one true religion (0.50)
Missing Items
I dress in a modest manner
I would never get a tattoo
I believe that laws ought to be strongly enforced
I do not trust conservative politicians
Children ought to be empowered to be more independent and know their rights
Item Correlation Matrix
Charisma
Item Loadings
I am skilled at handling social situations (0.81)
I am charismatic (0.79)
I lack the talent for influencing people (-0.74)
I accidentally tend to make bad first impressions because I am awkward (-0.68)
If I'm at a party where I don't know many people, I often spend a lot of time by myself, rather than striking up conversation (-0.67)
I tend to be awkward when doing presentations for people (-0.65)
I don't know how to do smalltalk (-0.63)
Originally assigned to Sociability
If I have to speak about some topic, I can quickly figure out the key points and prepare a presentation with short notice (0.60)
Originally assigned to Adaptability
I can stay stable and composed while coming up with solutions to urgent problems at work, even if my coworkers are worried and panicking (0.57)
Originally assigned to Emotional Stability
I love doing presentations of topics that interest me to crowds of people (0.55)
Originally assigned to Sociability
I end up feeling clueless about what others are talking about at work (-0.54)
Originally assigned to Intellect
If nobody is talking to me at a social event, I will often bring up a relatable topic (such as politics or the weather) to begin conversation (0.53)
Originally assigned to Attention-Seeking
If someone is treating me in a way that I am uncomfortable with, then I am capable of explaining what bothers me to them (0.52)
Originally assigned to Emotional Expressiveness
I don't feel I can come up with many good ideas when brainstorming with a group of people (-0.51)
Originally assigned to Creativity
My coworkers treat me like I am a role model for them (0.45)
I try to seem in control during emergencies (0.45)
Originally assigned to Self-Control
I know how to make sad people feel happier after they've lost someone close to them (0.39)
Originally assigned to Compassion
Missing Items
I go out of my way to find shared things to talk about with people I want to befriend
I share what I do on social media and inspire others to do similar things
When someone close to me has helped me, I give praise to them so they will help me more later
I think about where conversations are going so that I can steer them towards everyone feeling comfortable and sharing their perspective
I tend to hedge my claims, e.g. saying "maybe" or "sometimes" or "I think" a lot to appear less certain
In conversations, I jump straight to the point rather than doing smalltalk and other irrelevant things
Item Correlation Matrix
Intellect
Item Loadings
I am quick to understand things (0.84)
I can handle a lot of information (0.76)
When I have a puzzling problem at work, I am good at analyzing it to find a fixable root cause (0.76)
Originally assigned to Creativity
I am intelligent (0.75)
I've often been very quick at grasping topics that others find difficult in school (0.71)
I can learn to perform a new kind of job that I haven't tried before (0.60)
Originally assigned to Adaptability
I end up feeling clueless about what others are talking about at work (-0.55)
I've done well at exams in school (0.53)
I am quick at reading big, advanced books (0.52)
I avoid voicing my disagreement at work if everyone else thinks we should do something one way (-0.52)
Originally assigned to Conformity
When I try to learn new skills for work, I keep doing things wrong (-0.52)
At work I avoid coming up with new methods, and instead just copy old ones that have worked before (-0.50)
Originally assigned to Creativity
I try to seem in control during emergencies (0.46)
Originally assigned to Self-Control
I don't understand how to play board games or card games (-0.46)
At work, I often end up providing instruction to coworkers (0.44)
Missing Items
My choice of career was a mistake
Item Correlation Matrix
Sociability
Item Loadings
I am sociable (0.84)
I usually like to spend my free time with people (0.73)
If I'm at a party where I don't know many people, I often spend a lot of time by myself, rather than striking up conversation (-0.73)
Originally assigned to Charisma
I avoid company (-0.70)
I don't know how to do smalltalk (-0.62)
I have groups of people (outside of work) that I regularly meet up with (0.59)
I accidentally tend to make bad first impressions because I am awkward (-0.59)
Originally assigned to Charisma
I like to dance with people at parties (0.55)
If nobody is talking to me at a social event, I will often bring up a relatable topic (such as politics or the weather) to begin conversation (0.54)
Originally assigned to Attention-Seeking
I feel I have friends that I can rely on for support (0.49)
Originally assigned to Well-Being
I don't feel the need to arrange any elaborate events to go to in my free time (-0.45)
Originally assigned to Easy-Goingness
I dislike surprise parties (-0.44)
Originally assigned to Impulsivity
I would feel uncomfortable about asking for assistance in a supermarket (-0.41)
Originally assigned to Anxiety
Missing Items
I love doing presentations of topics that interest me to crowds of people
I find teamwork to be a effective way to learn new skills
I enjoy cooking food for other people
I'd find it a bothersome to go with a friend to an activity that I am not interested in
I use headphones to avoid having people try to start conversations with me
I have been bullied in school
Item Correlation Matrix
Emotional Stability
Item Loadings
I am emotionally stable (0.85)
I get overwhelmed by emotions (-0.79)
I think that my moods don't change more than most people's do (0.68)
I go from happy to suddenly quite sad if a minor part of my daily routine goes wrong (-0.64)
I believe I have the ability to cope with whatever problems life throws at me (0.64)
Originally assigned to Well-Being
I feel that I am a burden on my loved ones (-0.63)
Originally assigned to Well-Being
I can stay stable and composed while coming up with solutions to urgent problems at work, even if my coworkers are worried and panicking (0.59)
I'm anxious about whether my friends secretly dislike me (-0.58)
Originally assigned to Anxiety
I can calmly deal with bureaucracy in emergency situations (0.46)
I am bad at saving money (-0.43)
Originally assigned to Self-Control
If someone is trying to manipulate someone close to me, then I can stay calm while unravelling the lies (0.43)
Missing Items
I can easily tolerate being around toxic people
If someone I hold dear does something that upsets me, then I can end up assuming that they want to hurt me, when more likely it was an accident
I have had a dramatic breakup where my relationship with someone was totally destroyed and I hated them afterwards
I suddenly become quite excited if a minor part of my plan goes better than expected
Item Correlation Matrix
Authoritarianism
Item Loadings
I respect authority (0.77)
I believe that it is important that everyone respects the law (0.68)
I think the police are terrible (-0.67)
I believe that laws ought to be strongly enforced (0.65)
Originally assigned to Conservatism
I rebel against authority (-0.63)
I believe that we should be tough on crime (0.61)
I respect the hierarchy at my workplace (0.55)
Children ought to be empowered to be more independent and know their rights (-0.48)
Originally assigned to Conservatism
I do not trust conservative politicians (-0.43)
Originally assigned to Conservatism
I respected teachers in school (0.42)
Originally assigned to Conformity
I believe we must reduce immigration (0.41)
Originally assigned to Conservatism
I have the standard goals in life: get married and have children and my own home (0.39)
Originally assigned to Conformity
If I feel a rule is bad then I will deliberately violate it out of principle (-0.38)
I take part in leftist political marches and protests (-0.38)
Originally assigned to Conservatism
If I saw someone do a minor violation of a policy at work, I would make sure to report them (0.36)
Originally assigned to Honesty
I was well-behaved in school (0.36)
Originally assigned to Sensation-Seeking
I would never quit my job before having a new job ready (0.35)
Originally assigned to Impulsivity
I think it is important to pay good attention to training in following rules and regulations at work (0.35)
Missing Items
I would never text while driving
I broke the rules the government had set for preventing COVID spread
I've protested against getting poor grades in school that I've felt were unfair
Item Correlation Matrix
Attention-Seeking
Item Loadings
I hate being the center of attention (-0.78)
I seek attention (0.66)
I don't like the attention I get at big parties like my birthdays or my wedding (-0.66)
I put on a show to impress people (0.63)
I love doing presentations of topics that interest me to crowds of people (0.59)
Originally assigned to Sociability
I am afraid of participating in events where a lot of people would be looking at me perform (-0.57)
When I'm feeling happy, I love talking about how great everything is going (0.40)
Originally assigned to Emotional Expressiveness
In groups, if someone is telling a story about themselves, then I will often bring up relevant personal experiences and start telling my own story (0.37)
I dress in a modest manner (-0.37)
Originally assigned to Conservatism
When I organize events, I find it important to emphasize to people that it was me who planned the event (0.36)
I exaggerate stories about myself to make them more exciting (0.30)
Originally assigned to Honesty
Missing Items
I try to moderate my mood so people will find me more exciting and pay attention to me
If nobody is talking to me at a social event, I will often bring up a relatable topic (such as politics or the weather) to begin conversation
If I'm out in public and my companions start acting weird and silly, I would worry people are judging me
I find it embarrassing to be praised for my achievements/abilities
Item Correlation Matrix
Anxiety
Item Loadings
I worry about things (0.82)
I am an anxious person (0.80)
I panic easily (0.79)
I feel that I am a burden on my loved ones (0.69)
Originally assigned to Well-Being
I'm anxious about whether my friends secretly dislike me (0.65)
I believe I have the ability to cope with whatever problems life throws at me (-0.65)
Originally assigned to Well-Being
I go from happy to suddenly quite sad if a minor part of my daily routine goes wrong (0.61)
Originally assigned to Emotional Stability
I think that even if I do badly at a big exam or job interview, I will still have lots of good opportunities in life (-0.59)
I can stay stable and composed while coming up with solutions to urgent problems at work, even if my coworkers are worried and panicking (-0.56)
Originally assigned to Emotional Stability
I accidentally tend to make bad first impressions because I am awkward (0.50)
Originally assigned to Charisma
I worry that people will judge me if I laugh too hard (0.47)
Originally assigned to Humor
I spend time on social media, looking at successful people and feeling envious of how well they are doing (0.43)
Originally assigned to Well-Being
I get frustrated when I can't figure out a problem at work (0.40)
Originally assigned to Irritability
Missing Items
I would feel uncomfortable about asking for assistance in a supermarket
I am worried about my family members when they get sick
I stress about making sure that my house is fine when holding an event for my family
I avoid learning about bad stuff happening on the other side of the globe that will never affect me personally
If I get lost, I like thinking of it as being an adventure
If part of my home (e.g. plumbing) was old and needed replacement, I would feel confident in handling that
Item Correlation Matrix
Emotional Expressiveness
Item Loadings
I express my emotions (0.77)
I reveal little about myself (-0.68)
I find it physically difficult to show emotions; my expression just naturally tends toward a neutral state (-0.63)
I express myself easily (0.62)
I feel that I ought to fix my own problems, rather than telling other people about them (-0.38)
If someone asks "How are you?", I will answer honestly even when I am feeling bad (0.35)
Missing Items
When I get angry at people, I scream and jump rather than being quietly angry
When I'm feeling happy, I love talking about how great everything is going
I enjoy writing texts that describe a scene with a clear mood
If someone is treating me in a way that I am uncomfortable with, then I am capable of explaining what bothers me to them
I would find it scary and embarrassing to cry at a funeral
Sometimes I try to debate something in a detached way while my debate partner ends up very emotional and upset about it
Item Correlation Matrix
Humor
Item Loadings
I am humorous (0.83)
I seldom joke around (-0.76)
I laugh a lot (0.69)
I use humor for coping with tough things (0.69)
I like to watch comedy films and/or stand-up comedy (0.42)
I am often sarcastic and make fun of myself and others (0.41)
Missing Items
I often play silly pranks on people close to me
I worry that people will judge me if I laugh too hard
I feel that people excessively use humor to distract from serious problems
I think that most supposedly funny stuff that people share is not really that funny
Item Correlation Matrix
Honesty
Item Loadings
I tell a lot of lies (-0.72)
I cheat to get ahead (-0.72)
I tell the truth (0.64)
I would cheat on an exam if it is difficult and hard (-0.62)
I wouldn't steal money from rich people, even if I could get away with it (0.56)
I exaggerate stories about myself to make them more exciting (-0.47)
If a shop makes a mistake that gets me my things cheaper, I make sure to inform them so I can pay them what they deserve (0.41)
I've lied to avoid having my parents be overprotective of me (-0.35)
Missing Items
If I saw someone do a minor violation of a policy at work, I would make sure to report them
I admit when I cause problems at work, even if I worry I may end up getting fired for it
If someone gives me a gift that ends up useless, I would pretend the gift is good so the giver feels useful
Item Correlation Matrix
Creativity
Item Loadings
I am creative (0.75)
I have a vivid imagination (0.65)
I am bad at coming up with fictional stories (-0.64)
I am able to come up with new and different ideas (0.62)
I am good at creating visualizations that help people understand a concept (0.38)
Missing Items
When I have a puzzling problem at work, I am good at analyzing it to find a fixable root cause
I have a hobby of creating decorations for my home
I like making making quizzes/games or planning adventures/trips for people
At work I avoid coming up with new methods, and instead just copy old ones that have worked before
I don't feel I can come up with many good ideas when brainstorming with a group of people
I was better at math than humanities at school
Item Correlation Matrix
Industriousness
Item Loadings
I often feel too lazy to clean my house (-0.73)
I don't have the energy to tidy up my living place (-0.69)
Originally assigned to Orderliness
I start tasks right away (0.67)
I neglect my duties (-0.67)
Sometimes when trying to do a task, I can end up spending a long time just staring while not getting anything done (-0.55)
I work hard (0.50)
If I have a task at work that I know is going to involve a lot of bureaucracy, I will likely procrastinate on it (-0.43)
I can't stand working with lazy people (0.42)
Missing Items
If I notice that someone at work has a problem, I love going in and seeing if I can help fix it
I put in extra thought or practice in my spare time for team games to avoid being the weak link in the team
I feel that if I do not work hard enough, then that is going to screw over others
At work, I try to do my tasks extra slowly or avoid saying when I'm done, to avoid being assigned more tasks
Item Correlation Matrix
Self-Control
Item Loadings
I easily resist temptations (0.73)
I have good self-control (0.66)
I rarely overindulge (0.62)
I have a hard time controlling my diet (-0.57)
I am bad at saving money (-0.49)
I make sexual mistakes because I get too horny (-0.35)
Missing Items
If I think my friends are doing something stupid, I can easily resist peer pressure to join in
If I have a deadline at work, I can work overtime and cancel my commitments in my free time to ensure I make it
I try to seem in control during emergencies
I avoid drinking excessive amounts of alcohol
I can't stop myself from constantly checking social media
I stay up at night for longer than I feel I should
Item Correlation Matrix
Compassion
Item Loadings
I am concerned about others (0.81)
I am compassionate (0.77)
I am sensitive to the needs of others (0.72)
I think about where conversations are going so that I can steer them towards everyone feeling comfortable and sharing their perspective (0.53)
Originally assigned to Charisma
I am worried about my family members when they get sick (0.52)
Originally assigned to Anxiety
I feel uncomfortable if my friends are unhappy (0.47)
If people can't pay back their debts, then it's their own fault and I don't feel bad for consequences that might befall them (-0.45)
If I notice that someone at work has a problem, I love going in and seeing if I can help fix it (0.41)
Originally assigned to Industriousness
I show support to people who feel concerned about catching diseases (0.39)
I give things to homeless people (0.37)
I feel that if I do not work hard enough, then that is going to screw over others (0.33)
Originally assigned to Industriousness
Missing Items
I know how to make sad people feel happier after they've lost someone close to them
If someone asked for feedback about food they were proud of making, and I didn't like the food, I'd tell them it sucks
If people seem upset, I try to figure out whether they have a real problem or are just being dramatic
If the pet of someone close to me had run away, I might joke that it could have been run over by a car
If people don't want to date me, it's usually because they are shallow assholes
Item Correlation Matrix
Introspection
Item Loadings
I love to reflect on things (0.72)
I try to understand myself (0.62)
I like to get lost in thought (0.59)
If I don't understand an event, I will try a lot to figure out what happened - why people did what they did (0.57)
If I have a strong emotional reaction to something, I keep thinking about why until I come up with an explanation (0.47)
I try to think about how I could improve my abilities (0.45)
Missing Items
I am often thinking back to past times that I found enjoyable
I don't believe it's worth thinking about things you can't change
I avoid thinking about past experiences when they make me feel sad or embarrassed
I believe that introspecting too much can damage your psyche
Item Correlation Matrix
Impulsivity
Item Loadings
I am impulsive (0.77)
I make rash decisions (0.74)
I impulsively end up making reservations or buying tickets to things without thinking through the best time or place to do it (0.51)
When going out to stores I usually end up buying something I don't need (0.43)
I stop to think things over before doing anything (-0.43)
I was well-behaved in school (-0.40)
Originally assigned to Sensation-Seeking
Missing Items
Sometimes I do random physical things such as jumping around
I agree to tasks at work before figuring out all the details such as my responsibilities or the deadlines
I would never quit my job before having a new job ready
Before I get started working on a task, I make sure to gather all the things I need for the task
Before leaving my home, I make sure to check the traffic, weather forecasts, and other things that might need to be taken into account
I dislike surprise parties
Item Correlation Matrix
Trust
Item Loadings
I feel that most people can't be trusted (-0.84)
I trust people (0.81)
I think you've got to have low expectations of others, as otherwise they will let you down (-0.64)
Originally assigned to Easy-Goingness
I think people will never help you unless it benefits themselves somehow (-0.48)
I believe that people are basically moral (0.38)
Missing Items
I believe that if I lend money to my friends, they would pay me back when it is feasible
I trust that my coworkers will be qualified to do their jobs, even when I haven't seen them work
I trust children when they say they have a problem or need help
If someone comes to me with a problem that they need help on, I trust them to have provided accurate and relevant information for me to help them
I think my potential dating partners secretly have horribly judgemental thoughts about me, even if they pretend to be nice
I think companies contaminate their food with chemicals that they don't put on the labels
Police usually have to deal with dishonest criminals, who will say anything to slip out of the law
Item Correlation Matrix
Irritability
Item Loadings
I get angry easily (0.86)
I seldom get mad (-0.79)
I am irritable (0.71)
When I get angry at people, I scream and jump rather than being quietly angry (0.50)
Originally assigned to Emotional Expressiveness
I get angry about politics (0.35)
Originally assigned to Easy-Goingness
Missing Items
I can't stand the sound of another person chewing
I get frustrated when I can't figure out a problem at work
I'd get angry at my family if they got sick
I get very annoyed if buses/trains are cancelled and I have to wait a long time as a result
If a company I ordered something from has a delay, I'm fine with waiting a bit, as long as I still get my order
If people at work mess up, I'd always have patience with helping them repair the problem and improve themselves
If people I am close with confront me about something, I'd usually take the blame, even if I don't think it is my fault
I have had a long, close relationship with someone who often took terrible advantage of me
Item Correlation Matrix
Sensation-Seeking
Item Loadings
I seek adventure (0.83)
I seek excitement (0.81)
I like to dance with people at parties (0.57)
Originally assigned to Sociability
I love dangerous situations (0.54)
I go out of my way to find shared things to talk about with people I want to befriend (0.51)
Originally assigned to Charisma
If I get lost, I like thinking of it as being an adventure (0.44)
Originally assigned to Anxiety
I enjoy cooking food for other people (0.40)
Originally assigned to Sociability
Missing Items
I enjoy looking down at the ground from dizzyingly high places
I like physically intense sports
I find it exciting when people are loudly arguing with each other
I have had sex outdoors
Rollercoasters make me afraid of getting maimed
I try to avoid drunk people when I'm outside, as they seem risky to be around
I wouldn't dare to put a lot of money in a risky investment
I was well-behaved in school
Item Correlation Matrix
Perfectionism
Item Loadings
I want every detail to be taken care of (0.65)
I want everything to be perfect (0.65)
I am hard to satisfy (0.26)
Missing Items
I think that imperfect work might get me fired
I try to make sure that my appearance (hair, outfit, etc.) is perfect
I experiment with recipes to optimize them to be as perfectly delicious as possible
I spend money to come up with the perfect storage systems
At work, it is more important that I get as much done as possible than that all the details are perfect
I cannot be bothered to ensure that my house looks perfect
I don't mind being second place in games
I don't consider it sloppy if people let some details be imperfect
Item Correlation Matrix
Conformity
Item Loadings
I like to be thought of as a normal kind of person (0.64)
I see myself as an average person (0.60)
I am conformist (0.49)
Missing Items
I have the standard goals in life: get married and have children and my own home
I trust the government to know what to do about epidemics
I avoid voicing my disagreement at work if everyone else thinks we should do something one way
I respected teachers in school
I wear unusual clothes to work
I have a deal to make my working times unusually flexible
I keep things in my home that others find creepy (e.g. animal skeletons or spiders)
I am interested in spirituality that happens outside of traditional religions
I am not a religious person
Item Correlation Matrix
Adaptability
Item Loadings
I prefer variety to routine (0.31)
I am adaptable (0.30)
I dislike changes (0.02)
Missing Items
I can learn to perform a new kind of job that I haven't tried before
I can easily adapt to living in foreign cultures
If I have to speak about some topic, I can quickly figure out the key points and prepare a presentation with short notice
If I'm missing some ingredients for a meal I'm cooking, then I can improvise an alternative
I have a strict morning routine that I can't stand breaking
I can't deal with if a friend cancels an event we had planned
I often re-watch TV shows or re-read stories
I find it bothersome to deal with new requirements about how to be eco-friendly
Item Correlation Matrix
Easy-Goingness
Item Loadings
I have a slow pace to my life (0.51)
I hang around doing nothing (0.48)
I take it easy (0.25)
Missing Items
In the evening I tend to relax and watch some videos/TV
I don't feel the need to arrange any elaborate events to go to in my free time
I think it is best to take it easy about exams and interviews, rather than worrying a bunch about doing it right
I think you've got to have low expectations of others, as otherwise they will let you down
I get angry about politics
I have a stressful job
I don't feel like I should have breaks at work unless I've "earned" them by finishing something productive
I spent a lot of effort on parenting
Item Correlation Matrix
Implications
While reassigning the items makes the factors clearer, it does raise concerns about personality tests in general. According to Tailcalled, the concrete items were derived by first giving the SPI-81-27&5 test to a number of people and then asking those who scored high or low on various traits to describe examples of how they could be said to possess (or not possess) those traits.
Given this, the fact that so many items do not load on their assigned factors is concerning. The reason measuring personality is useful is that it lets us predict behavior. If there are no behaviors that can be predicted by a personality trait, why does the trait matter at all?
But there is another question: what exactly is going on in a respondent’s mind when they answer one of the abstract items?
A reasonable assumption is that when someone considers an abstract item (such as “I appreciate art”) they think about whether they exhibit specific behaviors, such as visiting art galleries, associating art with snobbery, or creating decorations. Depending on how strongly they exhibit such behaviors, they decide whether they agree or disagree with the statement.
For traits like Art Appreciation, this process seems to work well. The specific behaviors correlate strongly with one another and with the abstract items. But for a trait like Conformity, something appears to have gone wrong. When people are asked how exactly they can be said to be conformist, they give behaviors such as being interested in spirituality or avoiding voicing disagreements at work. Yet these behaviors do not seem to correlate very well with one another or with the abstract items.
This raises the question of what is going on in someone’s head when they consider an abstract item such as “I like to be thought of as a normal kind of person” (which loads on Conformity). Is everyone thinking of different behaviors? If so, it does not seem like a person’s score on that item would mean very much. Or maybe people are simply responding based on how much they vibe with the statement, which is not much better.
Perhaps there needs to be more focus on ensuring that personality tests have external, or criterion, validity.
To reassign the items, I fit a model in which items load on all factors. The item loadings have a spike-and-slab prior, and I count an item as assigned to a factor if its posterior loading on that factor has an absolute value greater than or equal to 0.10. ↩
