Front. Psychol. Frontiers in Psychology Front. Psychol. 1664-1078 Frontiers Media S.A. 10.3389/fpsyg.2023.1256779 Psychology Original Research Neutral is not fair enough: testing the efficiency of different language gender-fair strategies Spinelli Elsa 1 Chevrot Jean-Pierre 2 Varnet Léo 3 * 1Laboratoire de Psychologie et NeuroCognition, Université Grenoble Alpes, CNRS, Grenoble, France 2Laboratoire Lidilem, Université Grenoble Alpes, Grenoble, France 3Laboratoire des Systèmes Perceptifs, Département d'Études Cognitives, École Normale Supérieure, Université PSL, CNRS, Paris, France

Edited by: Ludovic Ferrand, Centre National de la Recherche Scientifique (CNRS), France

Reviewed by: Ana Rita Sá-Leite, University of Santiago de Compostela, Spain; Elena Dubenko, University of Basel, Switzerland

*Correspondence: Léo Varnet leo.varnet@cnrs.fr
29 09 2023 2023 14 1256779 11 07 2023 11 09 2023 Copyright © 2023 Spinelli, Chevrot and Varnet. 2023 Spinelli, Chevrot and Varnet

This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

In many languages with grammatical gender, the use of masculine forms as a generic reference has been associated with a bias favoring masculine-specific representations. This article examines the efficiency of gender-fair forms, specifically gender-unmarked forms (neutralization strategy, e.g., “l'enfant”) and contracted double forms (re-feminization strategy, e.g., “un·e enfant”), in reducing gender biases in language. Extensive empirical research has shown that gender-fair forms have the potential to promote more gender-balanced representations. However, the relative efficiency of these strategies remains a subject of debate in the scientific literature. In order to explore these questions, two experiments were conducted in French. We analyzed the response times and percent correct scores using a sentence evaluation paradigm, where the participants had to decide whether a second sentence starting with a gendered personal pronoun (“il” or “elle”) was a sensible continuation of the first sentence written in a gender-fair form. Experiment 1 confirmed that gender-unmarked forms are not fully effective in neutralizing the masculine bias. In Experiment 2, a comparison was made between gender-unmarked forms and contracted double forms, to assess their respective abilities to generate more balanced representations. The findings indicated that contracted double forms are more effective in promoting gender balance compared to gender-unmarked forms. This study contributes to the existing scientific literature by shedding light on the relative efficiency of neutralization and re-feminization strategies in reducing gender biases in language. These results have implications for informing efforts to promote more inclusive and unbiased language practices.

gender-fair language generic masculine gender-neutral noun gender representation masculine bias section-at-acceptance Psychology of Language

香京julia种子在线播放

    1. <form id=HxFbUHhlv><nobr id=HxFbUHhlv></nobr></form>
      <address id=HxFbUHhlv><nobr id=HxFbUHhlv><nobr id=HxFbUHhlv></nobr></nobr></address>

      1. Introduction

      In languages with grammatical gender, such as French, the use of masculine forms to refer to both males and females, as well as unspecified or mixed-gender groups, is a common linguistic convention (Gygax et al., 2019). As a result, while the feminine form always has a specific interpretation, the masculine form can be used in both a specific and a generic sense. For instance, in French, the word étudiantes [studentsFEM] unambiguously refers to a group of female students, while the word étudiants [studentsMASC] can refer to a group of only male students, both male and female students, or even students whose gender is unknown. This ambiguity poses challenges for language processing as the cognitive system needs to resolve the reference of the noun. This is evident in the following example, which is particularly challenging for French speakers due to the alternation of generic and specific senses of the same masculine form within a single sentence1:

      J'ai trente-quatre étudiants en cours, dont seulement sept sont des étudiants

      [I have thirty-four studentsMASC in my class, only seven of whom are studentsMASC]

      The resolution of this kind of ambiguity relies on various cognitive mechanisms, including world knowledge, context, and pragmatic cues. However, previous research suggests that the ambiguity is typically resolved to the disadvantage of the feminine gender, with the masculine generic favoring the activation of masculine-specific representations. For instance, in Experiment 1 of Gygax and Gabriel (2008), French-speaking participants had to decide, as fast as possible, whether the person referred to by a kinship term (e.g., un frère [a brother] or une sœur [a sister]) could be part of a group described by a role noun in the masculine generic form (e.g., musiciens [musiciansMASC]). The results revealed a strong bias toward male kinship terms, indicating that male kinship terms were more readily associated with role nouns written in the masculine form. Similarly, when asked to estimate the percentage of women in a group described by a generic masculine term, participants consistently selected gender ratios below 50%, despite the role nouns being non-stereotyped in terms of gender (Tibblin et al., 2023). Moreover, studies have shown that the use of generic masculine language in questionnaires can impact the self-reported efficacy of female respondents (Chatard-Pannetier et al., 2005; Vainapel et al., 2015). Wilson and Ng (1988) used a priming paradigm to manipulate the perception of gender in ambiguous photographs through short sentences presented beforehand. The results indicated that the use of masculine generic language in the sentences biased perception toward male faces. Together, the findings from these experiments, as well as other studies mentioned below, provide robust evidence supporting the notion that the use of masculine-generic forms automatically activates masculine-specific representations.

      One effective approach to reduce the influence of the masculine bias caused by masculine-generic forms is to employ gender-fair forms. Two main strategies can be distinguished regarding gender-fair language (see, e.g., Tibblin et al., 2023, Figure 1): neutralization on the one hand, which can be achieved, for instance, through the use of gender-unmarked words, and re-feminisation on the other hand, exemplified by the contracted double form. Gender-unmarked words have the same form for both male and for female referents,2 and are only differentiated by the preceding article. For instance, in French, le ministre vs. la ministre [theMASC ministerunmarked vs. theFEM ministerunmarked] refer to a male or female minister respectively. In certain cases, gender information can be entirely removed: when using plural forms (les ministres [theplur,unmarked ministersplur,unmarked]) or when an elision occurs on the article due to the phonological context (le or la replaced by l' if the following word begins with a vowel). For instance, l'acrobate [theunmarked acrobatunmarked] can refer to either a female or a male acrobat. On the other hand, the re-feminisation strategy consists in explicitly listing the masculine and feminine forms, such as un ou une ministre [aMASC or aFEM ministerunmarked]. This expression can be sometimes shortened into a contracted double form using a mid-dot (e.g., un·e ministre).3

      Average reaction times (A) and percentage of correct responses (B) for each participant in each of the two experiments. The boxplots show the median, and the 25th and 75th percentiles.

      There are two important distinctions between the gender-unmarked form and the contracted double form. First, while the gender-unmarked form is truly neutral in the sense that it lacks any explicit gender markings, the contracted double form explicitly includes both the feminine and the masculine forms. Secondly, these two forms hold different sociolinguistic status. Gender-unmarked forms are relatively common in standard French, even in a generic masculine context, whereas contracted double forms are still socially marked: although their use has been promoted in France since 2015 by the Haut Conseil à l'Égalité entre les femmes et les hommes (Guide pratique pour une communication publique sans stéréotypes de sexe, 2022), and is occasionally found in official documents, they are still considered as a radical linguistic innovation and have been the subject of intense public and political debates in the French society (see Candea and Véron, 2019; Loison-Leruste et al., 2020 for more sociocultural context).

      Extensive empirical research has been conducted to investigate whether the masculine bias associated with masculine generic forms can be eliminated or reduced through the use of gender-fair forms. Brauer and Landry (2008) conducted five studies comparing the activation of masculine representations in a masculine-generic context and in a double-form context in French. The results of all five experiments consistently demonstrated that double forms promote more gender-balanced representations. For instance, in the first experiment, participants cited nearly three times as many woman as a potential Prime Minister when the question was asked using a double form (candidat/candidate [candidateMASC/candidateFEM]), as compared to a generic masculine form (candidat [candidateMASC]) (Brauer and Landry 2008, exp. 1; see also Stahlberg and Sczesny, 2001). In a subsequent experiment, the use of masculine generics, as opposed to double forms, decreased the likelihood of participants naming a woman when asked to list their favorite heroes and artists (Brauer and Landry 2008, exp. 2; see also Stahlberg et al. 2001). The experimenters then conducted two experiments on adults and children, showing that grammatical form also influenced the gender of the imagined prototypical person when envisioning an occupational group (Brauer and Landry, 2008, exp. 3 and exp. 4). In a final experiment, participants read a short text about a professional gathering and estimated the percentages of men and women present. The findings indicated that the double form resulted in a more gender-balanced representation of the group when no information about its gender composition was provided (Brauer and Landry 2008, exp. 5; see also Braun et al., 1998, 2005; Xiao et al., 2023).

      Studies investigating the efficiency of the neutralization strategy in reducing masculine bias are more seldom. Kim et al. (2023) conducted a study in which participants had to judge whether an individual, identified solely by a gendered first name, could be part of a group described either in a plural generic masculine form or a gender-neutral form. The results demonstrated that the use of gender-neutral forms dramatically reduced the male bias observed with masculine forms, and that both grammatical forms used equal cognitive resources, as indicated by comparable response times. Richy and Burnett (2021) conducted a gender judgement task that yielded similar findings. Non-gender-stereotyped role names introduced with a masculine article (e.g., le journaliste [theMASC journalist]) were rated as masculine to a much higher degree than those introduced with a feminine article (e.g., la journaliste [theFEM journalist]). In contrast, when the gender marking was completely eliminated, such as in l'imperturbable journaliste [theunmarked unflappable journalist], the rating was close to balance (46%). These findings provide further support for the efficacy of gender-neutral forms in reducing masculine bias.

      This raises the question of whether one of the two strategies (neutralization or re-feminization) is more effective in promoting gender-balanced representations. Only a few studies have been designed to address this question, and the conclusions drawn from them are generally inconsistent. Lindqvist et al. (2019) explored whether job candidates described in short paragraphs were perceived as more masculine or more feminine when the summaries were written using gender-neutral words (such as “the applicant” or the singular “they”) or a double pronoun (“he/she”). The results indicate that double forms produced more balanced gender representations compared to gender-neutral forms, both in English and in Swedish. These findings align with other experiments conducted in French and German, suggesting that the specific type of gender-fair form may have a differential effects, particularly when they interact with stereotypical information (Irmen and Roßberg, 2004; Braun et al., 2005; Irmen, 2007; Brauer and Landry, 2008). However, these conclusions contradict those of other researchers. In a recent study conducted in French, Tibblin et al. (2023) compared the perceived gender ratio within groups described using a single role noun in the masculine generic form or four different gender-fair forms. The results indicated that all tested gender-fair forms were equally successful in countering the male bias induced by the masculine form, resulting in estimated percentages of women ranging between 49.1 to 50.0%. Similar results have also been reported in a study by Stahlberg et al. (2001) investigating neutralization and re-feminization strategies in German. Furthermore, several studies have found that gender-neutral forms were able to largely eliminate the masculine bias (see, in particular, Richy and Burnett, 2021; Kim et al., 2023, in French). These discrepancies may be attributed to methodological issues, such as inadequate control for response biases or insufficiently precise measures that might have hindered the detection of potential effects. For example, Tibblin et al. (2023) demonstrated that the direction of the response scale in a gender ratio estimation paradigm has a systematic effect on the results.

      In summary, both gender-unmarked forms (neutralization strategy) and contracted double forms (re-feminization strategy) have potential in reducing gender biases in language. However, gender-unmarked forms seem to yield intermediate results between double forms and masculine generic forms, suggesting a more nuanced impact on mental representations. Thus, the objective of the present study was twofold: firstly, to provide confirmation, using French sentences, that gender-unmarked forms are not fully effective in neutralizing the inherent masculine bias (Experiment 1); second, to compare this condition with a re-feminization strategy, specifically the contracted double form using a mid-dot (Experiment 2). Our hypothesis for the second experiment was that contracted double forms would yield more balanced representations than gender-unmarked forms.

      As noted above, the choice of a particular methodology is crucial for detecting potential differences among gender-fair forms. To ensure precise measurements capable of capturing these distinctions, we modified the sentence evaluation paradigm employed in prior studies (Gygax et al., 2008; Garnham et al., 2012). Compared to the more commonly-used gender-ratio estimation experiment, the sentence evaluation paradigm offers several advantages. It is less prone to ceiling effects as it relies on response time measurements. Additionaly, it is less susceptible to criterion effects, by avoiding subjective scaling task. Finally, stereotypes associated with nouns and contexts are known to greatly contribute to gendered interpretations. Thus, it is crucial to carefully control for this factor in experiments aimed at assessing the influence of grammatical gender. In practice, experimenters usually evaluate the level of stereotype associated with their stimuli prior to testing, in order to establish a stereotype-neutral condition (Irmen and Roßberg, 2004; Xiao et al., 2023). We adopted a similar approach in the present study.

      2. Experiment 1 2.1. Methods 2.1.1. Pre-test and stimuli selection

      The pre-test consisted in judging the extent to which a role noun was more represented by men or women. A list of 46 gender-unmarked words beginning with a vowel was tested (see Supplementary Table S1). A total of 74 participants (16 men and 58 women) took part in the pretest. They were all second-year psychology students recruited on a voluntary basis. Participants were asked to judge whether each word (e.g., accordéoniste [accordionist]) was more likely to be represented by women or men. They responded by ticking a line going from 100% men at the left edge of the line to 100% women at the right edge of the line (counterbalanced across participants). Then, masculine percentage was calculated for each word (for example, if a word received a 60% feminine rating, it was considered 40% masculine). The average masculine ratings across all participants are presented in Supplementary Table S1. The stereotypicality estimate were in close agreement with those obtained by Misersky et al. (2014), as evidence by a strong correlation in the masculine rating scores for the item examined in both their study and the present one (Supplementary Figure S1).

      We wanted our stimuli to be as unstereotyped as possible. Thus, we first selected the 25 words that came closest to 50% masculine. We further excluded two words (équilibriste [tightrope walker] and astrologue [astrologer]) that had a high standard deviation (19.8 and 24.58 respectively). Another one (harmoniciste [harmonica player]) was also removed, as over 10% of our participants did not know the meaning of this word and did not respond to this item. The 22 remaining words were then selected for the experiment (means ranged from 45.74 to 59.78% and standard deviations ranged from 6.724 to 17.907).

      2.1.2. Participants

      Forty-seven psychology students (44 women, 3 men) at Grenoble-Alpes University, participated in this study for course credit. They were all French native speakers and had either normal or corrected vision.

      2.1.3. Stimuli

      Each of the 22 gender-unmarked, non-stereotyped words that were selected by the means of the pretest (e.g., élève, [student]), was presented in a carrier sentence (hereafter context sentence). The gender-unmarked words all began with a vowel, so that the determiner l' [theunmarked] could be used, thus enabling grammatical gender neutrality in the context sentences (e.g., L'élève commenait à réviser, [Theunmarked studentunmarked began to study]). Twenty-two continuation sentences beginning by il [he] or elle [she], were associated to these context sentences and constituted a good continuation (e.g., Elle passait l'examen dans 15 jours [She was taking the exam in 15 days]). The list of all context and continuation sentences for the selected items is presented in Supplementary Table S2. There were also 22 gender-unmarked words beginning with a vowel (e.g., esclave, [slave]) presented in context sentences (e.g., L'esclave essaya de s'enfuir [The slave attempted to escape]) and followed by continuation sentences that constituted a bad continuation (e.g., Il faisait ses courses de Noël, [He was doing his Christmas shopping]). Moreover, there were also 22 consonant-initial filler words presented in context sentences and followed by continuation sentences that constituted a good continuation (e.g., Les vendeurs ont fait un bon chiffre. Ils ont atteint les dix-mille euros. [The sellers sold very well. They had takings of ten thousand euros.]). There were also 22 consonant-initial filler words presented in context sentences and followed by continuation sentences that constituted a bad continuation (e.g., Le lion est le roi de la savane. Il doit aller chercher les enfants à l'école. [The lion is king of the savannah. He has to pick up the kids from school.]). Consonant-initial filler words could be followed by either le [theMASC], la [theFEM] or les [theplural, unmarked] as determiners.

      2.1.4. Procedure

      Participants were seated ~50 cm from a computer screen. They were informed that they would read a succession of sentences, in pairs, and that they would have to determine as quickly as possible whether the second sentence was a good or bad continuation of the first one. The experiment was run on E-Prime 2.0 software (Psychology Software Tools, Pittsburgh, PA). The first sentence (context sentence) remained on the screen for 3 s. It was then replaced by the second one (continuation sentence). The participant then had to respond as quickly as possible by using one of the two keys on the keyboard. They were asked to press the “yes” key with their preferred hand. The intertrial interval was 3 s. The experiment began by 10 practice trials followed by a list of 88 (66 fillers and 22 experimental) trials that were randomly presented.

      For the 22 experimental trials, half of the continuation sentences began with il [he] and the other half with elle [she]. The gender assignment of the continuation sentence of each test item was counterbalanced in two experimental lists. The response of the participants to each stimulus were recorded, as well as their response time from the onset of the continuation sentence presentation.

      2.1.5. Analysis

      Data were analyzed through Bayesian hierarchical mixed effects regression models. This choice was motivated by the need to examine the influence of the predictor variable, grammatical gender, while accounting for the random variation between participants and items. By including the factors participant and item as random intercepts, we could capture the baseline response times for each participant and item separately, allowing for a more precise estimation of the effect of grammatical gender.

      Firstly, reaction times for all positive responses were examined.4 The z-scored response time data, RTz, was fitted with a model including a fixed effect of grammatical gender (0: feminine; 1: masculine) and two random effects of factors participant and item, entered as random intercepts:

      RTz=αp,i+βgender·gender+ϵ

      where ϵ~N(0,σ). Each pair of a specific participant p and a specific item i was associated with a unique intercept αp,i, whose distribution was described with three hyperparameters β0, σparticipant and σitem capturing the variability of individual differences in response times:

      α0,p,i=β0+βparticipant+βitem

      with βparticipant~N(0,σparticipant) and βitem~N(0,σitem). Weakly informative, conservative distributions βX~N(0,1) were used for all other effect-related parameter and for the hyperprior β0 (recall that all predictors were standardized). The dispersion of the participant-specific and item-specific parameters was associated with a prior distribution σX~Gamma(2, 0.1), enforcing the pooling of information to improve estimation. The same prior was used for σ. A graphical summary of this model and the prior distributions used is provided in Supplementary Figure S2.

      Secondly, participants' responses (yes/no) per item were analyzed using a logistic regression model with the same design as for the response time data. The probability of correct response was assumed to follow the general form for the psychometric function, with a chance level at 0.5:

      P(correct)=0.5+(0.5-pmiss)·p

      where pmiss represents the probability of lapse (defining the upper asymptote of the psychometric function) and p is a cumulative density function. This function is described with the standard logistic regression formula, following the same hierarchical model design as before:

      logit(p)=αp,i+βgender·gender

      For simplicity, pmiss was assumed to be the same for all participants and was estimated from the data using a weak Beta(5, 10) prior.

      All analyses were carried with R version 4.3.0 (R Core Team, 2020), using the RStan interface to Stan for Bayesian modeling (Carpenter et al., 2017; Stan Development Team, 2020). Seven chains of 7,000 samples each were run independently (3,000 burn-in samples, estimates based on 4,000 samples). Their convergence was monitored through standard summary statistics R-hat and Effective Sample Size, absence of divergent transition, and visual inspection of posterior distributions. Throughout this article, Bayesian estimates will be reported along with their 95% credible intervals, providing an assessment of the reliability of the results. All the codes and data supporting this analysis are openly available on Github at https://github.com/LeoVarnet/GenderFair/.

      2.2. Results

      The results from Experiment 1, averaged by participant, grammatical form and grammatical gender, are shown in Figure 1 (left panels). The posterior distributions for the intercept and fixed effects model parameters are shown in Figure 2 (upper panels). Posterior distributions for all parameters in the model are presented in Supplementary Figure S4.

      Posterior distributions for all fixed-effect parameters in the reaction-time models (A) and the percent-correct models (B). Upper panels correspond to Experiment 1, lower panels to Experiment 2. The blue regions indicate 95% credible intervals. The black contours delimit the 99% credible interval.

      2.2.1. Positive response times

      The average reaction times in the gender-neutral form condition was 1,594 ms ± 400 ms SD for continuation sentences beginning with a feminine pronoun and 1,468 ms ± 333 ms SD for continuation sentences beginning with a masculine pronoun. The posterior distribution for the parameter βgender in the varying-intercept hierarchical model revealed a strong effect of the grammatical gender factor, with an estimate centered around −0.22, CI95%= (−0.32, −0.13).

      It is important to note that reaction times varied noticeably across different items. For instance, the continuation sentence following l'acrobate [the acrobat] elicited a short average response time of 1,264 ms ± 313 ms (SD), while the one following l'adulte [the adult] required more processing time (mean response time = 1,845 ms ± 778 ms SD). These differences resulted in non-overlapping credible intervals for these items in the model (see Supplementary Figure S4).

      2.2.2. Percent correct scores

      Participants achieved scores ranging from 55 to 100% for feminine continuation sentences (mean = 84%), and from 64 to 100% for masculine continuation sentences (mean = 91%). This difference was associated with a strong βgender coefficient in the hierarchical logistic regression model [mean = 1.49, CI95%= (0.72, 2.45)]. The model also yielded a reliable estimate of pmiss to 6% [CI95%= (4%, 9%)].

      Similar to response times, a strong variability was found in the mean performance achieved on each specific item. A separate multivariate Gaussian distribution fitted on the vectors of random intercepts from the two models identified that the two variables were likely negatively correlated [R = −0.43, CI95%= (−0.73, −0.05)], indicating that the words corresponding to longer response times also yielded more errors.

      2.3. Interim discussion

      Experiment 1 aimed to investigate the effects of grammatical gender on response times and accuracy in sentence processing, specifically in a context where the words were previously referred to with gender-unmarked forms. The context sentence did not provide any grammatical-gender cue, and the words were selected to be stereotype-neutral (e.g., L'élève commenait à réviser [Theunmarked studentunmarked began to revise.]). Based on previous investigation by Irmen and Roßberg (2004) and Irmen (2007), our hypothesis was that even in this neutral context, a masculine bias would persist, resulting in a disadvantage in processing continuation sentences beginning with a feminine pronoun (e.g., Elle passait l'examen dans 15 jours [She was taking the exam in 15 days.]).

      The two statistical models supported our hypothesis, revealing a clear effect of the grammatical gender of the pronoun in the continuation sentence on both response times and accuracy scores. Specifically, sentences beginning with elle [she] required longer processing time and yielded higher error rates.

      One critical question remains regarding the generality of this result. Does the observed masculine bias extend to all gender-fair forms, or is it specific to gender-neutral form? Our hypothesis was that the use of a re-feminization strategy could potentially eliminate the masculine bias. The rationale behind this hypothesis stems from the notion that re-feminized forms explicitly reintroduce grammatical gender markers associated with the feminine gender. Therefore, if the masculine bias is primarily driven by the absence of grammatical gender cues in gender-neutral forms, the re-feminized forms should counteract this bias.

      In order to test this hypothesis, we designed a second experiment comparing the processing of gender-unmarked forms with contracted double forms. We expected that, in the second case, the observed masculine bias would be totally eliminated, or at least drastically reduced.

      3. Experiment 2 3.1. Methods 3.1.1. Participants

      Seventy psychology students (64 women, 6 men) at Grenoble-Alpes University participated in this study for course credit. All subjects were native French speakers, with normal or corrected vision. Thirty-four participants were assigned to the gender-unmarked condition and 36 to the contracted double form condition.

      3.1.2. Stimuli

      The gender-unmarked condition was a replication of experiment 1. Hence, the stimuli in this condition were the same as those of experiment 1, that is: context sentences began with l' and continuation sentences began with either il or elle. In the contracted double form condition however, the 22 gender-unmarked words presented in the context sentences were not preceded by the determiner l' [theunmarked] but by un·e [aMASC·FEM].5 Continuation sentences began with either il [he] or elle [she], as in experiment 1. For example one participant of the contracted double form condition would read Un·e élève commenait à réviser [AMASC·FEM studentunmarked began to study], followed by Elle passait l'examen dans 15 jours [She was taking the exam in 15 days].

      3.1.3. Procedure

      Participants were randomly assigned to either the gender-unmarked or the contracted double form condition. Apart from that, the procedure followed that of experiment 1.

      3.2. Data analysis

      The structure of the models in experiment 2 replicated that employed in experiment 1, with the only difference that the models also include the effect of factor condition (0: gender-unmarked; 1: contracted double) and a two-way interaction between this factor and grammatical gender (0: female; 1: male).

      3.3. Results

      The results from Experiment 2, averaged by participant, grammatical form and grammatical gender in each of the two conditions, are shown in Figure 1 (right panels). The posterior distributions for the intercept and fixed effects model parameters is shown in Figure 2. Posterior distributions for all parameters in the model are presented in Supplementary Figure S5. A post-hoc sensitivity analysis was also conducted on parameters βcondition and βgender×condition. The details and results are provided in the Supplementary material.

      In the gender-unmarked condition, continuation sentences beginning with a feminine pronoun yielded a mean reaction time of 1,575 ms ± 505 SD and an average accuracy score of 84.2%. Conversely, continuation sentences beginning with a masculine pronoun had a mean reaction time of 1,394 ms ± 370 SD and an average score of 92.2%. These findings closely aligned with the results observed in Experiment 1. In particular, the posterior distributions for β0 and βgender were highly consistent between the two experiments (recall that, because of the model design, βgender codes for the difference between grammatical genders in the gender-unmarked condition).

      In contrast, for the contracted double form condition, the measured reaction times were similar between feminine (mean = 1,467 ms ± 366 SD) and masculine continuation sentences (mean = 1,446 ms ± 395 SD). As a result, the posterior distribution for the βgender×condition parameter in the response time model revealed a strong interaction effect [mean = 0.26, CI95%= (0.11, 0.42)]. There was no main effect of condition, as indicated by a posterior distribution for βcondition centered around 0 [mean = −0.17, CI95%= (−0.49, 0.14)], suggesting that gender-unmarked and contracted double forms led to similar processing times of the following continuation sentence, on average. For percent correct accuracy, the 95% credible interval for both βcondition and βgender×condition overlapped with zero to a large extent [βcondition: mean = 0.20, CI95%= (−0.31, 0.73); βgender×condition: mean = −0.39, CI95%= (−1.07, 0.29)]. It is however possible that this absence of noticeable impact of factor condition on percent correct scores was partly due to a ceiling effect, as the scores were quite high overall (86.4% for feminine pronoun, 90.2% for masculine pronoun).

      Similar to Experiment 1, we measured the correlation between item-specific random intercepts from the reaction-time model and from the percent-correct model. No reliable correlation was found [R = 0.23, CI95%= (−0.19, 0.6)], again possibly because of a ceiling effect in the percent correct scores.

      4. General discussion

      The objective of the present study was to examine the efficiency of gender-unmarked forms and contracted double forms in mitigating gender biases in language. Two experiments were conducted, in which participants had to judge the consistency of a pair of French sentences: a context sentence where the gender of the character was intentionally left unspecified, using gender-fair forms, and a continuation sentence beginning with a feminine or a masculine singular pronoun. All nouns included in the experiment were pre-tested for the absence of strong gender stereotypes. In the first experiment, we confirmed that gender-unmarked forms in French were not fully successful in neutralizing the masculine bias. Specifically, sentences beginning with a feminine pronoun exhibited longer processing times and higher error rates compared to those beginning with a masculine pronoun, indicating the persistence of a masculine bias even in a gender-neutral context. For instance, following the context sentence L'élève commençait à réviser [Theunmarked studentunmarked began to revise], the feminine continuation sentence Elle passait l'examen dans 15 jours [She was taking the exam in 15 days] required more time to process and resulted in more errors compared to the masculine continuation sentence Elle passait l'examen dans 15 jours [She was taking the exam in 15 days]. In the second experiment, we contrasted gender-unmarked forms (such as L'élève) with contracted double forms using a mid-dot (such as Un·e élève). The results revealed that the use of contracted double forms, which reintroduce grammatical gender markers associated with the feminine gender, eliminated the gender bias observed in the gender-unmarked condition. In the contracted double form condition, there was no significant difference in processing time between feminine and masculine continuation sentences, suggesting that the re-feminization strategy successfully counteracted the masculine bias.

      The results of Experiment 1 are consistent with our hypothesis: gender-unmarked forms in French are not fully effective in neutralizing masculine bias. This finding is in line with previous research demonstrating that neutral wordings elicit a male bias, in English and Swedish (Lindqvist et al., 2019) as well as in German (Irmen and Roßberg, 2004). However, it contrasts with several studies that found no bias induced by gender-neutral forms (e.g., Tibblin et al. 2023, Richy and Burnett 2021 and Kim et al. 2023 in French, Stahlberg et al. 2001 in German). It is possible that these studies failed to capture the difference in masculine bias due to methodological limitations. More specifically, some estimates approached ceiling levels, making it difficult to detect potential effects (e.g., Tibblin et al., 2023). Furthermore, in some experiments, participants may have been able to understand the study's objective and adjusted their responses accordingly. In contrast, we believe that the sentence evaluation paradigm used in the present study is less susceptible to ceiling effects and less prone to the development of conscious strategies by participants. Finally, differences in the test population demographics may also explain these discrepancies. This point will be discussed in section 4.3.

      The observation of a masculine bias in the absence of any grammatical marker may seem surprising. At this point we can only speculate about the causes of this effect. Two possible, non-exclusive explanations are considered in the following paragraphs: a first one based on lexical frequency effects, and another one based on semantics.

      4.1. Prevalence of gender-neutral nouns in the masculine form

      An interesting explanation for the observed masculine bias is based on the fact that singular gender-neutral words, despite having no fixed grammatical gender, are often used as generic masculine forms. This is the case, for example, in sentences such as Ils ont eu un enfant [They had aMASC child] or Il faut que j'aille voir un orthopédiste [I need to see anMASC orthopedist]. These sentences employ gender-neutral nouns with a singular masculine marking of the pronoun to refer to individuals in a generic sense.

      Because of the prevalence of these singular generic masculine constructions, gender-neutral words are more frequently seen in their masculine forms. Therefore, when presented with a gender-neutral form such as L'enfant se roulait par terre en criant [Theunmarked child was rolling on the floor screaming], the reader is more likely to interpret the noun L'enfant as a masculine. As a result, they may take more time to process the feminine continuation sentence Elle faisait encore un caprice [She was throwing another tantrum] than the masculine one, therefore giving rise to a masculine bias. In other words, even though the noun itself lacks explicit gender markings, readers would tend to default to a masculine representation based on the prevalent usage of gender-neutral words as generic masculine in the language.

      4.2. Gender-specific interpretation of gender-neutral nouns

      A similar effect can be conceived at a semantic level. As noted by Richy and Burnett (2021), formally gender-neutral terms are often used in ways which are covertly gendered. This is the case, for example, in the following English sentences (Black and Coward, 1981; Cameron, 1995):

      Young people should be out interfering with the local maidens.

      We cannot tolerate attacks on the wife of an American citizen.

      Here, the generic nouns “people” and “citizen” are used to specifically refer to heterosexual men, thereby excluding women. Such usage suggests that English speakers tend to associate strong masculine representations with gender-neutral expressions. In French, Michard (1999) noted similar examples by studying the gendered discourse in the work of anthropologists, such as:

      Le village entier partit le lendemain dans une trentaine de pirogues, nous laissant seuls avec les femmes et les enfants dans les maisons abandonnées. [The entire village left the next day in about thirty canoes, leaving us alone with the women and children in the abandoned houses.]

      Même si l'enfant est mort-né, les Baruya souponnent toujours leur femme d'avoir tué leur enfant. [Even if the child is stillborn, the Baruya always suspect their wives of killing the child].

      These examples highlight that the use of gender-neutral nouns does not necessarily imply inclusive reference. Instead, due to our androcentric experiences and cultural influences, gender-neutral nouns may carry underlying masculine stereotypes. This could in turn explain why, in the present study, the items resulted in more activation of the masculine representations.

      4.3. Further studies

      In order to disentangle the locus (lexico-statistics vs. semantic level) of the masculine bias in the absence of gender marking, we plan to run a series of experiments using stimuli than convey conflicting cues between frequency of usage and semantics. In French some generic nouns occur only in the feminine form (e.g., une personne [aFEM personFEM], une victime [aFEM victimFEM], une recrue [aFEM recruitFEM]). In this case, the prevalence of the grammatical feminine form would conflict with the automatic activation of the masculine representations at the semantic level. If a masculine bias is still observed in noun phrases such as l'honnête victime [theunmarked honestunmarked victimFEM] it would suggest that the masculine bias is not lexically driven by usage frequency but by the automatic activation of the masculine representations at the semantic level. Interestingly, Brauer and Landry (2008)'s results (experiment 3) suggest that this is not the case: When participants were asked to imagine a prototypical human representation of a profession (by describing him/her, finding a name, attributing an age and a salary, etc.), more women were described when the instructions contained the feminine noun personne (e.g., Essayez d'imaginer cette personne le plus vivement possible, [try to imagine thisFEM personFEM as vividly as possible]) than when the masculine noun individu was used (e.g., [try to imagine thisMASC individualMASC as vividly as possible]).

      Another promising direction for broadening the scope of the study would involve testing the presence of masculine bias using unbalanced stereotyped words, in order to examine how the observed effects interact with stereotypes. This line of investigation would serve two complementary purposes. First, it would enable us to validate the robustness of the effects measured in our controlled experimental conditions, when tested in more ecological situations. Second, this would facilitate the manipulation of the semantics toward feminine representations. This is particularly relevant considering that frequency of usage may favors masculine representations due to the masculine generic rule (see section 4.2). Should we observe a persistent masculine bias in sentences such as l'hystérique hurlait [theunmarked hysterical personunmarked was yelling] (where hystérique is strongly biased toward feminine representations), it would imply that the masculine bias is primarily driven by lexical frequency.

      Finally, previous research has highlighted the influence of participant's gender and self-reported masculinity levels on gender processing effects (Casado et al., 2023). Our participant sample exhibits a marked gender imbalance (108 women vs. 9 men in total), reflecting the gender ratio typical of undergraduate psychology students at our University. It would be interesting to replicate the present experiment with a more balanced number of male and female participants to assess the potential influence of participant gender on the findings. Similarly, it is plausible that the effects described in this study are also conditioned by the age and socio-economic status of the participant. Indeed, as noted in the Introduction section, there is an important sociolinguistic distinction between the gender-unmarked form and the contracted double form in French. In this study, our participant cohort was highly homogeneous in terms of age and professional orientation. Therefore, further research endeavors should be undertaken to explore the impact of these variables on the relative effectiveness of neutralization and re-feminization strategies in mitigating gender biases in language processing. In any case, it is worth noting that the subpopulation under examination (mostly young female students) may reasonably be expected to exhibit lower susceptibility to gender biases in language compared to other demographic groups. Consequently the present findings might be considered as a conservative estimate of the effect that would be observed in a more representative sample of the general population.

      Data availability statement

      All the codes and data supporting this study are openly available on Github at https://github.com/LeoVarnet/GenderFair/.

      Ethics statement

      The studies involving humans were approved by Comité d'Ethique de la Recherche Paris-Descartes. The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study.

      Author contributions

      ES: Writing—review and editing, Data curation, Methodology, Resources. J-PC: Methodology, Writing—review and editing, Conceptualization. LV: Writing— review and editing, Formal analysis, Investigation, Writing—original draft.

      Funding

      The author(s) declare financial support was received for the research, authorship, and/or publication of this article. This study was funded by the ANR grants DRhyaDS (No. ANR-22-FRAL-0003) and FrontCog (Grant No. ANR-17-EURE-0017).

      The authors would like to thank Jules Guttierez, Lola Purghe and Aida El Karafli for their help during data collection. We are also grateful to Sharon Peperkamp for her insightful comments during the writing process.

      Conflict of interest

      The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

      Publisher's note

      All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

      Supplementary material

      The Supplementary Material for this article can be found online at: /articles/10.3389/fpsyg.2023.1256779/full#supplementary-material

      1The use of this sentence has been reported by Hofstadter and Sander (2013). The authors also stressed that its comprehension requires some mental effort. In practice French speakers would usually circumvent this paradoxical phrasing by opting for a more explicit wording such as J'ai trente-quatre étudiants en cours, dont seulement sept sont des garçons [I have thirty-four students in my class, only seven of whom are boys]. Nevertheless, it is important to note that the original sentence remains grammatically correct. It can therefore be seen as a thought-provoking example highlighting the challenges posed by plural masculine terms.

      2We refrain from using the term “epicene words” (Tibblin et al., 2023) here as it sometimes also includes generic nouns such as une personne or un individu which can refer to both male or female objects, but have a fixed grammatical gender. Alternative terms used as synonyms of gender-unmarked include “common-gender” (Richy and Burnett, 2021) and “non-differentiating” (Braun et al., 2005).

      3Again, there is some disagreement on the terminology, as some authors use the term “gender-neutral” (Brauer and Landry, 2008; Vainapel et al., 2015) or “gender-balanced” (Gygax et al., 2008). We decided to stick with the terms used by Tibblin et al. (2023).

      4A confirmatory analysis excluding reaction time data larger/smaller than the mean ± 2 SD for each participant yielded essentially the same results.

      5When it comes to inclusive writing, there are several options in French. In our day-to-day reading, we may encounter hyphens (un-e), parentheses (un(e)) or the mid-dot (un·e), as there are no official characters so far. In this experiment, we chose to use the mid-dot. The mid-dot has the advantage of having no other function in the French language, unlike hyphens or parentheses, which are used to link terms together or to add precision to a written text.

      References Black M. Coward R. (1981). Linguistic, social and sexual relations: a review of dale spender's man made language. Screen Educ. 39, 6985. Brauer M. Landry M. (2008). Un ministre peut-il tomber enceinte? L'impact du générique masculin sur les représentations mentales. L'Année Psychol. 108, 243272. 10.4074/S0003503308002030 Braun F. Gottburgsen A. Sczesny S. Stahlberg D. (1998). Können geophysiker frauen sein? Generische personenbezeichnungen im Deutschen. Z. Ger. Linguist. 26, 265283. 10.1515/zfgl.1998.26.3.265 Braun F. Sczesny S. Stahlberg D. (2005). Cognitive effects of masculine generics in German: an overview of empirical findings. Communications 30, 121. 10.1515/comm.2005.30.1.1 Cameron D. (1995). Verbal Hygiene. London: Routledge. Candea M. Véron L. (2019). Le Français est à nous ! Paris: La Découverte. Carpenter B. Gelman A. Hoffman M. D. Lee D. Goodrich B. Betancourt M. . (2017). Stan: a probabilistic programming language. J. Stat. Softw. 76, 132. 10.18637/jss.v076.i0136568334 Casado A. Sá-Leite A. R. Pesciarelli F. Paolieri D. (2023). Exploring the nature of the gender-congruency effect: implicit gender activation and social bias. Front. Psychol. 14, 1160836. 10.3389/fpsyg.2023.116083637287785 Chatard-Pannetier A. Guimont S. Martinot D. (2005). Impact de la féminisation lexicale des professions sur l'auto-efficacité des élè ves: une remise en cause de l'universalisme masculin? L'Année Psychol. 105, 249272. 10.3406/psy.2005.29694 Garnham A. Gabriel U. Sarrasin O. Gygax P. Oakhill J. (2012). Gender representation in different languages and grammatical marking on pronouns: when beauticians, musicians, and mechanics remain men. Discourse Process. 49, 481500. 10.1080/0163853X.2012.688184 Guide pratique pour une communication publique sans stéréotypes de sexe (2022). Haut Conseil à l'Egalité entre les Femmes et les Hommes. Retrieved from https://www.haut-conseil-egalite.gouv.fr/IMG/pdf/guide_egacom_sans_stereotypes-2022-versionpublique-min-2.pdf Gygax P. Gabriel U. (2008). Can a group of musicians be composed of women? Generic interpretation of French masculine role names in the absence and presence of feminine forms. Swiss J. Psychol. 67, 143151. 10.1024/1421-0185.67.3.143 Gygax P. Gabriel U. Sarrasin O. Oakhill J. Garnham A. (2008). Generically intended, but specifically interpreted: when beauticians, musicians, and mechanics are all men. Lang. Cognit. Process. 23, 464485. 10.1080/01690960701702035 Gygax P. M. Elmiger D. Zufferey S. Garnham A. Sczesny S. von Stockhausen L. . (2019). A language index of grammatical gender dimensions to study the impact of grammatical gender on the way we perceive women and men. Front. Psychol. 10, 1604. 10.3389/fpsyg.2019.0160431379661 Hofstadter D. Sander E. (2013). L'Analogie, Coeur de la Pensée. Paris: Odile Jacob. Irmen L. (2007). What's in a (role) name? Formal and conceptual aspects of comprehending personal nouns. J. Psycholinguist. Res. 36, 431456. 10.1007/s10936-007-9053-z17372839 Irmen L. Roßberg N. (2004). Gender markedness of language: the impact of grammatical and nonlinguistic information on the mental representation of person information. J. Lang. Soc. Psychol. 23, 272307. 10.1177/0261927X04266810 Kim J. Angst S. Gygax P. Gabriel U. Zufferey S. (2023). The masculine bias in fully gendered languages and ways to avoid it: a study on gender neutral forms in Québec and Swiss French. J. French Lang. Stud. 33, 126. 10.1017/S095926952200014X Lindqvist A. Renström E. A. Gustafsson Sendén M. (2019). Reducing a male bias in language? Establishing the efficiency of three different gender-fair language strategies. Sex Roles 81, 109117. 10.1007/s11199-018-0974-9 Loison-Leruste M. Perrier G. Noûs C. (2020). Introduction. Le langage inclusif est politique: une spécificité française? Cah. Genre 69, 529. 10.3917/cdge.069.0005 Michard C. (1999). Humain/femelle: deux poids deux mesures dans la catégorisation de sexe en français. Nouv. Quest. Fem. 20, 5395. Misersky J. Gygax P. M. Canal P. Gabriel U. Garnham A. Braun F. . (2014). Norms on the gender perception of role nouns in Czech, English, French, German, Italian, Norwegian, and Slovak. Behav. Res. Methods 46, 841871. 10.3758/s13428-013-0409-z24163213 R Core Team (2020). R: A Language and Environment for Statistical Computing. Vienna: R Foundation for Statistical Computing. Richy C. Burnett H. (2021). Démêler les Effets des stéréotypes et le Genre Grammatical dans le Biais Masculin: Une Approche Expérimentale. GLAD!. Revue sur le langage, le genre, les sexualités, 10. 10.4000/glad.2839 Stahlberg D. Sczesny S. (2001). Effekte des generischen maskulinums und alternativer sprachformen auf den gedanklichen einbezug von frauen. [Effect of the generic use of the masculine pronoun and alternative forms of speech on the cognitive visibility of women.]. Psychol. Rundsch. 52, 131140. 10.1026//0033-3042.52.3.131 Stahlberg D. Sczesny S. Braun F. (2001). Name your favorite musician: effects of masculine generics and of their alternatives in German. J. Lang. Soc. Psychol. 20, 464469. 10.1177/0261927X01020004004 Stan Development Team (2020). RStan: the R Interface to Stan. R package version 2.26.24. Available online at: https://mc-stan.org/ Tibblin J. Weijer J. V. D. Granfeldt J. Gygax P. (2023). There are more women in Joggeureuses than in Joggeurs: on the effects of gender-fair forms on perceived gender ratios in French role nouns. J. French Lang. Stud. 33, 2851. 10.1017/S0959269522000217 Vainapel S. Shamir O. Y. Tenenbaum Y. Gilam G. (2015). The dark side of gendered language: the masculine-generic form as a cause for self-report bias. Psychol. Assess. 27, 15131519. 10.1037/pas000015625984637 Wilson E. Ng S. H. (1988). Sex bias in visual images evoked by generics: a New Zealand study. Sex Roles 18, 159168. 10.1007/BF00287786 Xiao H. Strickland B. Peperkamp S. (2023). How fair is gender-fair language? Insights from gender ratio estimations in French. J. Lang. Soc. Psychol. 42, 82106. 10.1177/0261927X221084643
      ‘Oh, my dear Thomas, you haven’t heard the terrible news then?’ she said. ‘I thought you would be sure to have seen it placarded somewhere. Alice went straight to her room, and I haven’t seen her since, though I repeatedly knocked at the door, which she has locked on the inside, and I’m sure it’s most unnatural of her not to let her own mother comfort her. It all happened in a moment: I have always said those great motor-cars shouldn’t be allowed to career about the streets, especially when they are all paved with cobbles as they are at Easton Haven, which are{331} so slippery when it’s wet. He slipped, and it went over him in a moment.’ My thanks were few and awkward, for there still hung to the missive a basting thread, and it was as warm as a nestling bird. I bent low--everybody was emotional in those days--kissed the fragrant thing, thrust it into my bosom, and blushed worse than Camille. "What, the Corner House victim? Is that really a fact?" "My dear child, I don't look upon it in that light at all. The child gave our picturesque friend a certain distinction--'My husband is dead, and this is my only child,' and all that sort of thing. It pays in society." leave them on the steps of a foundling asylum in order to insure [See larger version] Interoffice guff says you're planning definite moves on your own, J. O., and against some opposition. Is the Colonel so poor or so grasping—or what? Albert could not speak, for he felt as if his brains and teeth were rattling about inside his head. The rest of[Pg 188] the family hunched together by the door, the boys gaping idiotically, the girls in tears. "Now you're married." The host was called in, and unlocked a drawer in which they were deposited. The galleyman, with visible reluctance, arrayed himself in the garments, and he was observed to shudder more than once during the investiture of the dead man's apparel. HoME香京julia种子在线播放 ENTER NUMBET 0016www.jxmmzz.org.cn
      www.fenjints.com.cn
      www.mashaike.org.cn
      gfltech.com.cn
      www.pf9jf.com.cn
      takyguyes.com.cn
      szbgjjdz.com.cn
      ru4.com.cn
      ujijia.com.cn
      shxunpu.com.cn
      处女被大鸡巴操 强奸乱伦小说图片 俄罗斯美女爱爱图 调教强奸学生 亚洲女的穴 夜来香图片大全 美女性强奸电影 手机版色中阁 男性人体艺术素描图 16p成人 欧美性爱360 电影区 亚洲电影 欧美电影 经典三级 偷拍自拍 动漫电影 乱伦电影 变态另类 全部电 类似狠狠鲁的网站 黑吊操白逼图片 韩国黄片种子下载 操逼逼逼逼逼 人妻 小说 p 偷拍10幼女自慰 极品淫水很多 黄色做i爱 日本女人人体电影快播看 大福国小 我爱肏屄美女 mmcrwcom 欧美多人性交图片 肥臀乱伦老头舔阴帝 d09a4343000019c5 西欧人体艺术b xxoo激情短片 未成年人的 插泰国人夭图片 第770弾み1 24p 日本美女性 交动态 eee色播 yantasythunder 操无毛少女屄 亚洲图片你懂的女人 鸡巴插姨娘 特级黄 色大片播 左耳影音先锋 冢本友希全集 日本人体艺术绿色 我爱被舔逼 内射 幼 美阴图 喷水妹子高潮迭起 和后妈 操逼 美女吞鸡巴 鸭个自慰 中国女裸名单 操逼肥臀出水换妻 色站裸体义术 中国行上的漏毛美女叫什么 亚洲妹性交图 欧美美女人裸体人艺照 成人色妹妹直播 WWW_JXCT_COM r日本女人性淫乱 大胆人艺体艺图片 女同接吻av 碰碰哥免费自拍打炮 艳舞写真duppid1 88电影街拍视频 日本自拍做爱qvod 实拍美女性爱组图 少女高清av 浙江真实乱伦迅雷 台湾luanlunxiaoshuo 洛克王国宠物排行榜 皇瑟电影yy频道大全 红孩儿连连看 阴毛摄影 大胆美女写真人体艺术摄影 和风骚三个媳妇在家做爱 性爱办公室高清 18p2p木耳 大波撸影音 大鸡巴插嫩穴小说 一剧不超两个黑人 阿姨诱惑我快播 幼香阁千叶县小学生 少女妇女被狗强奸 曰人体妹妹 十二岁性感幼女 超级乱伦qvod 97爱蜜桃ccc336 日本淫妇阴液 av海量资源999 凤凰影视成仁 辰溪四中艳照门照片 先锋模特裸体展示影片 成人片免费看 自拍百度云 肥白老妇女 女爱人体图片 妈妈一女穴 星野美夏 日本少女dachidu 妹子私处人体图片 yinmindahuitang 舔无毛逼影片快播 田莹疑的裸体照片 三级电影影音先锋02222 妻子被外国老头操 观月雏乃泥鳅 韩国成人偷拍自拍图片 强奸5一9岁幼女小说 汤姆影院av图片 妹妹人艺体图 美女大驱 和女友做爱图片自拍p 绫川まどか在线先锋 那么嫩的逼很少见了 小女孩做爱 处女好逼连连看图图 性感美女在家做爱 近距离抽插骚逼逼 黑屌肏金毛屄 日韩av美少女 看喝尿尿小姐日逼色色色网图片 欧美肛交新视频 美女吃逼逼 av30线上免费 伊人在线三级经典 新视觉影院t6090影院 最新淫色电影网址 天龙影院远古手机版 搞老太影院 插进美女的大屁股里 私人影院加盟费用 www258dd 求一部电影里面有一个二猛哥 深肛交 日本萌妹子人体艺术写真图片 插入屄眼 美女的木奶 中文字幕黄色网址影视先锋 九号女神裸 和骚人妻偷情 和潘晓婷做爱 国模大尺度蜜桃 欧美大逼50p 西西人体成人 李宗瑞继母做爱原图物处理 nianhuawang 男鸡巴的视屏 � 97免费色伦电影 好色网成人 大姨子先锋 淫荡巨乳美女教师妈妈 性nuexiaoshuo WWW36YYYCOM 长春继续给力进屋就操小女儿套干破内射对白淫荡 农夫激情社区 日韩无码bt 欧美美女手掰嫩穴图片 日本援交偷拍自拍 入侵者日本在线播放 亚洲白虎偷拍自拍 常州高见泽日屄 寂寞少妇自卫视频 人体露逼图片 多毛外国老太 变态乱轮手机在线 淫荡妈妈和儿子操逼 伦理片大奶少女 看片神器最新登入地址sqvheqi345com账号群 麻美学姐无头 圣诞老人射小妞和强奸小妞动话片 亚洲AV女老师 先锋影音欧美成人资源 33344iucoom zV天堂电影网 宾馆美女打炮视频 色五月丁香五月magnet 嫂子淫乱小说 张歆艺的老公 吃奶男人视频在线播放 欧美色图男女乱伦 avtt2014ccvom 性插色欲香影院 青青草撸死你青青草 99热久久第一时间 激情套图卡通动漫 幼女裸聊做爱口交 日本女人被强奸乱伦 草榴社区快播 2kkk正在播放兽骑 啊不要人家小穴都湿了 www猎奇影视 A片www245vvcomwwwchnrwhmhzcn 搜索宜春院av wwwsee78co 逼奶鸡巴插 好吊日AV在线视频19gancom 熟女伦乱图片小说 日本免费av无码片在线开苞 鲁大妈撸到爆 裸聊官网 德国熟女xxx 新不夜城论坛首页手机 女虐男网址 男女做爱视频华为网盘 激情午夜天亚洲色图 内裤哥mangent 吉沢明歩制服丝袜WWWHHH710COM 屌逼在线试看 人体艺体阿娇艳照 推荐一个可以免费看片的网站如果被QQ拦截请复制链接在其它浏览器打开xxxyyy5comintr2a2cb551573a2b2e 欧美360精品粉红鲍鱼 教师调教第一页 聚美屋精品图 中韩淫乱群交 俄罗斯撸撸片 把鸡巴插进小姨子的阴道 干干AV成人网 aolasoohpnbcn www84ytom 高清大量潮喷www27dyycom 宝贝开心成人 freefronvideos人母 嫩穴成人网gggg29com 逼着舅妈给我口交肛交彩漫画 欧美色色aV88wwwgangguanscom 老太太操逼自拍视频 777亚洲手机在线播放 有没有夫妻3p小说 色列漫画淫女 午间色站导航 欧美成人处女色大图 童颜巨乳亚洲综合 桃色性欲草 色眯眯射逼 无码中文字幕塞外青楼这是一个 狂日美女老师人妻 爱碰网官网 亚洲图片雅蠛蝶 快播35怎么搜片 2000XXXX电影 新谷露性家庭影院 深深候dvd播放 幼齿用英语怎么说 不雅伦理无需播放器 国外淫荡图片 国外网站幼幼嫩网址 成年人就去色色视频快播 我鲁日日鲁老老老我爱 caoshaonvbi 人体艺术avav 性感性色导航 韩国黄色哥来嫖网站 成人网站美逼 淫荡熟妇自拍 欧美色惰图片 北京空姐透明照 狼堡免费av视频 www776eom 亚洲无码av欧美天堂网男人天堂 欧美激情爆操 a片kk266co 色尼姑成人极速在线视频 国语家庭系列 蒋雯雯 越南伦理 色CC伦理影院手机版 99jbbcom 大鸡巴舅妈 国产偷拍自拍淫荡对话视频 少妇春梦射精 开心激动网 自拍偷牌成人 色桃隐 撸狗网性交视频 淫荡的三位老师 伦理电影wwwqiuxia6commqiuxia6com 怡春院分站 丝袜超短裙露脸迅雷下载 色制服电影院 97超碰好吊色男人 yy6080理论在线宅男日韩福利大全 大嫂丝袜 500人群交手机在线 5sav 偷拍熟女吧 口述我和妹妹的欲望 50p电脑版 wwwavtttcon 3p3com 伦理无码片在线看 欧美成人电影图片岛国性爱伦理电影 先锋影音AV成人欧美 我爱好色 淫电影网 WWW19MMCOM 玛丽罗斯3d同人动画h在线看 动漫女孩裸体 超级丝袜美腿乱伦 1919gogo欣赏 大色逼淫色 www就是撸 激情文学网好骚 A级黄片免费 xedd5com 国内的b是黑的 快播美国成年人片黄 av高跟丝袜视频 上原保奈美巨乳女教师在线观看 校园春色都市激情fefegancom 偷窥自拍XXOO 搜索看马操美女 人本女优视频 日日吧淫淫 人妻巨乳影院 美国女子性爱学校 大肥屁股重口味 啪啪啪啊啊啊不要 操碰 japanfreevideoshome国产 亚州淫荡老熟女人体 伦奸毛片免费在线看 天天影视se 樱桃做爱视频 亚卅av在线视频 x奸小说下载 亚洲色图图片在线 217av天堂网 东方在线撸撸-百度 幼幼丝袜集 灰姑娘的姐姐 青青草在线视频观看对华 86papa路con 亚洲1AV 综合图片2区亚洲 美国美女大逼电影 010插插av成人网站 www色comwww821kxwcom 播乐子成人网免费视频在线观看 大炮撸在线影院 ,www4KkKcom 野花鲁最近30部 wwwCC213wapwww2233ww2download 三客优最新地址 母亲让儿子爽的无码视频 全国黄色片子 欧美色图美国十次 超碰在线直播 性感妖娆操 亚洲肉感熟女色图 a片A毛片管看视频 8vaa褋芯屑 333kk 川岛和津实视频 在线母子乱伦对白 妹妹肥逼五月 亚洲美女自拍 老婆在我面前小说 韩国空姐堪比情趣内衣 干小姐综合 淫妻色五月 添骚穴 WM62COM 23456影视播放器 成人午夜剧场 尼姑福利网 AV区亚洲AV欧美AV512qucomwwwc5508com 经典欧美骚妇 震动棒露出 日韩丝袜美臀巨乳在线 av无限吧看 就去干少妇 色艺无间正面是哪集 校园春色我和老师做爱 漫画夜色 天海丽白色吊带 黄色淫荡性虐小说 午夜高清播放器 文20岁女性荫道口图片 热国产热无码热有码 2015小明发布看看算你色 百度云播影视 美女肏屄屄乱轮小说 家族舔阴AV影片 邪恶在线av有码 父女之交 关于处女破处的三级片 极品护士91在线 欧美虐待女人视频的网站 享受老太太的丝袜 aaazhibuo 8dfvodcom成人 真实自拍足交 群交男女猛插逼 妓女爱爱动态 lin35com是什么网站 abp159 亚洲色图偷拍自拍乱伦熟女抠逼自慰 朝国三级篇 淫三国幻想 免费的av小电影网站 日本阿v视频免费按摩师 av750c0m 黄色片操一下 巨乳少女车震在线观看 操逼 免费 囗述情感一乱伦岳母和女婿 WWW_FAMITSU_COM 偷拍中国少妇在公车被操视频 花也真衣论理电影 大鸡鸡插p洞 新片欧美十八岁美少 进击的巨人神thunderftp 西方美女15p 深圳哪里易找到老女人玩视频 在线成人有声小说 365rrr 女尿图片 我和淫荡的小姨做爱 � 做爱技术体照 淫妇性爱 大学生私拍b 第四射狠狠射小说 色中色成人av社区 和小姨子乱伦肛交 wwwppp62com 俄罗斯巨乳人体艺术 骚逼阿娇 汤芳人体图片大胆 大胆人体艺术bb私处 性感大胸骚货 哪个网站幼女的片多 日本美女本子把 色 五月天 婷婷 快播 美女 美穴艺术 色百合电影导航 大鸡巴用力 孙悟空操美少女战士 狠狠撸美女手掰穴图片 古代女子与兽类交 沙耶香套图 激情成人网区 暴风影音av播放 动漫女孩怎么插第3个 mmmpp44 黑木麻衣无码ed2k 淫荡学姐少妇 乱伦操少女屄 高中性爱故事 骚妹妹爱爱图网 韩国模特剪长发 大鸡巴把我逼日了 中国张柏芝做爱片中国张柏芝做爱片中国张柏芝做爱片中国张柏芝做爱片中国张柏芝做爱片 大胆女人下体艺术图片 789sss 影音先锋在线国内情侣野外性事自拍普通话对白 群撸图库 闪现君打阿乐 ady 小说 插入表妹嫩穴小说 推荐成人资源 网络播放器 成人台 149大胆人体艺术 大屌图片 骚美女成人av 春暖花开春色性吧 女亭婷五月 我上了同桌的姐姐 恋夜秀场主播自慰视频 yzppp 屄茎 操屄女图 美女鲍鱼大特写 淫乱的日本人妻山口玲子 偷拍射精图 性感美女人体艺木图片 种马小说完本 免费电影院 骑士福利导航导航网站 骚老婆足交 国产性爱一级电影 欧美免费成人花花性都 欧美大肥妞性爱视频 家庭乱伦网站快播 偷拍自拍国产毛片 金发美女也用大吊来开包 缔D杏那 yentiyishu人体艺术ytys WWWUUKKMCOM 女人露奶 � 苍井空露逼 老荡妇高跟丝袜足交 偷偷和女友的朋友做爱迅雷 做爱七十二尺 朱丹人体合成 麻腾由纪妃 帅哥撸播种子图 鸡巴插逼动态图片 羙国十次啦中文 WWW137AVCOM 神斗片欧美版华语 有气质女人人休艺术 由美老师放屁电影 欧美女人肉肏图片 白虎种子快播 国产自拍90后女孩 美女在床上疯狂嫩b 饭岛爱最后之作 幼幼强奸摸奶 色97成人动漫 两性性爱打鸡巴插逼 新视觉影院4080青苹果影院 嗯好爽插死我了 阴口艺术照 李宗瑞电影qvod38 爆操舅母 亚洲色图七七影院 被大鸡巴操菊花 怡红院肿么了 成人极品影院删除 欧美性爱大图色图强奸乱 欧美女子与狗随便性交 苍井空的bt种子无码 熟女乱伦长篇小说 大色虫 兽交幼女影音先锋播放 44aad be0ca93900121f9b 先锋天耗ばさ无码 欧毛毛女三级黄色片图 干女人黑木耳照 日本美女少妇嫩逼人体艺术 sesechangchang 色屄屄网 久久撸app下载 色图色噜 美女鸡巴大奶 好吊日在线视频在线观看 透明丝袜脚偷拍自拍 中山怡红院菜单 wcwwwcom下载 骑嫂子 亚洲大色妣 成人故事365ahnet 丝袜家庭教mp4 幼交肛交 妹妹撸撸大妈 日本毛爽 caoprom超碰在email 关于中国古代偷窥的黄片 第一会所老熟女下载 wwwhuangsecome 狼人干综合新地址HD播放 变态儿子强奸乱伦图 强奸电影名字 2wwwer37com 日本毛片基地一亚洲AVmzddcxcn 暗黑圣经仙桃影院 37tpcocn 持月真由xfplay 好吊日在线视频三级网 我爱背入李丽珍 电影师傅床戏在线观看 96插妹妹sexsex88com 豪放家庭在线播放 桃花宝典极夜著豆瓜网 安卓系统播放神器 美美网丝袜诱惑 人人干全免费视频xulawyercn av无插件一本道 全国色五月 操逼电影小说网 good在线wwwyuyuelvcom www18avmmd 撸波波影视无插件 伊人幼女成人电影 会看射的图片 小明插看看 全裸美女扒开粉嫩b 国人自拍性交网站 萝莉白丝足交本子 七草ちとせ巨乳视频 摇摇晃晃的成人电影 兰桂坊成社人区小说www68kqcom 舔阴论坛 久撸客一撸客色国内外成人激情在线 明星门 欧美大胆嫩肉穴爽大片 www牛逼插 性吧星云 少妇性奴的屁眼 人体艺术大胆mscbaidu1imgcn 最新久久色色成人版 l女同在线 小泽玛利亚高潮图片搜索 女性裸b图 肛交bt种子 最热门有声小说 人间添春色 春色猜谜字 樱井莉亚钢管舞视频 小泽玛利亚直美6p 能用的h网 还能看的h网 bl动漫h网 开心五月激 东京热401 男色女色第四色酒色网 怎么下载黄色小说 黄色小说小栽 和谐图城 乐乐影院 色哥导航 特色导航 依依社区 爱窝窝在线 色狼谷成人 91porn 包要你射电影 色色3A丝袜 丝袜妹妹淫网 爱色导航(荐) 好男人激情影院 坏哥哥 第七色 色久久 人格分裂 急先锋 撸撸射中文网 第一会所综合社区 91影院老师机 东方成人激情 怼莪影院吹潮 老鸭窝伊人无码不卡无码一本道 av女柳晶电影 91天生爱风流作品 深爱激情小说私房婷婷网 擼奶av 567pao 里番3d一家人野外 上原在线电影 水岛津实透明丝袜 1314酒色 网旧网俺也去 0855影院 在线无码私人影院 搜索 国产自拍 神马dy888午夜伦理达达兔 农民工黄晓婷 日韩裸体黑丝御姐 屈臣氏的燕窝面膜怎么样つぼみ晶エリーの早漏チ○ポ强化合宿 老熟女人性视频 影音先锋 三上悠亚ol 妹妹影院福利片 hhhhhhhhsxo 午夜天堂热的国产 强奸剧场 全裸香蕉视频无码 亚欧伦理视频 秋霞为什么给封了 日本在线视频空天使 日韩成人aⅴ在线 日本日屌日屄导航视频 在线福利视频 日本推油无码av magnet 在线免费视频 樱井梨吮东 日本一本道在线无码DVD 日本性感诱惑美女做爱阴道流水视频 日本一级av 汤姆avtom在线视频 台湾佬中文娱乐线20 阿v播播下载 橙色影院 奴隶少女护士cg视频 汤姆在线影院无码 偷拍宾馆 业面紧急生级访问 色和尚有线 厕所偷拍一族 av女l 公交色狼优酷视频 裸体视频AV 人与兽肉肉网 董美香ol 花井美纱链接 magnet 西瓜影音 亚洲 自拍 日韩女优欧美激情偷拍自拍 亚洲成年人免费视频 荷兰免费成人电影 深喉呕吐XXⅩX 操石榴在线视频 天天色成人免费视频 314hu四虎 涩久免费视频在线观看 成人电影迅雷下载 能看见整个奶子的香蕉影院 水菜丽百度影音 gwaz079百度云 噜死你们资源站 主播走光视频合集迅雷下载 thumbzilla jappen 精品Av 古川伊织star598在线 假面女皇vip在线视频播放 国产自拍迷情校园 啪啪啪公寓漫画 日本阿AV 黄色手机电影 欧美在线Av影院 华裔电击女神91在线 亚洲欧美专区 1日本1000部免费视频 开放90后 波多野结衣 东方 影院av 页面升级紧急访问每天正常更新 4438Xchengeren 老炮色 a k福利电影 色欲影视色天天视频 高老庄aV 259LUXU-683 magnet 手机在线电影 国产区 欧美激情人人操网 国产 偷拍 直播 日韩 国内外激情在线视频网给 站长统计一本道人妻 光棍影院被封 紫竹铃取汁 ftp 狂插空姐嫩 xfplay 丈夫面前 穿靴子伪街 XXOO视频在线免费 大香蕉道久在线播放 电棒漏电嗨过头 充气娃能看下毛和洞吗 夫妻牲交 福利云点墦 yukun瑟妃 疯狂交换女友 国产自拍26页 腐女资源 百度云 日本DVD高清无码视频 偷拍,自拍AV伦理电影 A片小视频福利站。 大奶肥婆自拍偷拍图片 交配伊甸园 超碰在线视频自拍偷拍国产 小热巴91大神 rctd 045 类似于A片 超美大奶大学生美女直播被男友操 男友问 你的衣服怎么脱掉的 亚洲女与黑人群交视频一 在线黄涩 木内美保步兵番号 鸡巴插入欧美美女的b舒服 激情在线国产自拍日韩欧美 国语福利小视频在线观看 作爱小视颍 潮喷合集丝袜无码mp4 做爱的无码高清视频 牛牛精品 伊aⅤ在线观看 savk12 哥哥搞在线播放 在线电一本道影 一级谍片 250pp亚洲情艺中心,88 欧美一本道九色在线一 wwwseavbacom色av吧 cos美女在线 欧美17,18ⅹⅹⅹ视频 自拍嫩逼 小电影在线观看网站 筱田优 贼 水电工 5358x视频 日本69式视频有码 b雪福利导航 韩国女主播19tvclub在线 操逼清晰视频 丝袜美女国产视频网址导航 水菜丽颜射房间 台湾妹中文娱乐网 风吟岛视频 口交 伦理 日本熟妇色五十路免费视频 A级片互舔 川村真矢Av在线观看 亚洲日韩av 色和尚国产自拍 sea8 mp4 aV天堂2018手机在线 免费版国产偷拍a在线播放 狠狠 婷婷 丁香 小视频福利在线观看平台 思妍白衣小仙女被邻居强上 萝莉自拍有水 4484新视觉 永久发布页 977成人影视在线观看 小清新影院在线观 小鸟酱后丝后入百度云 旋风魅影四级 香蕉影院小黄片免费看 性爱直播磁力链接 小骚逼第一色影院 性交流的视频 小雪小视频bd 小视频TV禁看视频 迷奸AV在线看 nba直播 任你在干线 汤姆影院在线视频国产 624u在线播放 成人 一级a做爰片就在线看狐狸视频 小香蕉AV视频 www182、com 腿模简小育 学生做爱视频 秘密搜查官 快播 成人福利网午夜 一级黄色夫妻录像片 直接看的gav久久播放器 国产自拍400首页 sm老爹影院 谁知道隔壁老王网址在线 综合网 123西瓜影音 米奇丁香 人人澡人人漠大学生 色久悠 夜色视频你今天寂寞了吗? 菲菲影视城美国 被抄的影院 变态另类 欧美 成人 国产偷拍自拍在线小说 不用下载安装就能看的吃男人鸡巴视频 插屄视频 大贯杏里播放 wwwhhh50 233若菜奈央 伦理片天海翼秘密搜查官 大香蕉在线万色屋视频 那种漫画小说你懂的 祥仔电影合集一区 那里可以看澳门皇冠酒店a片 色自啪 亚洲aV电影天堂 谷露影院ar toupaizaixian sexbj。com 毕业生 zaixian mianfei 朝桐光视频 成人短视频在线直接观看 陈美霖 沈阳音乐学院 导航女 www26yjjcom 1大尺度视频 开平虐女视频 菅野雪松协和影视在线视频 华人play在线视频bbb 鸡吧操屄视频 多啪啪免费视频 悠草影院 金兰策划网 (969) 橘佑金短视频 国内一极刺激自拍片 日本制服番号大全magnet 成人动漫母系 电脑怎么清理内存 黄色福利1000 dy88午夜 偷拍中学生洗澡磁力链接 花椒相机福利美女视频 站长推荐磁力下载 mp4 三洞轮流插视频 玉兔miki热舞视频 夜生活小视频 爆乳人妖小视频 国内网红主播自拍福利迅雷下载 不用app的裸裸体美女操逼视频 变态SM影片在线观看 草溜影院元气吧 - 百度 - 百度 波推全套视频 国产双飞集合ftp 日本在线AV网 笔国毛片 神马影院女主播是我的邻居 影音资源 激情乱伦电影 799pao 亚洲第一色第一影院 av视频大香蕉 老梁故事汇希斯莱杰 水中人体磁力链接 下载 大香蕉黄片免费看 济南谭崔 避开屏蔽的岛a片 草破福利 要看大鸡巴操小骚逼的人的视频 黑丝少妇影音先锋 欧美巨乳熟女磁力链接 美国黄网站色大全 伦蕉在线久播 极品女厕沟 激情五月bd韩国电影 混血美女自摸和男友激情啪啪自拍诱人呻吟福利视频 人人摸人人妻做人人看 44kknn 娸娸原网 伊人欧美 恋夜影院视频列表安卓青青 57k影院 如果电话亭 avi 插爆骚女精品自拍 青青草在线免费视频1769TV 令人惹火的邻家美眉 影音先锋 真人妹子被捅动态图 男人女人做完爱视频15 表姐合租两人共处一室晚上她竟爬上了我的床 性爱教学视频 北条麻妃bd在线播放版 国产老师和师生 magnet wwwcctv1024 女神自慰 ftp 女同性恋做激情视频 欧美大胆露阴视频 欧美无码影视 好女色在线观看 后入肥臀18p 百度影视屏福利 厕所超碰视频 强奸mp magnet 欧美妹aⅴ免费线上看 2016年妞干网视频 5手机在线福利 超在线最视频 800av:cOm magnet 欧美性爱免播放器在线播放 91大款肥汤的性感美乳90后邻家美眉趴着窗台后入啪啪 秋霞日本毛片网站 cheng ren 在线视频 上原亚衣肛门无码解禁影音先锋 美脚家庭教师在线播放 尤酷伦理片 熟女性生活视频在线观看 欧美av在线播放喷潮 194avav 凤凰AV成人 - 百度 kbb9999 AV片AV在线AV无码 爱爱视频高清免费观看 黄色男女操b视频 观看 18AV清纯视频在线播放平台 成人性爱视频久久操 女性真人生殖系统双性人视频 下身插入b射精视频 明星潜规测视频 mp4 免賛a片直播绪 国内 自己 偷拍 在线 国内真实偷拍 手机在线 国产主播户外勾在线 三桥杏奈高清无码迅雷下载 2五福电影院凸凹频频 男主拿鱼打女主,高宝宝 色哥午夜影院 川村まや痴汉 草溜影院费全过程免费 淫小弟影院在线视频 laohantuiche 啪啪啪喷潮XXOO视频 青娱乐成人国产 蓝沢润 一本道 亚洲青涩中文欧美 神马影院线理论 米娅卡莉法的av 在线福利65535 欧美粉色在线 欧美性受群交视频1在线播放 极品喷奶熟妇在线播放 变态另类无码福利影院92 天津小姐被偷拍 磁力下载 台湾三级电髟全部 丝袜美腿偷拍自拍 偷拍女生性行为图 妻子的乱伦 白虎少妇 肏婶骚屄 外国大妈会阴照片 美少女操屄图片 妹妹自慰11p 操老熟女的b 361美女人体 360电影院樱桃 爱色妹妹亚洲色图 性交卖淫姿势高清图片一级 欧美一黑对二白 大色网无毛一线天 射小妹网站 寂寞穴 西西人体模特苍井空 操的大白逼吧 骚穴让我操 拉好友干女朋友3p