pSceptical {ReplicationSuccess}R Documentation

Computes the sceptical p-value

Description

The sceptical p-value is computed based on the z-values of the original and the replication study and the corresponding variance ratio.

Usage

pSceptical(zo, zr, c, alternative = "one.sided", type="nominal")

Arguments

zo

A vector of z-values from original studies.

zr

A vector of z-values from replication studies.

c

A vector of variance ratios of the original and replication effect estimates. This is usually the ratio of the sample size of the replication study to the sample size of the original study.

alternative

either "one.sided" or "two.sided". Defaults to "one.sided". If "one.sided" then the sceptical p-value is based on a one-sided assessment of replication success in the direction of the original effect estimate. If "two.sided" then the sceptical p-value is based on a two-sided assessment of replication success regardless of the direction of the original and replication effect estimate.

type

Type of recalibration. Default is "nominal", so no recalibration as in Held (2020). This ensures that the sceptical p-value is always larger than both the original and replication p-values. A recalibration is applied if type is "liberal", "controlled" or "golden".

Value

The sceptical p-value.

Author(s)

Leonhard Held

References

Held, L. (2020). A new standard for the analysis and design of replication studies (with discussion). Journal of the Royal Statistical Society: Series A (Statistics in Society). 183(2):431 - 448. https://doi.org/10.1111/rssa.12493

See Also

sampleSizeReplicationSuccess, powerReplicationSuccess, thresholdSceptical

Examples

## two-sided p-values 0.01 and 0.02, relative sample size 2
pSceptical(zo = p2z(0.01), zr = p2z(0.02), c = 2, alternative = "one.sided")
## reverse the studies
pSceptical(zo = p2z(0.02), zr = p2z(0.01), c = 1/2, alternative = "one.sided")
## both p-values 0.01, relative sample size 2
pSceptical(zo = p2z(0.01), zr = p2z(0.01), c = 2, alternative = "two.sided")

[Package ReplicationSuccess version 0.1-3 Index]