Using this App

Please cite as: Lakens, D., & Caldwell, A. R. (2019). Simulation-Based Power-Analysis for Factorial ANOVA Designs. https://doi.org/10.31234/osf.io/baxsf
This Shiny app is for performing 'exact' simuations of factorial experimental designs in order to estimate power for an ANOVA and follow-up pairwise comparisons. This app will not allow you to vary the standard deviations or the correlations in within-subjects designs. If you do need/want to violate these assumptions please use the ANOVA_power app.
Click here for the other app

The Design Tab

You must start with the Design tab in order to perform a power analysis. At this stage you must establish the parameters of the design (sample size, standard deviation, etc). *Please note the sample size must be greater than the product of the cells For example, 2b*2w = 4 and requires a sample size of at least 5 per cell. If this is entered incorrectly, then the 'Submit Design' button will be disabled. Once you click 'Submit Design' the design details will appear and you can continue onto the power analysis.

Exact Power Tab

In this tab, you will setup an *exact* simulation. All you can do at this stage is set the alpha level (default=.05) and decide the estimated marinal means analysis (optional)

Power curve Tab

In this tab, you can find your desired power (default = 90%) power across a range of sample sizes. All you need to do is set a minimum and maximum sample size. This tab will also allow you to download csv files including the power of ANOVA and estimated marginal means across a range of sample sizes.

Download your Simulation

Once your simulation is completed a button a button will appear on the sidebar to download a PDF

NEWS

Current updates to Superpower's Exact Shiny App
App uses the updated ANOVA_exact2 function. There are no longer sample size limtations for the function

Design Input

Specify the factorial design below
*Must be specified to continue*
Add numbers for each factor that specify the number of levels in the factors (e.g., 2 for a factor with 2 levels). Add a 'w' after the number for within factors, and a 'b' for between factors. Seperate factors with a * (asterisks). Thus '2b*3w' is a design with two factors, the first of which has 2 between levels, and the second of which has 3 within levels.
Specify one word for each factor (e.g., AGE and SPEED) and the level of each factor (e.g., old and yound for a factor age with 2 levels).
Specify the correlation for within-subjects factors.
Note that for each cell in the design, a mean must be provided. Thus, for a '2b*3w' design, 6 means need to be entered. Means need to be entered in the correct order. The app provides a plot so you can check if you entered means correctly. The general principle has designated factors (i.e., AGE and SPEED) and levels (e.g., old, young).
Means for Each Cell in the Design
Click the button below to set up the design - Check the output to see if the design is as you intended, then you can run the simulation in the next tab.

Design Output


                    

                    

                  

                

              

            

          

          

            
Exact Power for Design

            

              

                

                  

                    
Simulation Parameters

                  

                  

                    

                      

                        
                        

                          
                          
                        

                      

                      

                        
Keeping the default settings will result in all pairwise comparisons being performed.

                        

                          
                          

                            
                            
                          

                        

                        

                          
                          

                            
                            
                          

                        

                        

                          
                          
                        

                        

                        
The addition sign ('+') will add factors for comparisons while factors after a vertical bar '|'  specifies the names of predictors to condition on

                        For more information on setting comparisons
                      

                      

                        
                        
                      

                      
                    

                  

                

              

              

                

                  

                    
Power Analysis Output

                    

                      
                    

                  

                  

                    

                    

                      

                    

                    

                      

                    

                  

                

              

            

          

          

            
Find Desired Power Across a Range of Sample Sizes

            

              

                

                  

                    
Set Min and Max Sample Size

                  

                  

                    

                      
Enter Range of Sample Sizes

                      

                        
                        
                      

                      

                        
                        
                      

                      

                        
                        
                      

                      

                        
                        
                      

                      
                      
Note: No sphercity correction

                      

                        
Download Results for ANOVA and estimated marginal means

                        
                          
                          Download ANOVA Results
                        
                        
                      

                    

                  

                

              

              

                

                  

                    
ANOVA/MANOVA Effects

                    

                      
                    

                  

                  

                    

                    

                  

                

              

              

                

                  

                    
Estimated Marginal Means