Average across Columns in R, excluding NAs
Why NOT the accepted answer?
The accepted answer is correct, however, it is too specific to this particular task and impossible to be generalized. What if we need, instead of mean
, other statistics like var
, skewness
, etc. , or even a custom function?
A more flexible solution:
row_means <- apply(X=data, MARGIN=1, FUN=mean, na.rm=TRUE)
More details on apply
:
Generally, to apply any function (custom or built-in) on the entire dataset, column-wise or row-wise, apply
or one of its variations (sapply
, lapply`, ...) should be used. Its signature is:
apply(X, MARGIN, FUN, na.rm)
where:
X
: The data of form dataframe or matrix.MARGIN
: The dimension on which the aggregation takes place. Use1
for row-wise operation and2
for column-wise operation.FUN
: The operation to be called on the data. Here any pre-defined R functions, as well as any user-defined function could be used.na.rm
: IfTRUE
, theNA
values will be removed beforeFUN
is called.
Why should I use apply
?
For many reasons, including but not limited to:
- Any function can be easily plugged in to
apply
. - For different preferences such as the input or output data types, other variations can be used (e.g.,
lapply
for operations on lists). - (Most importantly) It facilitates scalability since there are versions of this function that allows parallel execution (e.g.
mclapply
from{parallel}
library). For instance, see [+] or [+].
You want rowMeans()
but importantly note it has a na.rm
argument that you want to set to TRUE
. E.g.:
> mat <- matrix(c(23,2,NA,NA,2,9,23,2,9), ncol = 3)
> mat
[,1] [,2] [,3]
[1,] 23 NA 23
[2,] 2 2 2
[3,] NA 9 9
> rowMeans(mat)
[1] NA 2 NA
> rowMeans(mat, na.rm = TRUE)
[1] 23 2 9
To match your example:
> dat <- data.frame(Trait = c("DF","DG","DH"), mat)
> names(dat) <- c("Trait", paste0("Col", 1:3))
> dat
Trait Col1 Col2 Col3
1 DF 23 NA 23
2 DG 2 2 2
3 DH NA 9 9
> dat <- transform(dat, Col4 = rowMeans(dat[,-1], na.rm = TRUE))
> dat
Trait Col1 Col2 Col3 Col4
1 DF 23 NA 23 23
2 DG 2 2 2 2
3 DH NA 9 9 9