Remove all duplicates except last instance

Wouldn't this just be the standard case for using the 'fromLast' parameter to duplicated?

 dat[ !duplicated(dat[, c("ID", "Date")], fromLast=T),]
#---------
  ID     Date Tally
6  1 2/1/2011     6
7  3 2/1/2011     7
8  4 2/1/2011     8
9  2 2/1/2011     9

Your example was not rich enough to tell whether you needed the "Date" column in the test fro duplication, so perhaps you could simplify. I'm leaving it in to illustrate that duplicated has a data.frame method. I prefer !duplicated to unique because it allows easy access to the set complement if you are comparing groups.


Use dplyr:

data <- data %>%
  group_by(ID) %>%
  slice(which.max(Tally))

Use !rev(duplicated(rev(ID))) to filter out all but the last unique occurrences.

To get the dataset filtered, use dataset[!rev(duplicated(rev(dataset$ID))),]


Using a data.table join, you can set mult = 'last'

For example

library(data.table)
DT <- data.table(DF, key = 'id')

# join with the unique ID values
DT[unique(DT[,list(ID)]), mult= 'last']

   ID     Date Tally
1:  1 2/1/2011     6
2:  2 2/1/2011     9
3:  3 2/1/2011     7
4:  4 2/1/2011     8

If you knew the unique IDs you could also any of the following

DT[.(1:4), mult='last']
DT[list(1:4), mult = 'last']

Tags:

Duplicates

R