MongoError: cannot infer query fields to set, path 'users' is matched twice

I use this as the condition

{
  "users": {
        $all: [
          {"$elemMatch": userId1},
          {"$elemMatch": userId2}
        ]
  }......
}