javascript - How to remove duplicates in mongoDB with mongoose(NodeJS) - Stack Overflow

admin管理员组

文章数量:1415100

I have a collection in MongoDB where there are around (~200k records). My sample record would look like,

{
    name:String,
    slug:String,
    metaDes:String,
    content:String,
    parentID:String,
    thumbnail:String,
    display:Boolean,
}

I am having a lot of duplicate records in the collection having same slug

I want to remove duplicate records based on slug Is there any fast way to remove all duplicates with mongoose(Nodejs)? Thanks!

I have a collection in MongoDB where there are around (~200k records). My sample record would look like,

{
    name:String,
    slug:String,
    metaDes:String,
    content:String,
    parentID:String,
    thumbnail:String,
    display:Boolean,
}

I am having a lot of duplicate records in the collection having same slug

I want to remove duplicate records based on slug Is there any fast way to remove all duplicates with mongoose(Nodejs)? Thanks!

• javascript
• node.js
• mongodb
• mongoose

Share Improve this question Follow asked Apr 12, 2020 at 6:37 vy.phamvy.pham 62111 gold badge1010 silver badges2323 bronze badges

Add a ment  | 

1 Answer 1

Sorted by: Reset to default 7

Remove duplicate records in the collection having the same slug

db.table.aggregate([
 {
     "$group": {
         _id: {slug: "$slug"},
         slugs: { $addToSet: "$_id" } ,
         count: { $sum : 1 }
     }
 },
 {
     "$match": {
         count: { "$gt": 1 }
     }
 }
]).forEach(function(doc) {
   doc.slugs.shift();
   db.table.remove({
       _id: {$in: doc.slugs}
   });
})

Refarnce link

本文标签： javascriptHow to remove duplicates in mongoDB with mongoose(NodeJS)Stack Overflow