This is probably blasphemy but…

I think the main purpose of keeping sets together is for resale - if that's not a concern for you (and it doesn't sound like it is) - then make the stamps work for you.

I would probably offer up the ones you don't want (partial sets) as a RAK or package together and donate as a group rather than toss but that's up to you and sometimes tossing is what works best when decluttering.

I would probably make a set of the ones you use and keep that on your desk since you use them regularly.

Laura Wonsik said a couple of years ago that what worked for her was to put all the stamps that are similar to her together.

For example, every stamp that says May will go on the plastic sheet together. All the flowers from the May stamp sets will go together.
And if she's not going to use a stamp, she gets rid of it.

It's your stuff. It's not going to have any value to you if you don't use it. So pull off the ones you want and get rid of the ones you don't.

I give you permission!

Disclaimer: I don't use stamps.

I wouldn't feel obligated to keep something I know I won't use.

I have always done this. Especially with paper pads and assorted sticker sheets. 
I take out the paper I want. I cut out around the stickers that I want. The unwanted goes in the donate pile. 

I started doing that a while back. I just cut out the one(s) that I want. Since I store my stamp sets in Avery Elle pockets I just use them for single stamps. I sort by category. I do the same with dies.

I am pretty left-brained and even I think you should get rid of the ones you won't use. I do find that I get energized after I purge.

My approach with all papercrafting supplies (e.g. stamps, dies, ephemera packs, chipboard sheets) is to keep what I'll use & share/donate the rest. The random image/sentiment stamps from various sets are stored together by manufacturer. HTH. 

This is how I feel. I don't care who sees my stuff. I buy what I like, not because I am on a design team. I have no idea most of the time who has made what I'm using. I just mix it all up. I need to do a better job of purging what I'm not going to use.

i tend to keep the set together if think i will pass it on to someone else someday.  i definitely have sets that have components i will probably never use or don't find appealing.  yet, i keep the set together.

i only toss stamps that have torn or become really gummy (so basically the clear stamps).

I think keeping just your most loved stamps in one place is a great idea. Don't feel any guilt if you just throw the others away. I'd just X out the missing stamp on the packaging and donate the rest.

I find trying to sell things more stressful than it's worth to me.

Thanks for starting this conversation! I was not much of a stamper until the past 2-3 years and now I have too much and can't find or remember to use the ones I like the most. I really like the idea of going through my collection and picking out the single stamps I know or think I will use the most and putting them in their own collections for the next 3-6 months and see how it goes and then donate/sell the unused portions. I definitely have sets that I would keep in tact as I use as a set, but I also have some single stamps that I like and don't use because I don't really use the rest of the set. And, I have too much - I would really like to cull them down. I also wish shipping was less $$ because I would love to give some away, but stamps are heavy + packaging.

I think the big decision for me is how to best group/store the individual ones. I have seen what Laura W does just not sure what I want to do....

So while I was driving back from Mayo this week, I was thinking about the Laura W stamp storage idea. I then looked through some of the image files I've downloaded of stamp sets I've purchased over the years (mostly KP/PP, but also FYC and Ink Road), and trying to figure out how I would categorize things like holiday baking or holiday movie or seasonal/holiday reading stamps. Would I place them under baking or media or TV or books or under the season/holiday? Would I create a seasonal media sub category? This is where my analysis turns into paralysis.

Believe it or not, I actually have two sets of holiday shows/movies stamp sets from KP/PP (from different years). There are some icons/phrases that can be used for any type of movie (for example, the Netflix icon or a journaling image to describe the movie), but then there is a movie chalkboard with holly leaves on it and a Christmas themed popcorn bucket.

There are definitely stamps I will never use, like ones about drinking alcohol or cursing ones or the cats dressed up for Christmas. I am happy to get rid of those. I just get stuck on the other part of how to keep what I want to keep, as it seems pointless to get rid of the stamps I'll never use if I keep the stamps I will use on their original backing.

For me, I’d think about how I would probably use it. I don’t bake except at Christmas, so into my Christmas pile it goes. If, at some random point I decide to bake, I know my baking stamps are with my Christmas stuff.

I really try not to overthink this.

Overthinking is my weakness! 🤣

Knowing how you organize is SO valuable! If having things you don't use in your way is bothersome you should definitely clear them out somehow. And if you know you won't access things in deep storage/quarantine you may as well just give them away or toss them and save having to deal with them later. Easy access is important but easy to put away/tidy even more so!