Setting budget for non-grocery items?

I lump them all together in one budget.

I budget $20 a week for household.. $30 a week for my beauty (mani pedi eyebrow).. $80 a week for grocery... so essentially 100 at the grocery store... but split

We are cash based.. so every payday I put those amounts in the dreaded Dave Ramsey envelopes.. lol... when I go to the grocery store I take both envelopes... I dont split my transactions.. I just know how much comes out of what envelope... and I carry over.. if I only bought dish soap the week at about 6 bucks.. then the rest stays in the envelope.. because I know at some point I will need shampoo n conditioner and toilet paper all in the same week...

As soon household gets too 100 that we haven't spent... I deposit it to savings and start again with 20...

I don't want or need to break things down to that degree. If we need dishwasher detergent or toothpaste I buy it along with groceries. There may be times I notice that there are more non-food items than usual in the grocery cart, but it's all from the same pot of money.

For me, stuff like paper towels, toilet paper, cleaning supplies, laundry soap, kitty litter, etc...is a part of my regular grocery shopping budget.

Beauty products, such as make up and skin care are not included in my groceries category. I use higher end products and that is my splurge(I don't buy expensive purses or clothes, a lot of shoes, no pricy perfume, no fancy restaurants, etc...)
In general I budget $50-60 a month for beauty. I tend to wait until Sephora sale 2-3 times a year, and stock up then. I roll each months unspent beauty budget to the next month, then when the sale is on I have $200-250+ set aside for what I want. Doing it that way is more cost effective. If I wait until the sale (20%off) I can get $200 worth for $160.

As far as grocery shopping(or any shopping), I try to be wise with my money. I check the ads weekly. I don't buy certain things unless they are on sale(kitty litter, toilet paper, tissues, paper towels, etc....). When things are on sale I buy multiple. which gets me through until it's on sale again. For instance, the kitty litter I use is usually 7.99, but a local store recently had it for $4.99 so I bought four of them. It would have cost me $32 full price, but I paid $20 on sale. 

Perhaps you should revise your shopping categories. Include certain things and move other things to a separate category. I find shopping from a list, deters impulse purchases.
I always think twice(or ten times) when making an impulse purchases. Do I really NEED that, or do I simply want it. Do I already have something similar at home?  More often, than not I will put something back. Recently, I've been asking myself "do I really need or want that, or would I rather put it back and put the funds in my travel money fund instead?". 

I found separating things out too much made tracking too hard. So I keep it simple and lump it in with groceries.

I don't separate it out but I have $200/week for groceries/household items/cats...and whatever else I want/need to buy be it scrapbook supplies or a birthday present or a new pair of jeans. Since that's all the money that goes into the account each week, it's impossible to overspend unless I have money leftover from a previous week.