If you put out some cat food in your yard, you are going to attract cats. One will come and then two. And if you keep putting out the free bennies, you soon will have many cats in your yard. They may catch a mouse or two and even be good cats, but soon they will have kittens and your bill for cat food will skyrocket.
If you don't want the cats, stop feeding them. Guess what? They won't come anymore.