I don't know if this system is up to modern standards, but it is what my mother has used since before I was born, and she is happy with it.
What she has is a gas stove of this type. (I can't recommend a current brand, hers is made in East Germany). Hers is, however, bigger than the one on the pic looks like.

She also has a gas bottle (a mix of propane-butane) sitting in a corner of the kitchen, close to the stove. The bottle is of this type:

On the bottle, a simple valve is mounted:

The bottle is connected to the burner with a simple rubber hose, no need for the installation of pipes. I don't know how much gas is there in a bottle, but it lasts for maybe 3 months. We keep a second, full bottle in the basement, so when one bottle is empty, we clamp on the second one and use it. If you don't have a second bottle, you are left without a stove for the 3-4 days the supplier needs to deliver a full one. I agree that the auto-switching regulator Vicky mentioned sounds very convenient, but I don't know how expensive it is or how much space it needs. The nice thing about our setup is that it is simple and low-cost.
The capacity of such a burner is enough to cook a meal for the extended family (maybe up to a 7-8 l pot). I don't know how it fares at amounts above that, e.g. if you want to cook your whole strawberry bed into jam.
As for safety, we always turn off the valve when the burner is not in use. This means that turning on the burner becomes a three-step action (flip valve open, turn knob at burner, ignite gas), but with the bottle sitting next to the burner, it isn't so much additional effort. As long as the bottle itself is OK (and regulated suppliers should be checking them before refilling), this minimizes the possibility of a leak to times when a cook is in the kitchen and would smell the leak before dangerous levels of gas have accumulated.