The only thing that has held me back thus far from going ahead and investing in hardware for local AI inference is the thought that hardware should continue to improve while the resource cost of these open models continues to become more efficient. But thats pure speculation on my part. While I've been speculating on being able to get a better deal, the cost of this hardware continues to pump.
I have a garden as well and I'm pretty new to gardening, but it's been fun, although I fear I overdid it a bit this year. I had like six tomato plants, cucumbers, carrots, radishes, eggplants, potatoes ...way too many things. Some of them were a complete failure. I've learned a lot, and next year I'll reduce the variety of things that I grow and just focus on the things that worked well for me.
The only thing that has held me back thus far from going ahead and investing in hardware for local AI inference is the thought that hardware should continue to improve while the resource cost of these open models continues to become more efficient. But thats pure speculation on my part. While I've been speculating on being able to get a better deal, the cost of this hardware continues to pump.
I have a garden as well and I'm pretty new to gardening, but it's been fun, although I fear I overdid it a bit this year. I had like six tomato plants, cucumbers, carrots, radishes, eggplants, potatoes ...way too many things. Some of them were a complete failure. I've learned a lot, and next year I'll reduce the variety of things that I grow and just focus on the things that worked well for me.