pull down to refresh
The only thing that has held me back thus far from going ahead and investing in hardware for local AI inference is the thought that hardware should continue to improve while the resource cost of these open models continues to become more efficient. But thats pure speculation on my part. While I've been speculating on being able to get a better deal, the cost of this hardware continues to pump.
I have a garden as well and I'm pretty new to gardening, but it's been fun, although I fear I overdid it a bit this year. I had like six tomato plants, cucumbers, carrots, radishes, eggplants, potatoes ...way too many things. Some of them were a complete failure. I've learned a lot, and next year I'll reduce the variety of things that I grow and just focus on the things that worked well for me.
Running local AI is a step all of us should take. I hope as AI tech progresses the cost to run a local model becomes an inverse relation of the progress. Looking to running my own in the coming years.
The media narrative erupting from state actors is that open source models is a major threat. The truth is they are tryjng to solidify a state-private monopoly on the tech leaving the plebs the crumbs of restricted AI. Just as they couldnt stop pirating, which moved to private trackers, and wont be able to stop private cryptos from flourishing in a subset of society, they wont be able to prevent informed users from maximizing AI resources on their own.
Solar energy and having a garden should be on everyones agenda. We grew radishes, lettuce, and tomatoes this year. Hoping to add some berry plants next year as im a berry fanatic. we used to grow our own when i was a child and i miss not picking my own in the morning to put on some waffles. Solar is still very expensive imo, but the benefits will outweigh the costs of being dependent on the grid especially as energy prices will soar with the contruction of these mega dataceners that will be popping up over the next couple of years.
Im still developing privacy tech for users, but i try to take time for myself to remove my dependency on the system little by little each day.