Doug Binks on Nostr: nprofile1q…tj05z Sure but without certain features for efficient tensor operations ...

nprofile1qy2hwumn8ghj7un9d3shjtnyd968gmewwp6kyqpq09f4fyf3nlr8l5hkspvfe3a8ncazkyj3cguv6z3pclru64gg2z5qftj05z (nprofile…j05z) Sure but without certain features for efficient tensor operations and low bit float support a given GPU could be made which was great for gaming (both in terms of cost and performance) but bad for LLMs. It's a bit harder on CPUs but removing AVX support might be a good step.