Tag: hardware

A practical tip for running ~30B parameter models on consumer hardware: combining a modern 16GB card (like 5070Ti) with an older 6GB card (like RTX 2060) enables running larger models by splitting layers across GPUs. The key insight is that fitting everything in VRAM matters more than having matching GPUs, even if one card is significantly weaker.

Leaks describe OpenAI's wearable audio device: metal "eggstone" design worn behind the ear, powered by custom 2nm Samsung Exynos chip designed to command Siri and replace iPhone actions. Bill of materials closer to smartphone than earbuds. The Jony Ive collaboration has apparently prioritized this project.

Qwen team lead publicly states that Chinese AI companies are severely bottlenecked by inference compute rather than training compute. This suggests export controls on inference chips may be more impactful than training restrictions. The comment provides rare insight into how sanctions affect Chinese AI development.