AI - LLMs - Hardware
Companies
Hardware
PC purchased from online from JD.com while in China for approx $2500 NZD, see links below.
| Type | Item |
|---|---|
| CPU | Intel i9-14900HX |
| Motherboard | Erying Polestar MoTD HX G686B |
| Chipset | Z790 |
| Memory | Juhor 2 x 16GB GB DDR5-5600 CL36 |
| Storage | CF600 1 TB Colorfire Ssd Nvme M2 |
| Video Card | RTX 4090M 16 GB Video Card - Mobile GPU in Desktop form factor |
| Case | Golden Field |
| Power Supply | ATX |
| Case fans | 6x Fans with RGB |
NVidia Card Details
- 16 GB GDDR6 Ram…
- 9728 Cuda cores
- 175 W
- PCI Express x16 GEN4
Note these cards require unofficial NVidia drivers to run eg FrankenDrivers
GPU-Z
Software to run locally
Ollama Results
Nvidia card had no issues running the below models
| Model | Parameters | Size | Download |
|---|---|---|---|
| Llama 3.2 | 3B | 2.0GB | ollama run llama3.2 |
| Llama 3.2 | 1B | 1.3GB | ollama run llama3.2:1b |
| Llama 3.1 | 8B | 4.7GB | ollama run llama3.1 |
AI References
The Coming Wave: How Ai will change everything | FM Camp 2024 Keynote | Slovakia | IMM
Aragorn (nicknamed MrMetaverse by his early audience)
Photo AI
Referenec Links
- JD Link to PC - Note link may not work outside China
