Architectures/ARM/AArch64/FoundationModel System Requirements
- CPU: A 64-bit x86_64 system (the model does not run on 32-bit systems). The Model will frequently use 100% of a single core (typically, either 100% or 0%).
- Memory: 4GB plus the amount of memory assigned to the Model (e.g., if the Model is assigned 8 GB, the total memory allocated on the host is 12 GB; if the Model is assigned 4 GB RAM, the total memory allocated on the host is 8 GB)
Running Multiple Models on One Host
On a typical multi-core x86_64 desktop system, the amount of available RAM is more of a limiting factor than the available CPU power. If you have sufficient RAM, it is reasonable to run up to (host_cores-1) models simultaneously.
Running the Model on a Laptop
Since the Foundation Model often runs cores at 100% CPU utilization, using the Model on a laptop may result in short battery life and a lot of heat.
As a rough yardstick, /proc/cpuinfo on the Foundation Model typically reports around 200 "bogomips". An x86_64 host will typically report 5500-6000 bogomips per core.