Skip to content

vllm.utils.mem_constants

GB_bytes module-attribute

GB_bytes = 1000000000

The number of bytes in one gigabyte (GB).

GiB_bytes module-attribute

GiB_bytes = 1 << 30

The number of bytes in one gibibyte (GiB).

MB_bytes module-attribute

MB_bytes = 1000000

The number of bytes in one megabyte (MB).

MiB_bytes module-attribute

MiB_bytes = 1 << 20

The number of bytes in one mebibyte (MiB).